[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:58:57.044775   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34191
I20260709 12:58:57.046617   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:58:57.047860   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:57.066509   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:57.066505   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:57.068249   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:57.069855   431 server_base.cc:1061] running on GCE node
I20260709 12:58:58.251681   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:58.251966   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:58.252133   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601938252113 us; error 0 us; skew 500 ppm
I20260709 12:58:58.253050   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:58.259142   431 webserver.cc:533] Webserver started at http://127.0.107.254:38025/ using document root <none> and password file <none>
I20260709 12:58:58.260069   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:58.260416   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:58.261014   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:58.267163   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "d11b087bb05544f6b7375f1a9fed3790"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.275766   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.007s
I20260709 12:58:58.281565   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.282766   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:58:58.283085   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "d11b087bb05544f6b7375f1a9fed3790"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.283402   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:58.357651   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:58.359247   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:58:58.359666   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:58.444576   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34191
I20260709 12:58:58.444664   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34191 every 8 connection(s)
I20260709 12:58:58.453685   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.481828   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: Bootstrap starting.
I20260709 12:58:58.489095   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.491102   498 log.cc:826] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: Log is configured to *not* fsync() on all Append() calls
I20260709 12:58:58.496894   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: No bootstrap required, opened a new log
I20260709 12:58:58.520627   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER }
I20260709 12:58:58.521229   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.521504   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11b087bb05544f6b7375f1a9fed3790, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.522559   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER }
I20260709 12:58:58.523610   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:58.523907   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:58.524295   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.529050   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER }
I20260709 12:58:58.530611   498 leader_election.cc:304] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d11b087bb05544f6b7375f1a9fed3790; no voters: 
I20260709 12:58:58.532928   498 leader_election.cc:290] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:58.533231   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:58.536285   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 1 LEADER]: Becoming Leader. State: Replica: d11b087bb05544f6b7375f1a9fed3790, State: Running, Role: LEADER
I20260709 12:58:58.537474   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER }
I20260709 12:58:58.539136   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:58.552561   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d11b087bb05544f6b7375f1a9fed3790. Latest consensus state: current_term: 1 leader_uuid: "d11b087bb05544f6b7375f1a9fed3790" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER } }
I20260709 12:58:58.552280   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d11b087bb05544f6b7375f1a9fed3790" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11b087bb05544f6b7375f1a9fed3790" member_type: VOTER } }
I20260709 12:58:58.553371   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:58.553509   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:58.557273   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:58.573323   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:58.575981   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:58.595155   511 catalog_manager.cc:1383] Generated new cluster ID: 89190a24566041d78bfe11fc72390cda
I20260709 12:58:58.595460   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:58.614606   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:58.617256   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:58.630313   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: Generated new TSK 0
I20260709 12:58:58.631880   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:58.645325   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:58.655951   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:58.657626   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:58.662458   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:58.662722   431 server_base.cc:1061] running on GCE node
I20260709 12:58:58.663600   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:58.663844   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:58.664062   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601938664041 us; error 0 us; skew 500 ppm
I20260709 12:58:58.664752   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:58.669886   431 webserver.cc:533] Webserver started at http://127.0.107.193:45851/ using document root <none> and password file <none>
I20260709 12:58:58.670442   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:58.670634   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:58.670917   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:58.672045   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "0474c591a4154337a74f518f02e4ce43"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.678016   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:58:58.683583   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.684639   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.002s
I20260709 12:58:58.684968   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "0474c591a4154337a74f518f02e4ce43"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.685284   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:58.710805   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:58.712230   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:58.715056   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:58.719918   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:58.720191   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.720638   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:58.720929   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.836616   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34439
I20260709 12:58:58.836755   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34439 every 8 connection(s)
I20260709 12:58:58.844902   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:58.856736   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:58.862432   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:58.870390   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:58.870556   431 server_base.cc:1061] running on GCE node
I20260709 12:58:58.871558   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:58.871778   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:58.871917   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601938871904 us; error 0 us; skew 500 ppm
I20260709 12:58:58.872550   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:58.875640   431 webserver.cc:533] Webserver started at http://127.0.107.194:41241/ using document root <none> and password file <none>
I20260709 12:58:58.876173   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:58.876421   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:58.876725   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:58.877936   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "786a151463ac4848863ff9c739f0b311"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.884721   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:58.887946   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34191
I20260709 12:58:58.888459   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:58.890259   591 heartbeater.cc:507] Master 127.0.107.254:34191 requested a full tablet report, sending...
I20260709 12:58:58.891213   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.892117   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:58:58.892486   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "786a151463ac4848863ff9c739f0b311"
format_stamp: "Formatted at 2026-07-09 12:58:58 on dist-test-slave-021n"
I20260709 12:58:58.892786   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:58.893759   463 ts_manager.cc:194] Registered new tserver with Master: 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439)
I20260709 12:58:58.896903   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46486
I20260709 12:58:58.915539   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:58.916972   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:58.919389   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:58.923683   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:58.924018   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:58.924288   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:58.924523   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:58:59.041357   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34205
I20260709 12:58:59.041713   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34205 every 8 connection(s)
I20260709 12:58:59.054802   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:59.062852   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:59.065961   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:59.071537   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34191
I20260709 12:58:59.072044   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:59.073283   666 heartbeater.cc:507] Master 127.0.107.254:34191 requested a full tablet report, sending...
I20260709 12:58:59.075971   463 ts_manager.cc:194] Registered new tserver with Master: 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:58:59.077986   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46490
I20260709 12:58:59.078778   431 server_base.cc:1061] running on GCE node
W20260709 12:58:59.079342   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:59.080664   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:59.080988   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:59.081228   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601939081207 us; error 0 us; skew 500 ppm
I20260709 12:58:59.081853   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:59.085001   431 webserver.cc:533] Webserver started at http://127.0.107.195:45065/ using document root <none> and password file <none>
I20260709 12:58:59.085480   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:59.085664   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:59.085912   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:59.087044   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
format_stamp: "Formatted at 2026-07-09 12:58:59 on dist-test-slave-021n"
I20260709 12:58:59.091907   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:59.095773   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:59.096843   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:59.097190   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
format_stamp: "Formatted at 2026-07-09 12:58:59 on dist-test-slave-021n"
I20260709 12:58:59.097505   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:59.110649   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:59.112236   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:59.115319   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:59.118391   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:59.118646   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:59.119203   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:59.119534   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:59.223523   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41855
I20260709 12:58:59.223664   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41855 every 8 connection(s)
I20260709 12:58:59.243585   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34191
I20260709 12:58:59.244210   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:59.245298   740 heartbeater.cc:507] Master 127.0.107.254:34191 requested a full tablet report, sending...
I20260709 12:58:59.248157   463 ts_manager.cc:194] Registered new tserver with Master: 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:58:59.249106   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016553255s
I20260709 12:58:59.250135   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46500
I20260709 12:58:59.311722   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46508:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:59.315975   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:59.437441   703 tablet_service.cc:1511] Processing CreateTablet for tablet 000429b459e44efda90a7a43be3470c2 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:59.441978   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000429b459e44efda90a7a43be3470c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.444902   705 tablet_service.cc:1511] Processing CreateTablet for tablet 25d830e9c3da4be6922452902e8fb6c9 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:59.446194   704 tablet_service.cc:1511] Processing CreateTablet for tablet d0afc0a8df384f56844fc46faa0ba35b (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:59.447959   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d830e9c3da4be6922452902e8fb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.443495   702 tablet_service.cc:1511] Processing CreateTablet for tablet df331c22ebed4e8b9e6b970bb06c620e (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:59.447734   701 tablet_service.cc:1511] Processing CreateTablet for tablet 310b2081dc294ece8bbaba5424bbffec (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:59.451782   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0afc0a8df384f56844fc46faa0ba35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.456354   556 tablet_service.cc:1511] Processing CreateTablet for tablet 25d830e9c3da4be6922452902e8fb6c9 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:59.461704   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d830e9c3da4be6922452902e8fb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.466462   555 tablet_service.cc:1511] Processing CreateTablet for tablet d0afc0a8df384f56844fc46faa0ba35b (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:59.466492   553 tablet_service.cc:1511] Processing CreateTablet for tablet df331c22ebed4e8b9e6b970bb06c620e (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:59.473291   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df331c22ebed4e8b9e6b970bb06c620e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.479341   554 tablet_service.cc:1511] Processing CreateTablet for tablet 000429b459e44efda90a7a43be3470c2 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:59.483281   551 tablet_service.cc:1511] Processing CreateTablet for tablet 9e186344d3f043b3ac2ea2998a2cfcbe (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:59.486127   550 tablet_service.cc:1511] Processing CreateTablet for tablet 90e9d8eae1164168ac8c4e022cb30bbf (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:59.477932   700 tablet_service.cc:1511] Processing CreateTablet for tablet 9e186344d3f043b3ac2ea2998a2cfcbe (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:59.479465   552 tablet_service.cc:1511] Processing CreateTablet for tablet 310b2081dc294ece8bbaba5424bbffec (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:59.490310   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310b2081dc294ece8bbaba5424bbffec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.493839   699 tablet_service.cc:1511] Processing CreateTablet for tablet 90e9d8eae1164168ac8c4e022cb30bbf (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:59.497287   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0afc0a8df384f56844fc46faa0ba35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.498482   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e186344d3f043b3ac2ea2998a2cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.501573   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e186344d3f043b3ac2ea2998a2cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.512933   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e9d8eae1164168ac8c4e022cb30bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.516573   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310b2081dc294ece8bbaba5424bbffec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.517705   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000429b459e44efda90a7a43be3470c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.520921   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e9d8eae1164168ac8c4e022cb30bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.529516   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df331c22ebed4e8b9e6b970bb06c620e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.531037   549 tablet_service.cc:1511] Processing CreateTablet for tablet e4fce4ffd3fb4021a9ceab820ced2714 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:59.536698   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fce4ffd3fb4021a9ceab820ced2714. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:59.563323   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:59.588487   698 tablet_service.cc:1511] Processing CreateTablet for tablet e4fce4ffd3fb4021a9ceab820ced2714 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:59.598830   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fce4ffd3fb4021a9ceab820ced2714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.606611   631 tablet_service.cc:1511] Processing CreateTablet for tablet 25d830e9c3da4be6922452902e8fb6c9 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:59.622501   625 tablet_service.cc:1511] Processing CreateTablet for tablet 90e9d8eae1164168ac8c4e022cb30bbf (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:59.624902   627 tablet_service.cc:1511] Processing CreateTablet for tablet 310b2081dc294ece8bbaba5424bbffec (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:59.612052   628 tablet_service.cc:1511] Processing CreateTablet for tablet df331c22ebed4e8b9e6b970bb06c620e (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:59.626366   630 tablet_service.cc:1511] Processing CreateTablet for tablet d0afc0a8df384f56844fc46faa0ba35b (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:59.629544   629 tablet_service.cc:1511] Processing CreateTablet for tablet 000429b459e44efda90a7a43be3470c2 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:59.641651   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d830e9c3da4be6922452902e8fb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.641873   626 tablet_service.cc:1511] Processing CreateTablet for tablet 9e186344d3f043b3ac2ea2998a2cfcbe (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:59.657284   624 tablet_service.cc:1511] Processing CreateTablet for tablet e4fce4ffd3fb4021a9ceab820ced2714 (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:59.644032   548 tablet_service.cc:1511] Processing CreateTablet for tablet b7d34d249566461f926acfb7128635eb (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:59.661834   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e9d8eae1164168ac8c4e022cb30bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.664114   623 tablet_service.cc:1511] Processing CreateTablet for tablet b7d34d249566461f926acfb7128635eb (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:59.674300   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d34d249566461f926acfb7128635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.678332   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000429b459e44efda90a7a43be3470c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.683158   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0afc0a8df384f56844fc46faa0ba35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.686177   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df331c22ebed4e8b9e6b970bb06c620e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.688338   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fce4ffd3fb4021a9ceab820ced2714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.690469   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e186344d3f043b3ac2ea2998a2cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.691795   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d34d249566461f926acfb7128635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.703326   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310b2081dc294ece8bbaba5424bbffec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.748023   703 tablet_service.cc:1511] Processing CreateTablet for tablet b7d34d249566461f926acfb7128635eb (DEFAULT_TABLE table=test-workload [id=27c204932f004c16994948736d7adb4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:59.749573   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d34d249566461f926acfb7128635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.805132   758 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:58:59.829990   759 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:58:59.852137   759 tablet_bootstrap.cc:654] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.864389   760 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:58:59.870750   758 tablet_bootstrap.cc:654] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.877372   760 tablet_bootstrap.cc:654] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.883105   759 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:58:59.883649   759 ts_tablet_manager.cc:1403] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.054s	user 0.000s	sys 0.019s
I20260709 12:58:59.887822   759 raft_consensus.cc:359] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.888693   759 raft_consensus.cc:385] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.889151   759 raft_consensus.cc:740] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.889945   758 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:58:59.890542   758 ts_tablet_manager.cc:1403] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.000s
I20260709 12:58:59.889956   759 consensus_queue.cc:260] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.894424   760 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:58:59.894536   758 raft_consensus.cc:359] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.895092   760 ts_tablet_manager.cc:1403] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.012s
I20260709 12:58:59.895381   758 raft_consensus.cc:385] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.895728   758 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.896561   758 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.898968   760 raft_consensus.cc:359] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.900022   760 raft_consensus.cc:385] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.901420   759 ts_tablet_manager.cc:1434] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:58:59.902108   591 heartbeater.cc:499] Master 127.0.107.254:34191 was elected leader, sending a full tablet report...
I20260709 12:58:59.903374   759 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:58:59.900556   760 raft_consensus.cc:740] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.906689   760 consensus_queue.cc:260] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.912701   759 tablet_bootstrap.cc:654] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.915607   666 heartbeater.cc:499] Master 127.0.107.254:34191 was elected leader, sending a full tablet report...
I20260709 12:58:59.916674   760 ts_tablet_manager.cc:1434] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:58:59.918437   760 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:58:59.925982   760 tablet_bootstrap.cc:654] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.935075   759 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:58:59.935724   759 ts_tablet_manager.cc:1403] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 12:58:59.939028   759 raft_consensus.cc:359] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.939898   759 raft_consensus.cc:385] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.940217   759 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.941154   759 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.944360   760 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:58:59.944870   760 ts_tablet_manager.cc:1403] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 12:58:59.945503   759 ts_tablet_manager.cc:1434] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:58:59.946904   740 heartbeater.cc:499] Master 127.0.107.254:34191 was elected leader, sending a full tablet report...
I20260709 12:58:59.947372   758 ts_tablet_manager.cc:1434] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.057s	user 0.036s	sys 0.022s
I20260709 12:58:59.947780   760 raft_consensus.cc:359] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.948443   758 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:58:59.948583   760 raft_consensus.cc:385] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.948943   760 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.946470   759 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:58:59.952950   760 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.958956   758 tablet_bootstrap.cc:654] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.960075   760 ts_tablet_manager.cc:1434] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:58:59.961958   760 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:58:59.969355   760 tablet_bootstrap.cc:654] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.971217   759 tablet_bootstrap.cc:654] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.975601   758 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:58:59.976128   758 ts_tablet_manager.cc:1403] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.008s
I20260709 12:58:59.979213   758 raft_consensus.cc:359] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.979892   758 raft_consensus.cc:385] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.980124   758 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.980373   760 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:58:59.980855   760 ts_tablet_manager.cc:1403] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:58:59.981016   758 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.983600   758 ts_tablet_manager.cc:1434] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:59.983680   760 raft_consensus.cc:359] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:58:59.984447   760 raft_consensus.cc:385] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.984592   758 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:58:59.984935   760 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.985713   760 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
W20260709 12:58:59.987202   741 tablet.cc:2406] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:59.988164   760 ts_tablet_manager.cc:1434] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:59.989154   760 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:58:59.996927   760 tablet_bootstrap.cc:654] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.997126   758 tablet_bootstrap.cc:654] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.997934   766 raft_consensus.cc:493] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.998517   766 raft_consensus.cc:515] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.003844   766 leader_election.cc:290] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.036684   766 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.037171   766 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.037791   759 tablet_bootstrap.cc:492] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.039358   759 ts_tablet_manager.cc:1403] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.021s
I20260709 12:59:00.044844   766 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.054309   759 raft_consensus.cc:359] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.056048   759 raft_consensus.cc:385] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.061364   758 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.063139   758 ts_tablet_manager.cc:1403] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.014s
I20260709 12:59:00.056834   759 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.068840   765 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.070465   765 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.070442   758 raft_consensus.cc:359] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.076867   765 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.074975   758 raft_consensus.cc:385] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.078027   758 raft_consensus.cc:740] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.077220   759 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.084851   760 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.081324   758 consensus_queue.cc:260] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.095853   759 ts_tablet_manager.cc:1434] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 12:59:00.097030   759 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.093077   760 ts_tablet_manager.cc:1403] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.033s
I20260709 12:59:00.149725   758 ts_tablet_manager.cc:1434] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.001s
I20260709 12:59:00.156296   759 tablet_bootstrap.cc:654] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.156718   758 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:59:00.221570   759 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.222123   759 ts_tablet_manager.cc:1403] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.005s
I20260709 12:59:00.227711   759 raft_consensus.cc:359] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.228480   759 raft_consensus.cc:385] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.228796   759 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.229496   759 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.232110   759 ts_tablet_manager.cc:1434] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:59:00.233029   759 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.241391   759 tablet_bootstrap.cc:654] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.257314   759 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.257973   759 ts_tablet_manager.cc:1403] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:59:00.262149   759 raft_consensus.cc:359] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.262995   759 raft_consensus.cc:385] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.263281   759 raft_consensus.cc:740] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.263967   759 consensus_queue.cc:260] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.269412   759 ts_tablet_manager.cc:1434] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:59:00.270710   759 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.277976   759 tablet_bootstrap.cc:654] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.278904   766 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.279476   766 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.281761   766 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.283154   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.284194   565 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 0.
I20260709 12:59:00.286580   607 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.287889   766 raft_consensus.cc:2804] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.288254   766 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.288906   766 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.290311   759 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.290810   759 ts_tablet_manager.cc:1403] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:59:00.296790   758 tablet_bootstrap.cc:654] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.297344   759 raft_consensus.cc:359] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.298111   759 raft_consensus.cc:385] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.298403   759 raft_consensus.cc:740] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.298350   766 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.299664   759 consensus_queue.cc:260] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.301316   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.302449   766 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.302665   564 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 0.
I20260709 12:59:00.302635   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.304193   565 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.304566   607 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.305137   759 ts_tablet_manager.cc:1434] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:59:00.307746   766 raft_consensus.cc:2804] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.307925   759 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.308176   766 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.308753   766 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.317837   764 raft_consensus.cc:493] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.318336   764 raft_consensus.cc:515] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.319640   565 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.322098   607 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.323729   759 tablet_bootstrap.cc:654] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.323822   784 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.324895   784 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.325899   760 raft_consensus.cc:359] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.326740   760 raft_consensus.cc:385] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.327028   760 raft_consensus.cc:740] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.330379   784 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.329979   760 consensus_queue.cc:260] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.331621   764 leader_election.cc:290] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.337447   766 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.354238   766 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.360765   766 raft_consensus.cc:2804] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.361272   766 raft_consensus.cc:697] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:00.361795   758 tablet_bootstrap.cc:492] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.362401   758 ts_tablet_manager.cc:1403] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.020s
I20260709 12:59:00.362193   766 consensus_queue.cc:237] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.370126   758 raft_consensus.cc:359] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.371161   758 raft_consensus.cc:385] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.371556   758 raft_consensus.cc:740] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.373279   758 consensus_queue.cc:260] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.375289   765 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.375718   765 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.377373   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.377739   765 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.378000   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.378311   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.378742   712 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.378657   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.386543   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.387494   565 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 0.
W20260709 12:59:00.388075   607 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34439, user_credentials={real_user=slave}} blocked reactor thread for 66099.6us
I20260709 12:59:00.384684   758 ts_tablet_manager.cc:1434] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 12:59:00.405784   758 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
W20260709 12:59:00.417303   606 leader_election.cc:343] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.417544   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.381735   760 ts_tablet_manager.cc:1434] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.274s	user 0.015s	sys 0.010s
I20260709 12:59:00.420616   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.422649   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.426708   765 raft_consensus.cc:493] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.427263   765 raft_consensus.cc:515] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
W20260709 12:59:00.427664   606 leader_election.cc:343] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.429170   760 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:59:00.432538   764 raft_consensus.cc:493] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.433292   764 raft_consensus.cc:515] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
W20260709 12:59:00.429108   681 leader_election.cc:343] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:00.445361   681 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34205, user_credentials={real_user=slave}} blocked reactor thread for 55460.3us
I20260709 12:59:00.446226   681 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.452857   565 raft_consensus.cc:2393] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in current term 1: Already voted for candidate 786a151463ac4848863ff9c739f0b311 in this term.
I20260709 12:59:00.453317   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.456700   564 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.444205   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.453804   712 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.470292   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.473457   764 leader_election.cc:290] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.471913   765 leader_election.cc:290] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
W20260709 12:59:00.474380   606 leader_election.cc:343] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.476426   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.477841   566 raft_consensus.cc:2468] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 0.
I20260709 12:59:00.479563   793 raft_consensus.cc:2804] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.482970   793 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.483358   793 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.484750   607 leader_election.cc:304] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:00.489082   764 raft_consensus.cc:493] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.491547   764 raft_consensus.cc:515] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.487919   787 raft_consensus.cc:2804] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.494029   787 raft_consensus.cc:493] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.495246   564 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.494865   787 raft_consensus.cc:3060] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.495664   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.496330   764 leader_election.cc:290] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.493388   463 catalog_manager.cc:5697] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 0 to 1, leader changed from <none> to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.490187   681 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311
W20260709 12:59:00.503440   681 leader_election.cc:343] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.505388   759 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.505945   759 ts_tablet_manager.cc:1403] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.198s	user 0.031s	sys 0.027s
I20260709 12:59:00.505218   607 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:00.508478   765 raft_consensus.cc:2749] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.509470   766 raft_consensus.cc:2804] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.509361   759 raft_consensus.cc:359] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.510749   766 raft_consensus.cc:697] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:00.513794   766 consensus_queue.cc:237] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.510820   759 raft_consensus.cc:385] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.515740   759 raft_consensus.cc:740] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.518814   759 consensus_queue.cc:260] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.521502   759 ts_tablet_manager.cc:1434] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
W20260709 12:59:00.513136   681 leader_election.cc:343] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.521966   787 raft_consensus.cc:515] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.522563   759 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.527472   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.524642   681 leader_election.cc:304] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.531986   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.534152   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.534230   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.535840   765 raft_consensus.cc:2749] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.538066   639 raft_consensus.cc:2393] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0474c591a4154337a74f518f02e4ce43 in current term 1: Already voted for candidate 786a151463ac4848863ff9c739f0b311 in this term.
W20260709 12:59:00.534240   532 leader_election.cc:343] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.537196   640 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 0.
W20260709 12:59:00.539271   532 leader_election.cc:343] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.539757   760 tablet_bootstrap.cc:654] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.544348   758 tablet_bootstrap.cc:654] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.542918   532 leader_election.cc:304] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.546880   764 raft_consensus.cc:2804] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.547487   764 raft_consensus.cc:493] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.548035   764 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.550333   787 leader_election.cc:290] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.552156   759 tablet_bootstrap.cc:654] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.545538   793 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.553606   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.554315   564 raft_consensus.cc:3060] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.555387   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.556694   712 raft_consensus.cc:2393] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0474c591a4154337a74f518f02e4ce43 in current term 1: Already voted for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in this term.
I20260709 12:59:00.556370   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.558223   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.558917   712 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 0.
W20260709 12:59:00.559597   606 leader_election.cc:343] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.560663   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.563591   531 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.563992   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
W20260709 12:59:00.566771   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:00.568347   784 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:00.569016   531 leader_election.cc:343] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.569446   531 leader_election.cc:304] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.570691   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.575439   764 raft_consensus.cc:515] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.579031   764 leader_election.cc:290] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.581919   784 raft_consensus.cc:2749] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.580241   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:00.582147   564 raft_consensus.cc:2468] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.581943   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:00.582645   639 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:00.584040   681 leader_election.cc:343] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.583627   607 leader_election.cc:304] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:00.586835   760 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.587083   787 raft_consensus.cc:2804] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.587329   760 ts_tablet_manager.cc:1403] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.013s
I20260709 12:59:00.587585   787 raft_consensus.cc:697] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:00.589673   787 consensus_queue.cc:237] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.580399   793 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.588456   764 raft_consensus.cc:2749] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.597185   760 raft_consensus.cc:359] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.607494   639 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 1.
I20260709 12:59:00.608180   566 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 1.
I20260709 12:59:00.608937   532 leader_election.cc:304] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.602047   760 raft_consensus.cc:385] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.610870   797 raft_consensus.cc:2804] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.611757   797 raft_consensus.cc:697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:00.612708   759 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.613170   759 ts_tablet_manager.cc:1403] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.008s
W20260709 12:59:00.605146   531 leader_election.cc:343] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.613713   531 leader_election.cc:304] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.611196   760 raft_consensus.cc:740] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.616431   759 raft_consensus.cc:359] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.617882   759 raft_consensus.cc:385] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.618245   759 raft_consensus.cc:740] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.619459   784 raft_consensus.cc:2749] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.619712   681 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.620848   793 raft_consensus.cc:2804] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.621313   793 raft_consensus.cc:697] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:00.618444   760 consensus_queue.cc:260] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.621999   793 consensus_queue.cc:237] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.623951   760 ts_tablet_manager.cc:1434] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 12:59:00.625168   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.612736   797 consensus_queue.cc:237] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.625780   712 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.625358   760 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:59:00.628613   758 tablet_bootstrap.cc:492] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.629115   758 ts_tablet_manager.cc:1403] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.224s	user 0.025s	sys 0.021s
I20260709 12:59:00.619043   759 consensus_queue.cc:260] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.635913   712 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 1.
I20260709 12:59:00.637243   764 raft_consensus.cc:493] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.637739   764 raft_consensus.cc:515] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.639495   764 leader_election.cc:290] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.641747   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.640928   758 raft_consensus.cc:359] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.645260   759 ts_tablet_manager.cc:1434] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:59:00.646306   759 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: Bootstrap starting.
I20260709 12:59:00.643959   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.644029   758 raft_consensus.cc:385] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.647646   758 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.648633   758 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.646950   712 raft_consensus.cc:2468] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 0.
W20260709 12:59:00.650800   532 leader_election.cc:343] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.654022   758 ts_tablet_manager.cc:1434] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:59:00.655630   760 tablet_bootstrap.cc:654] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.656204   758 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:59:00.657364   531 leader_election.cc:304] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.663945   462 catalog_manager.cc:5697] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:00.666676   759 tablet_bootstrap.cc:654] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.671746   460 catalog_manager.cc:5697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.667027   797 raft_consensus.cc:2804] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.674980   797 raft_consensus.cc:493] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.675359   797 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.689828   760 tablet_bootstrap.cc:492] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.690340   760 ts_tablet_manager.cc:1403] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.011s
I20260709 12:59:00.693563   760 raft_consensus.cc:359] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.695097   760 raft_consensus.cc:385] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.695406   760 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.696328   760 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.696296   461 catalog_manager.cc:5697] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 0 to 1, leader changed from <none> to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.698884   760 ts_tablet_manager.cc:1434] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:00.698277   461 catalog_manager.cc:5697] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 0 to 1, leader changed from <none> to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.699189   797 raft_consensus.cc:515] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.699832   760 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:59:00.698372   758 tablet_bootstrap.cc:654] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.702646   797 leader_election.cc:290] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.707813   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.708412   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:00.708673   712 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:00.710179   532 leader_election.cc:343] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.713959   759 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: No bootstrap required, opened a new log
I20260709 12:59:00.714455   759 ts_tablet_manager.cc:1403] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.009s
I20260709 12:59:00.716185   760 tablet_bootstrap.cc:654] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.721642   759 raft_consensus.cc:359] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.722571   759 raft_consensus.cc:385] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.722936   759 raft_consensus.cc:740] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.723760   759 consensus_queue.cc:260] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.726274   759 ts_tablet_manager.cc:1434] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:59:00.728066   712 raft_consensus.cc:2468] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 1.
I20260709 12:59:00.729223   531 leader_election.cc:304] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.730332   784 raft_consensus.cc:2804] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.730767   784 raft_consensus.cc:697] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:00.731021   758 tablet_bootstrap.cc:492] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.731456   758 ts_tablet_manager.cc:1403] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.003s
I20260709 12:59:00.731547   784 consensus_queue.cc:237] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.728696   797 raft_consensus.cc:493] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.735491   758 raft_consensus.cc:359] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.735790   797 raft_consensus.cc:515] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.736253   758 raft_consensus.cc:385] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.736624   758 raft_consensus.cc:740] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.738504   797 leader_election.cc:290] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.738870   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.739514   639 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 0.
I20260709 12:59:00.739662   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.737491   758 consensus_queue.cc:260] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.740984   532 leader_election.cc:304] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.742151   797 raft_consensus.cc:2804] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.742533   797 raft_consensus.cc:493] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.743063   758 ts_tablet_manager.cc:1434] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:59:00.742887   797 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.744279   758 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
W20260709 12:59:00.745570   531 leader_election.cc:343] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.753796   797 raft_consensus.cc:515] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.754639   758 tablet_bootstrap.cc:654] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.754946   760 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.759346   760 ts_tablet_manager.cc:1403] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.007s
I20260709 12:59:00.765592   462 catalog_manager.cc:5697] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.768985   760 raft_consensus.cc:359] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.769783   760 raft_consensus.cc:385] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.770072   760 raft_consensus.cc:740] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.773638   797 leader_election.cc:290] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.774184   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:00.774899   639 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.774482   760 consensus_queue.cc:260] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.775970   758 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.776503   758 ts_tablet_manager.cc:1403] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.016s
I20260709 12:59:00.777165   760 ts_tablet_manager.cc:1434] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:59:00.778158   760 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:59:00.780189   758 raft_consensus.cc:359] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.780972   758 raft_consensus.cc:385] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.781270   758 raft_consensus.cc:740] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.782059   758 consensus_queue.cc:260] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.784539   758 ts_tablet_manager.cc:1434] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:00.784641   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.785804   758 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
W20260709 12:59:00.786108   531 leader_election.cc:343] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:00.789655   760 tablet_bootstrap.cc:654] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.789856   639 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 1.
I20260709 12:59:00.791031   532 leader_election.cc:304] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:00.791865   797 raft_consensus.cc:2804] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.792342   797 raft_consensus.cc:697] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:00.792848   758 tablet_bootstrap.cc:654] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.793123   797 consensus_queue.cc:237] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.804210   461 catalog_manager.cc:5697] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.806810   758 tablet_bootstrap.cc:492] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.807322   758 ts_tablet_manager.cc:1403] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:59:00.807857   787 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:00.809960   758 raft_consensus.cc:359] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.810634   758 raft_consensus.cc:385] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.810901   758 raft_consensus.cc:740] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.811589   758 consensus_queue.cc:260] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.813491   758 ts_tablet_manager.cc:1434] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:00.814438   758 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: Bootstrap starting.
I20260709 12:59:00.821535   758 tablet_bootstrap.cc:654] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.823943   760 tablet_bootstrap.cc:492] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.824621   760 ts_tablet_manager.cc:1403] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.001s
I20260709 12:59:00.827863   760 raft_consensus.cc:359] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.828888   760 raft_consensus.cc:385] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.829260   760 raft_consensus.cc:740] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.830008   760 consensus_queue.cc:260] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.830873   758 tablet_bootstrap.cc:492] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: No bootstrap required, opened a new log
I20260709 12:59:00.831333   758 ts_tablet_manager.cc:1403] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:59:00.832019   760 ts_tablet_manager.cc:1434] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:00.833986   758 raft_consensus.cc:359] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.834787   758 raft_consensus.cc:385] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.835094   758 raft_consensus.cc:740] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.837198   760 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: Bootstrap starting.
I20260709 12:59:00.837198   758 consensus_queue.cc:260] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.840173   758 ts_tablet_manager.cc:1434] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:59:00.844518   760 tablet_bootstrap.cc:654] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:00.872187   790 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:00.873829   760 tablet_bootstrap.cc:492] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: No bootstrap required, opened a new log
I20260709 12:59:00.874393   760 ts_tablet_manager.cc:1403] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.012s
I20260709 12:59:00.877118   760 raft_consensus.cc:359] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.877931   760 raft_consensus.cc:385] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:00.878268   760 raft_consensus.cc:740] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Initialized, Role: FOLLOWER
I20260709 12:59:00.879009   760 consensus_queue.cc:260] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.881104   760 ts_tablet_manager.cc:1434] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:00.892943   787 raft_consensus.cc:493] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.893448   787 raft_consensus.cc:515] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.896682   787 leader_election.cc:290] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.897480   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.897790   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.898502   712 raft_consensus.cc:2393] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 786a151463ac4848863ff9c739f0b311 in current term 1: Already voted for candidate 0474c591a4154337a74f518f02e4ce43 in this term.
I20260709 12:59:00.899760   793 raft_consensus.cc:493] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.899537   606 leader_election.cc:304] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 786a151463ac4848863ff9c739f0b311; no voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:00.900367   793 raft_consensus.cc:515] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.901489   787 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.902779   793 leader_election.cc:290] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.905210   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.907577   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e9d8eae1164168ac8c4e022cb30bbf" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.908459   566 raft_consensus.cc:2393] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in current term 1: Already voted for candidate 786a151463ac4848863ff9c739f0b311 in this term.
I20260709 12:59:00.909041   787 raft_consensus.cc:2749] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.909708   681 leader_election.cc:304] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.910384   793 raft_consensus.cc:3060] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.914674   793 raft_consensus.cc:2749] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.919766   793 raft_consensus.cc:493] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.920207   793 raft_consensus.cc:515] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.923087   793 leader_election.cc:290] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.923883   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.924154   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.924840   639 raft_consensus.cc:2393] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in current term 1: Already voted for candidate 0474c591a4154337a74f518f02e4ce43 in this term.
I20260709 12:59:00.925737   681 leader_election.cc:304] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:00.927335   793 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.932602   793 raft_consensus.cc:2749] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:00.951373   793 raft_consensus.cc:493] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.951884   793 raft_consensus.cc:515] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.953619   793 leader_election.cc:290] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.954632   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.954793   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:00.955406   639 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 0.
I20260709 12:59:00.955369   566 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 0.
I20260709 12:59:00.956527   681 leader_election.cc:304] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.957304   793 raft_consensus.cc:2804] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.957667   793 raft_consensus.cc:493] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.958009   793 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.962705   787 raft_consensus.cc:493] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.962931   793 raft_consensus.cc:515] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.963258   787 raft_consensus.cc:515] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.964839   793 leader_election.cc:290] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:00.965426   787 leader_election.cc:290] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.966715   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:00.966915   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.967412   564 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 0.
I20260709 12:59:00.967619   566 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.968048   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" is_pre_election: true
I20260709 12:59:00.968700   712 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 0.
I20260709 12:59:00.969900   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:00.970146   606 leader_election.cc:304] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.970932   639 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.971865   787 raft_consensus.cc:2804] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:00.972507   787 raft_consensus.cc:493] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.973099   787 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.980266   566 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 1.
I20260709 12:59:00.980666   639 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 1.
I20260709 12:59:00.982124   681 leader_election.cc:304] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:00.982676   787 raft_consensus.cc:515] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.983250   793 raft_consensus.cc:2804] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.984122   793 raft_consensus.cc:697] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:00.984386   787 leader_election.cc:290] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:00.984951   793 consensus_queue.cc:237] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:00.985643   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:00.985879   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:00.986266   566 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.986400   712 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:00.993476   566 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.993763   712 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 1.
I20260709 12:59:00.994884   607 leader_election.cc:304] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:00.996500   787 raft_consensus.cc:2804] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:00.997000   787 raft_consensus.cc:697] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:00.997831   787 consensus_queue.cc:237] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.003062   462 catalog_manager.cc:5697] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.007728   461 catalog_manager.cc:5697] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 0 to 1, leader changed from <none> to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.015648   793 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.027557   639 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:01.038793   793 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.039698   797 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.057627   825 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.058185   825 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.061167   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0474c591a4154337a74f518f02e4ce43" is_pre_election: true
I20260709 12:59:01.061969   566 raft_consensus.cc:2393] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in current term 1: Already voted for candidate 786a151463ac4848863ff9c739f0b311 in this term.
I20260709 12:59:01.064344   825 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:01.065349   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786a151463ac4848863ff9c739f0b311" is_pre_election: true
I20260709 12:59:01.066788   681 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311
I20260709 12:59:01.068876   787 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.073346   793 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:01.081938   793 raft_consensus.cc:2749] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:01.082305   784 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.130259   766 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:01.175417   587 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6060 after lost signal to thread 434
W20260709 12:59:01.176229   587 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6740 after lost signal to thread 497
W20260709 12:59:01.177290   587 debug-util.cc:398] Leaking SignalData structure 0x7b0800133180 after lost signal to thread 590
I20260709 12:59:01.179235   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:42734
I20260709 12:59:01.180397   639 raft_consensus.cc:606] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Received request to transfer leadership to TS 0474c591a4154337a74f518f02e4ce43
I20260709 12:59:01.189527   766 consensus_queue.cc:1048] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.211181   787 consensus_queue.cc:1048] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.214704   784 consensus_queue.cc:1048] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.266772   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
mode: GRACEFUL
new_leader_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:38726
I20260709 12:59:01.267424   712 raft_consensus.cc:606] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Received request to transfer leadership to TS 0474c591a4154337a74f518f02e4ce43
I20260709 12:59:01.272233   764 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.278257   784 consensus_queue.cc:1048] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.313401   839 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.331431   790 raft_consensus.cc:993] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: : Instructing follower 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:01.332024   790 raft_consensus.cc:1081] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Signalling peer 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:01.336504   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:37402
I20260709 12:59:01.337145   564 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:01.337520   564 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.351162   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:37424
I20260709 12:59:01.351831   566 raft_consensus.cc:606] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:01.355849   564 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.359349   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:01.359951   639 raft_consensus.cc:3055] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:01.360270   639 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:01.361153   639 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.362408   639 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.368637   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:38726
I20260709 12:59:01.369284   712 raft_consensus.cc:606] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:01.369341   564 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 2 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:01.370714   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:01.371274   712 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.373349   639 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 2.
I20260709 12:59:01.374526   532 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:01.375404   839 raft_consensus.cc:2804] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.375846   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7d34d249566461f926acfb7128635eb"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:42734
I20260709 12:59:01.376623   640 raft_consensus.cc:606] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Received request to transfer leadership to TS 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:01.375890   839 raft_consensus.cc:697] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:01.377892   839 consensus_queue.cc:237] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.383899   712 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 2.
I20260709 12:59:01.385797   462 catalog_manager.cc:5697] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 1 to 2, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.432451   793 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.451606   765 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.472677   787 consensus_queue.cc:1048] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:01.479262   765 raft_consensus.cc:993] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:01.479826   765 raft_consensus.cc:1081] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:01.488247   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42712
I20260709 12:59:01.488958   640 raft_consensus.cc:493] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:01.489409   640 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.497948   640 raft_consensus.cc:515] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.501487   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:01.502251   564 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.510392   564 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:01.510634   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:01.511191   713 raft_consensus.cc:3055] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:01.511488   713 raft_consensus.cc:740] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:01.511722   607 leader_election.cc:304] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:01.512549   787 raft_consensus.cc:2804] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.512285   713 consensus_queue.cc:260] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.513422   713 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.513010   787 raft_consensus.cc:697] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:01.514568   787 consensus_queue.cc:237] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.519065   766 raft_consensus.cc:993] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: : Instructing follower 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:01.519529   766 raft_consensus.cc:1081] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Signalling peer 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:01.523602   713 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:01.524221   640 leader_election.cc:290] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:01.525786   790 consensus_queue.cc:1048] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.532076   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7d34d249566461f926acfb7128635eb"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:01.532733   712 raft_consensus.cc:493] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:01.533119   712 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.535485   765 raft_consensus.cc:993] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: : Instructing follower 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:01.535956   825 raft_consensus.cc:1081] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Signalling peer 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:01.538204   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:59:01.538790   565 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:01.539162   565 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.548288   460 catalog_manager.cc:5697] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 1 to 2, leader changed from 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.548096   565 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.571316   565 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 2 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:01.571450   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:01.572896   640 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.567132   712 raft_consensus.cc:515] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.575924   713 raft_consensus.cc:1240] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Rejecting Update request from peer 786a151463ac4848863ff9c739f0b311 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:01.580475   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:01.581319   565 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.581434   787 consensus_queue.cc:1059] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.582310   787 raft_consensus.cc:3055] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:01.583314   787 raft_consensus.cc:740] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:01.584041   712 leader_election.cc:290] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:01.588032   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:01.588758   713 raft_consensus.cc:3055] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:01.589097   713 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:01.590001   713 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.591409   713 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.594722   565 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:01.595781   764 raft_consensus.cc:993] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:01.596271   681 leader_election.cc:304] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:01.596222   764 raft_consensus.cc:1081] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:01.597373   765 raft_consensus.cc:2804] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.597922   765 raft_consensus.cc:697] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:01.598826   765 consensus_queue.cc:237] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.599509   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42726
I20260709 12:59:01.600143   638 raft_consensus.cc:493] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:01.600771   638 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.584575   787 consensus_queue.cc:260] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.586521   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d34d249566461f926acfb7128635eb" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:01.613914   713 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 2.
I20260709 12:59:01.615521   531 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:01.619117   787 raft_consensus.cc:3060] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.619159   764 raft_consensus.cc:2804] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.617733   463 catalog_manager.cc:5697] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 1 to 2, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.620034   764 raft_consensus.cc:697] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:01.621315   764 consensus_queue.cc:237] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.625614   640 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 2.
I20260709 12:59:01.634122   460 catalog_manager.cc:5697] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 1 to 2, leader changed from 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195) to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.661356   638 raft_consensus.cc:515] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.674949   638 leader_election.cc:290] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:01.677354   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:01.678077   565 raft_consensus.cc:3055] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:01.678435   565 raft_consensus.cc:740] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:01.680898   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:01.681677   712 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.679304   565 consensus_queue.cc:260] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.685535   565 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:01.688513   712 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:01.689916   606 leader_election.cc:304] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:01.693161   639 raft_consensus.cc:2468] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:01.694612   846 raft_consensus.cc:2804] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.696597   846 raft_consensus.cc:697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:01.697530   846 consensus_queue.cc:237] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:01.698153   565 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:01.706640   460 catalog_manager.cc:5697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 1 to 2, leader changed from 0474c591a4154337a74f518f02e4ce43 (127.0.107.193) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.761756   712 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:01.763312   839 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.779572   639 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:01.781211   797 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.986613   565 raft_consensus.cc:1275] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:01.988777   846 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.004077   712 raft_consensus.cc:1275] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.006944   846 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.010381   712 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.012779   839 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.025993   639 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.032560   797 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.080848   639 raft_consensus.cc:1275] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.082791   825 consensus_queue.cc:1048] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.090893   565 raft_consensus.cc:1275] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.101781   825 consensus_queue.cc:1048] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.141080   713 raft_consensus.cc:1275] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.143368   846 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.160636   565 raft_consensus.cc:1275] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:02.162213   787 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.411831   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:04.412817   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:04.439400   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:04.439913   639 raft_consensus.cc:606] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Received request to transfer leadership to TS 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:04.451145   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
mode: GRACEFUL
new_leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:59210
I20260709 12:59:04.451648   565 raft_consensus.cc:606] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Received request to transfer leadership to TS 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:04.453050   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:04.453581   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:04.734673   857 raft_consensus.cc:993] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: : Instructing follower 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:04.735278   797 raft_consensus.cc:1081] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Signalling peer 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:04.737241   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:38712
I20260709 12:59:04.738052   713 raft_consensus.cc:493] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:04.738487   713 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.743134   713 raft_consensus.cc:515] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.745597   713 leader_election.cc:290] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:04.745724   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:04.745875   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:04.746537   565 raft_consensus.cc:3055] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:04.746580   639 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.747025   565 raft_consensus.cc:740] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:04.747874   565 consensus_queue.cc:260] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.749099   565 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.752373   639 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:04.753399   681 leader_election.cc:304] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:04.754036   856 raft_consensus.cc:2804] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:04.755283   856 raft_consensus.cc:697] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:04.756125   565 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:04.756009   856 consensus_queue.cc:237] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.763309   463 catalog_manager.cc:5697] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 1 to 2, leader changed from 0474c591a4154337a74f518f02e4ce43 (127.0.107.193) to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.871946   864 raft_consensus.cc:993] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: : Instructing follower 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:04.872386   787 raft_consensus.cc:1081] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Signalling peer 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:04.873824   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:04.874454   713 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:04.874846   713 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.881497   713 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.883586   713 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:04.884567   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:04.885138   565 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.885020   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:04.885650   639 raft_consensus.cc:3055] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:04.885964   639 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:04.886729   639 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.887874   639 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:04.890297   565 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:04.891336   681 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:04.891965   856 raft_consensus.cc:2804] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:04.892369   856 raft_consensus.cc:697] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:04.893143   856 consensus_queue.cc:237] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:04.894224   639 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 2.
I20260709 12:59:04.901386   463 catalog_manager.cc:5697] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 1 to 2, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:05.238051   565 raft_consensus.cc:1275] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.239415   856 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.250738   639 raft_consensus.cc:1275] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.252609   868 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:05.342578   565 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.343835   638 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.343858   868 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:05.345528   868 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.455019   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:05.466665   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:37424
I20260709 12:59:05.467181   565 raft_consensus.cc:606] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:05.472743   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:37424
I20260709 12:59:05.473266   565 raft_consensus.cc:606] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:05.478873   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:37424
I20260709 12:59:05.479467   565 raft_consensus.cc:606] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:05.485363   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:38726
I20260709 12:59:05.486089   713 raft_consensus.cc:606] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:05.492641   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
mode: GRACEFUL
new_leader_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:38726
I20260709 12:59:05.493163   713 raft_consensus.cc:606] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Received request to transfer leadership to TS 786a151463ac4848863ff9c739f0b311
I20260709 12:59:05.783605   868 raft_consensus.cc:993] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.784067   856 raft_consensus.cc:1081] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.785681   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42712
I20260709 12:59:05.786262   638 raft_consensus.cc:493] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.786605   638 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.790966   638 raft_consensus.cc:515] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.792562   638 leader_election.cc:290] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:05.793824   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:05.794346   713 raft_consensus.cc:3055] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:05.794392   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df331c22ebed4e8b9e6b970bb06c620e" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:05.795027   713 raft_consensus.cc:740] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:05.795293   564 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.796185   713 consensus_queue.cc:260] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.797714   713 raft_consensus.cc:3060] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.802827   564 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.804436   607 leader_election.cc:304] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:05.805040   713 raft_consensus.cc:2468] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.805373   787 raft_consensus.cc:2804] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.806492   787 raft_consensus.cc:697] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:05.807320   787 consensus_queue.cc:237] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.809186   868 raft_consensus.cc:993] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.809702   868 raft_consensus.cc:1081] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.813331   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42712
I20260709 12:59:05.814069   638 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.814599   638 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.816792   460 catalog_manager.cc:5697] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 2 to 3, leader changed from 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:05.821241   638 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.823810   638 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:05.824146   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:05.824833   564 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.825102   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:05.825625   713 raft_consensus.cc:3055] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:05.825903   713 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:05.826781   713 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.827792   713 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.830435   878 raft_consensus.cc:993] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.831027   857 raft_consensus.cc:1081] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.832880   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42726
I20260709 12:59:05.833506   638 raft_consensus.cc:493] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.834615   638 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.835326   564 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.836652   607 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:05.837376   787 raft_consensus.cc:2804] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.837256   713 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.837934   787 raft_consensus.cc:697] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:05.838804   787 consensus_queue.cc:237] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.843575   638 raft_consensus.cc:515] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.845590   638 leader_election.cc:290] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:05.846711   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:05.846665   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d830e9c3da4be6922452902e8fb6c9" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:05.846107   460 catalog_manager.cc:5697] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 2 to 3, leader changed from 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:05.847319   713 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.847455   564 raft_consensus.cc:3055] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:05.847960   564 raft_consensus.cc:740] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:05.848814   564 consensus_queue.cc:260] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.849814   564 raft_consensus.cc:3060] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.854537   713 raft_consensus.cc:2468] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:05.856396   606 leader_election.cc:304] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:05.855979   564 raft_consensus.cc:2468] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 2.
I20260709 12:59:05.857275   787 raft_consensus.cc:2804] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:05.857911   787 raft_consensus.cc:697] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:05.858682   787 consensus_queue.cc:237] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.865513   460 catalog_manager.cc:5697] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 1 to 2, leader changed from 0474c591a4154337a74f518f02e4ce43 (127.0.107.193) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:05.913959   878 raft_consensus.cc:993] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.914458   857 raft_consensus.cc:1081] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:05.916242   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42726
I20260709 12:59:05.916896   638 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.917186   638 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.924719   638 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.926518   638 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:05.927467   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:05.927464   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:05.928098   713 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.928179   564 raft_consensus.cc:3055] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:05.928524   564 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:05.929148   564 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.930037   564 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.932370   713 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.933317   606 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:05.933984   787 raft_consensus.cc:2804] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.934347   787 raft_consensus.cc:697] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:05.935019   787 consensus_queue.cc:237] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:05.935364   564 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:05.942390   460 catalog_manager.cc:5697] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 2 to 3, leader changed from 0474c591a4154337a74f518f02e4ce43 (127.0.107.193) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.002286   878 raft_consensus.cc:993] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: : Instructing follower 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:06.002730   878 raft_consensus.cc:1081] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Signalling peer 786a151463ac4848863ff9c739f0b311 to start an election
I20260709 12:59:06.004448   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
 from {username='slave'} at 127.0.0.1:42726
I20260709 12:59:06.004971   638 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:06.005260   638 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.009871   638 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:06.011461   638 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:06.012879   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:06.013063   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "786a151463ac4848863ff9c739f0b311" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:06.013460   713 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.013586   564 raft_consensus.cc:3055] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.013931   564 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:06.014534   564 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:06.015764   564 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.019580   713 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:06.020620   606 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09dfb8e38f8b41ab8b2d7f60f0586842, 786a151463ac4848863ff9c739f0b311; no voters: 
I20260709 12:59:06.021370   787 raft_consensus.cc:2804] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.021554   564 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786a151463ac4848863ff9c739f0b311 in term 3.
I20260709 12:59:06.021718   787 raft_consensus.cc:697] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Leader. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:06.022748   787 consensus_queue.cc:237] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:06.028621   460 catalog_manager.cc:5697] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 reported cstate change: term changed from 2 to 3, leader changed from 0474c591a4154337a74f518f02e4ce43 (127.0.107.193) to 786a151463ac4848863ff9c739f0b311 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "786a151463ac4848863ff9c739f0b311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.251230   565 raft_consensus.cc:1275] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.252660   787 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.256449   713 raft_consensus.cc:1275] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.259178   787 consensus_queue.cc:1048] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.293402   713 raft_consensus.cc:1275] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.294924   874 consensus_queue.cc:1048] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.302364   713 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.304199   884 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.305565   565 raft_consensus.cc:1275] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.307075   884 consensus_queue.cc:1048] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.315928   564 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.317962   884 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.350101   712 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.351276   884 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.361075   565 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.362433   874 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.506130   712 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.507408   874 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.516834   565 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Refusing update from remote peer 786a151463ac4848863ff9c739f0b311: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.518783   874 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.508952   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:08.518196   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:08.518860   638 raft_consensus.cc:606] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Received request to transfer leadership to TS 0474c591a4154337a74f518f02e4ce43
I20260709 12:59:08.521755   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:08.522217   638 raft_consensus.cc:606] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Received request to transfer leadership to TS 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:08.524484   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:08.524937   638 raft_consensus.cc:606] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Received request to transfer leadership to TS 0474c591a4154337a74f518f02e4ce43
I20260709 12:59:08.527539   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:08.528129   638 raft_consensus.cc:606] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Received request to transfer leadership to TS 0474c591a4154337a74f518f02e4ce43
I20260709 12:59:08.531203   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714"
dest_uuid: "786a151463ac4848863ff9c739f0b311"
mode: GRACEFUL
new_leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:59:08.531754   638 raft_consensus.cc:606] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Received request to transfer leadership to TS 09dfb8e38f8b41ab8b2d7f60f0586842
I20260709 12:59:08.533034   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:08.533548   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:08.692795   898 raft_consensus.cc:993] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: : Instructing follower 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:08.693413   895 raft_consensus.cc:1081] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Signalling peer 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:08.695444   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:08.696154   712 raft_consensus.cc:493] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.696625   712 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.702577   712 raft_consensus.cc:515] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.704262   712 leader_election.cc:290] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 4 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:08.705258   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:08.705479   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "310b2081dc294ece8bbaba5424bbffec" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:08.705938   565 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.706012   638 raft_consensus.cc:3055] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.706353   638 raft_consensus.cc:740] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:08.707052   638 consensus_queue.cc:260] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.708052   638 raft_consensus.cc:3060] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.711413   565 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 4.
I20260709 12:59:08.712944   681 leader_election.cc:304] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:08.713127   638 raft_consensus.cc:2468] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 4.
I20260709 12:59:08.714120   856 raft_consensus.cc:2804] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:08.715322   856 raft_consensus.cc:697] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:08.716449   856 consensus_queue.cc:237] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.717545   898 raft_consensus.cc:993] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: : Instructing follower 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:08.718123   895 raft_consensus.cc:1081] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Signalling peer 09dfb8e38f8b41ab8b2d7f60f0586842 to start an election
I20260709 12:59:08.720124   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714"
dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
 from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:08.720696   712 raft_consensus.cc:493] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.721112   712 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.730188   712 raft_consensus.cc:515] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.732096   712 leader_election.cc:290] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 3 election: Requested vote from peers 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439), 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205)
I20260709 12:59:08.731494   460 catalog_manager.cc:5697] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 3 to 4, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.733114   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0474c591a4154337a74f518f02e4ce43"
I20260709 12:59:08.733729   565 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.733660   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fce4ffd3fb4021a9ceab820ced2714" candidate_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:08.734382   638 raft_consensus.cc:3055] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.734951   638 raft_consensus.cc:740] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:08.736071   638 consensus_queue.cc:260] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.737754   638 raft_consensus.cc:3060] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.742164   565 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 3.
I20260709 12:59:08.743691   681 leader_election.cc:304] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:08.744679   856 raft_consensus.cc:2804] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:08.745299   856 raft_consensus.cc:697] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 LEADER]: Becoming Leader. State: Replica: 09dfb8e38f8b41ab8b2d7f60f0586842, State: Running, Role: LEADER
I20260709 12:59:08.745577   638 raft_consensus.cc:2468] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09dfb8e38f8b41ab8b2d7f60f0586842 in term 3.
I20260709 12:59:08.746188   856 consensus_queue.cc:237] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.754751   460 catalog_manager.cc:5697] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 reported cstate change: term changed from 2 to 3, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.778460   898 raft_consensus.cc:993] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: : Instructing follower 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.778926   895 raft_consensus.cc:1081] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Signalling peer 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.780483   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "000429b459e44efda90a7a43be3470c2"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:37402
I20260709 12:59:08.780910   565 raft_consensus.cc:493] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.781164   565 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.786208   565 raft_consensus.cc:515] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.787853   565 leader_election.cc:290] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 4 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:08.788838   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:08.789004   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000429b459e44efda90a7a43be3470c2" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:08.789320   638 raft_consensus.cc:3055] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.789438   712 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.789618   638 raft_consensus.cc:740] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:08.790479   638 consensus_queue.cc:260] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.791383   638 raft_consensus.cc:3060] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.794112   712 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 4.
I20260709 12:59:08.795434   531 leader_election.cc:304] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:08.797962   638 raft_consensus.cc:2468] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 4.
I20260709 12:59:08.798123   906 raft_consensus.cc:2804] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:08.799636   906 raft_consensus.cc:697] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 4 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:08.800593   906 consensus_queue.cc:237] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.808272   460 catalog_manager.cc:5697] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 3 to 4, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.865077   898 raft_consensus.cc:993] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: : Instructing follower 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.865514   895 raft_consensus.cc:1081] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Signalling peer 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.867133   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:37402
I20260709 12:59:08.867574   565 raft_consensus.cc:493] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.867851   565 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.872051   565 raft_consensus.cc:515] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.873617   565 leader_election.cc:290] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 4 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:08.874486   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:08.874652   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0afc0a8df384f56844fc46faa0ba35b" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:08.875133   638 raft_consensus.cc:3055] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.875175   712 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.875447   638 raft_consensus.cc:740] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:08.876185   638 consensus_queue.cc:260] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.877069   638 raft_consensus.cc:3060] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.879288   712 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 4.
I20260709 12:59:08.880612   531 leader_election.cc:304] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:08.881480   906 raft_consensus.cc:2804] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:08.881906   906 raft_consensus.cc:697] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 4 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:08.882189   638 raft_consensus.cc:2468] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 4.
I20260709 12:59:08.882871   906 consensus_queue.cc:237] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.889930   460 catalog_manager.cc:5697] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 3 to 4, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.969414   898 raft_consensus.cc:993] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: : Instructing follower 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.969871   895 raft_consensus.cc:1081] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Signalling peer 0474c591a4154337a74f518f02e4ce43 to start an election
I20260709 12:59:08.971311   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe"
dest_uuid: "0474c591a4154337a74f518f02e4ce43"
 from {username='slave'} at 127.0.0.1:37402
I20260709 12:59:08.971709   565 raft_consensus.cc:493] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.971935   565 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.977030   565 raft_consensus.cc:515] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.978480   565 leader_election.cc:290] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 3 election: Requested vote from peers 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205), 09dfb8e38f8b41ab8b2d7f60f0586842 (127.0.107.195:41855)
I20260709 12:59:08.979327   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "786a151463ac4848863ff9c739f0b311"
I20260709 12:59:08.979521   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e186344d3f043b3ac2ea2998a2cfcbe" candidate_uuid: "0474c591a4154337a74f518f02e4ce43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842"
I20260709 12:59:08.980088   638 raft_consensus.cc:3055] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.980144   712 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.980530   638 raft_consensus.cc:740] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 786a151463ac4848863ff9c739f0b311, State: Running, Role: LEADER
I20260709 12:59:08.981709   638 consensus_queue.cc:260] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.982843   638 raft_consensus.cc:3060] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.984557   712 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 3.
I20260709 12:59:08.985538   531 leader_election.cc:304] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0474c591a4154337a74f518f02e4ce43, 09dfb8e38f8b41ab8b2d7f60f0586842; no voters: 
I20260709 12:59:08.986295   906 raft_consensus.cc:2804] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:08.986793   906 raft_consensus.cc:697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 3 LEADER]: Becoming Leader. State: Replica: 0474c591a4154337a74f518f02e4ce43, State: Running, Role: LEADER
I20260709 12:59:08.987928   638 raft_consensus.cc:2468] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0474c591a4154337a74f518f02e4ce43 in term 3.
I20260709 12:59:08.987702   906 consensus_queue.cc:237] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } }
I20260709 12:59:08.994882   460 catalog_manager.cc:5697] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 reported cstate change: term changed from 2 to 3, leader changed from 786a151463ac4848863ff9c739f0b311 (127.0.107.194) to 0474c591a4154337a74f518f02e4ce43 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0474c591a4154337a74f518f02e4ce43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.138029   565 raft_consensus.cc:1275] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:09.139323   856 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.149863   638 raft_consensus.cc:1275] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:09.153415   913 consensus_queue.cc:1048] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:09.212489   564 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.214213   899 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0474c591a4154337a74f518f02e4ce43" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.223438   638 raft_consensus.cc:1275] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Refusing update from remote peer 09dfb8e38f8b41ab8b2d7f60f0586842: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.225442   856 consensus_queue.cc:1048] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.244112   638 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.245409   906 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.254563   712 raft_consensus.cc:1275] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.256716   920 consensus_queue.cc:1048] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:09.296769   712 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.297844   920 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.308746   638 raft_consensus.cc:1275] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:09.310043   907 consensus_queue.cc:1048] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.431939   638 raft_consensus.cc:1275] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:09.433123   907 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786a151463ac4848863ff9c739f0b311" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.442507   712 raft_consensus.cc:1275] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Refusing update from remote peer 0474c591a4154337a74f518f02e4ce43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:09.444705   920 consensus_queue.cc:1048] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09dfb8e38f8b41ab8b2d7f60f0586842" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.534602   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.540437   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:09.563182   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:09.563879   431 tablet_replica.cc:333] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.564596   431 raft_consensus.cc:2243] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.565112   431 raft_consensus.cc:2272] T e4fce4ffd3fb4021a9ceab820ced2714 P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.568513   431 tablet_replica.cc:333] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
W20260709 12:59:09.568547   607 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:09.569454   431 raft_consensus.cc:2243] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.570261   431 raft_consensus.cc:2272] T b7d34d249566461f926acfb7128635eb P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:09.572108   607 consensus_peers.cc:597] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 -> Peer 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439): Couldn't send request to peer 0474c591a4154337a74f518f02e4ce43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.572809   431 tablet_replica.cc:333] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.573307   431 raft_consensus.cc:2243] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.573670   431 raft_consensus.cc:2272] T 90e9d8eae1164168ac8c4e022cb30bbf P 0474c591a4154337a74f518f02e4ce43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.575361   431 tablet_replica.cc:333] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.575811   431 raft_consensus.cc:2243] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.576185   431 raft_consensus.cc:2272] T df331c22ebed4e8b9e6b970bb06c620e P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.577775   431 tablet_replica.cc:333] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.578250   431 raft_consensus.cc:2243] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.578612   431 raft_consensus.cc:2272] T 310b2081dc294ece8bbaba5424bbffec P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.580739   431 tablet_replica.cc:333] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.581212   431 raft_consensus.cc:2243] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.581902   431 raft_consensus.cc:2272] T d0afc0a8df384f56844fc46faa0ba35b P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.584076   431 tablet_replica.cc:333] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.584619   431 raft_consensus.cc:2243] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.585021   431 raft_consensus.cc:2272] T 25d830e9c3da4be6922452902e8fb6c9 P 0474c591a4154337a74f518f02e4ce43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.586612   431 tablet_replica.cc:333] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.587085   431 raft_consensus.cc:2243] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.587762   431 raft_consensus.cc:2272] T 000429b459e44efda90a7a43be3470c2 P 0474c591a4154337a74f518f02e4ce43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.589813   431 tablet_replica.cc:333] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43: stopping tablet replica
I20260709 12:59:09.590232   431 raft_consensus.cc:2243] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.590886   431 raft_consensus.cc:2272] T 9e186344d3f043b3ac2ea2998a2cfcbe P 0474c591a4154337a74f518f02e4ce43 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:09.696463   681 consensus_peers.cc:597] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 -> Peer 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439): Couldn't send request to peer 0474c591a4154337a74f518f02e4ce43. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:09.696974   681 consensus_peers.cc:597] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 -> Peer 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439): Couldn't send request to peer 0474c591a4154337a74f518f02e4ce43. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:09.703330   607 consensus_peers.cc:597] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 -> Peer 0474c591a4154337a74f518f02e4ce43 (127.0.107.193:34439): Couldn't send request to peer 0474c591a4154337a74f518f02e4ce43. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.723685   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:59:09.742781   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:09.763978   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:09.764633   431 tablet_replica.cc:333] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.765158   431 raft_consensus.cc:2243] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.765561   431 raft_consensus.cc:2272] T e4fce4ffd3fb4021a9ceab820ced2714 P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.767590   431 tablet_replica.cc:333] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.768090   431 raft_consensus.cc:2243] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.768844   431 raft_consensus.cc:2272] T 25d830e9c3da4be6922452902e8fb6c9 P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.770592   431 tablet_replica.cc:333] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.771064   431 raft_consensus.cc:2243] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.771427   431 raft_consensus.cc:2272] T 000429b459e44efda90a7a43be3470c2 P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.773417   431 tablet_replica.cc:333] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.773864   431 raft_consensus.cc:2243] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.774206   431 raft_consensus.cc:2272] T 9e186344d3f043b3ac2ea2998a2cfcbe P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.776087   431 tablet_replica.cc:333] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.776574   431 raft_consensus.cc:2243] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.776933   431 raft_consensus.cc:2272] T 310b2081dc294ece8bbaba5424bbffec P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.778726   431 tablet_replica.cc:333] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.779170   431 raft_consensus.cc:2243] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.779834   431 raft_consensus.cc:2272] T df331c22ebed4e8b9e6b970bb06c620e P 786a151463ac4848863ff9c739f0b311 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.781291   431 tablet_replica.cc:333] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.781728   431 raft_consensus.cc:2243] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.782177   431 raft_consensus.cc:2272] T d0afc0a8df384f56844fc46faa0ba35b P 786a151463ac4848863ff9c739f0b311 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.784135   431 tablet_replica.cc:333] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.784608   431 raft_consensus.cc:2243] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.785008   431 raft_consensus.cc:2272] T b7d34d249566461f926acfb7128635eb P 786a151463ac4848863ff9c739f0b311 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.786629   431 tablet_replica.cc:333] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311: stopping tablet replica
I20260709 12:59:09.787119   431 raft_consensus.cc:2243] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.787798   431 raft_consensus.cc:2272] T 90e9d8eae1164168ac8c4e022cb30bbf P 786a151463ac4848863ff9c739f0b311 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.815299   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:09.832536   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 12:59:09.843525   681 consensus_peers.cc:597] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 -> Peer 786a151463ac4848863ff9c739f0b311 (127.0.107.194:34205): Couldn't send request to peer 786a151463ac4848863ff9c739f0b311. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.859118   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:09.859931   431 tablet_replica.cc:333] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.860769   431 raft_consensus.cc:2243] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.861672   431 raft_consensus.cc:2272] T e4fce4ffd3fb4021a9ceab820ced2714 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.864172   431 tablet_replica.cc:333] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.864988   431 raft_consensus.cc:2243] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.865669   431 raft_consensus.cc:2272] T b7d34d249566461f926acfb7128635eb P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.867587   431 tablet_replica.cc:333] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.868063   431 raft_consensus.cc:2243] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.868513   431 raft_consensus.cc:2272] T 90e9d8eae1164168ac8c4e022cb30bbf P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.870409   431 tablet_replica.cc:333] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.871001   431 raft_consensus.cc:2243] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.871446   431 raft_consensus.cc:2272] T 9e186344d3f043b3ac2ea2998a2cfcbe P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.874373   431 tablet_replica.cc:333] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.874899   431 raft_consensus.cc:2243] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.875406   431 raft_consensus.cc:2272] T 000429b459e44efda90a7a43be3470c2 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.877784   431 tablet_replica.cc:333] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.878301   431 raft_consensus.cc:2243] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.878700   431 raft_consensus.cc:2272] T 25d830e9c3da4be6922452902e8fb6c9 P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.880366   431 tablet_replica.cc:333] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.881021   431 raft_consensus.cc:2243] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.881424   431 raft_consensus.cc:2272] T df331c22ebed4e8b9e6b970bb06c620e P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.883014   431 tablet_replica.cc:333] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.883445   431 raft_consensus.cc:2243] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:09.884068   431 raft_consensus.cc:2272] T 310b2081dc294ece8bbaba5424bbffec P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.886062   431 tablet_replica.cc:333] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842: stopping tablet replica
I20260709 12:59:09.886516   431 raft_consensus.cc:2243] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.886941   431 raft_consensus.cc:2272] T d0afc0a8df384f56844fc46faa0ba35b P 09dfb8e38f8b41ab8b2d7f60f0586842 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.914970   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:09.933964   431 master.cc:562] Master@127.0.107.254:34191 shutting down...
I20260709 12:59:10.155586   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:10.156148   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:10.156517   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d11b087bb05544f6b7375f1a9fed3790: stopping tablet replica
I20260709 12:59:10.179144   431 master.cc:584] Master@127.0.107.254:34191 shutdown complete.
0474c591a4154337a74f518f02e4ce43  4
09dfb8e38f8b41ab8b2d7f60f0586842  1
786a151463ac4848863ff9c739f0b311  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13186 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:10.228227   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45527
I20260709 12:59:10.229581   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:10.235404   930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.235626   931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.239449   933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:10.240746   431 server_base.cc:1061] running on GCE node
I20260709 12:59:10.241972   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:10.242241   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:10.242426   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601950242401 us; error 0 us; skew 500 ppm
I20260709 12:59:10.242952   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:10.246048   431 webserver.cc:533] Webserver started at http://127.0.107.254:44577/ using document root <none> and password file <none>
I20260709 12:59:10.246622   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:10.246806   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:10.247035   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:10.248203   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "8932167264b0418a92cd85a92ef3d6d6"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.252900   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:10.256479   938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.257308   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:10.257659   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "8932167264b0418a92cd85a92ef3d6d6"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.258020   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:10.271433   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:10.272753   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:10.318195   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45527
I20260709 12:59:10.318305   989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45527 every 8 connection(s)
I20260709 12:59:10.322952   990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.333478   990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6: Bootstrap starting.
I20260709 12:59:10.338234   990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:10.343170   990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6: No bootstrap required, opened a new log
I20260709 12:59:10.345700   990 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER }
I20260709 12:59:10.346112   990 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:10.346343   990 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8932167264b0418a92cd85a92ef3d6d6, State: Initialized, Role: FOLLOWER
I20260709 12:59:10.346946   990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER }
I20260709 12:59:10.347391   990 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:10.347841   990 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:10.348332   990 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:10.372785   990 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER }
I20260709 12:59:10.373489   990 leader_election.cc:304] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8932167264b0418a92cd85a92ef3d6d6; no voters: 
I20260709 12:59:10.375042   990 leader_election.cc:290] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:10.375406   993 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:10.376690   993 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 1 LEADER]: Becoming Leader. State: Replica: 8932167264b0418a92cd85a92ef3d6d6, State: Running, Role: LEADER
I20260709 12:59:10.377398   993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER }
I20260709 12:59:10.378180   990 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:10.383060   995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8932167264b0418a92cd85a92ef3d6d6. Latest consensus state: current_term: 1 leader_uuid: "8932167264b0418a92cd85a92ef3d6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER } }
I20260709 12:59:10.383829   995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:10.385085   994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8932167264b0418a92cd85a92ef3d6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8932167264b0418a92cd85a92ef3d6d6" member_type: VOTER } }
I20260709 12:59:10.385924   994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:10.386300  1002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:10.392153  1002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:10.394599   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:10.402017  1002 catalog_manager.cc:1383] Generated new cluster ID: 0b03404dd0df4ade9d1a51b087e6c1f1
I20260709 12:59:10.402297  1002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:10.423301  1002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:10.425243  1002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:10.443368  1002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6: Generated new TSK 0
I20260709 12:59:10.444024  1002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:10.464991   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:10.471788  1011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.472631  1012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.474057  1014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:10.474820   431 server_base.cc:1061] running on GCE node
I20260709 12:59:10.475608   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:10.475793   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:10.475955   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601950475942 us; error 0 us; skew 500 ppm
I20260709 12:59:10.476548   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:10.478858   431 webserver.cc:533] Webserver started at http://127.0.107.193:37317/ using document root <none> and password file <none>
I20260709 12:59:10.479358   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:10.479529   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:10.479919   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:10.481038   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "c021745e2e654329bc44df9ff0f58f81"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.485831   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:10.490111  1019 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.491024   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:59:10.491333   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "c021745e2e654329bc44df9ff0f58f81"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.491611   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:10.507987   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:10.509450   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:10.511019   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:10.513659   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:10.513898   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.514143   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:10.514318   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.558477   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34305
I20260709 12:59:10.558570  1081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34305 every 8 connection(s)
I20260709 12:59:10.563462   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:10.571398  1086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.573107  1087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.575814  1089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:10.576617   431 server_base.cc:1061] running on GCE node
I20260709 12:59:10.577793   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:10.578075   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:10.578275   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601950578254 us; error 0 us; skew 500 ppm
I20260709 12:59:10.578855   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:10.582243   431 webserver.cc:533] Webserver started at http://127.0.107.194:45875/ using document root <none> and password file <none>
I20260709 12:59:10.582765  1082 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45527
I20260709 12:59:10.582866   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:10.583184  1082 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:10.583182   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:10.583912   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:10.584060  1082 heartbeater.cc:507] Master 127.0.107.254:45527 requested a full tablet report, sending...
I20260709 12:59:10.585489   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.586468   955 ts_manager.cc:194] Registered new tserver with Master: c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305)
I20260709 12:59:10.588884   955 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35208
I20260709 12:59:10.591440   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:59:10.595536  1094 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.596361   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:10.596642   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.596896   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:10.608810   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:10.610008   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:10.611542   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:10.613862   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:10.614050   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.614274   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:10.614444   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.658099   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33691
I20260709 12:59:10.658200  1156 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33691 every 8 connection(s)
I20260709 12:59:10.663498   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:10.670433  1160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.672518  1161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:10.674259  1163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:10.675987   431 server_base.cc:1061] running on GCE node
I20260709 12:59:10.676741  1157 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45527
I20260709 12:59:10.677301  1157 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:10.677378   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:10.677685   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:10.677898   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601950677879 us; error 0 us; skew 500 ppm
I20260709 12:59:10.678277  1157 heartbeater.cc:507] Master 127.0.107.254:45527 requested a full tablet report, sending...
I20260709 12:59:10.678656   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:10.681226   955 ts_manager.cc:194] Registered new tserver with Master: ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:10.681787   431 webserver.cc:533] Webserver started at http://127.0.107.195:33751/ using document root <none> and password file <none>
I20260709 12:59:10.682278   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:10.682474   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:10.682716   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:10.682858   955 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35222
I20260709 12:59:10.683911   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "6ab9f7d50c044526a738cd7071d47be9"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.688920   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:10.692394  1168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.693218   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:10.693548   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "6ab9f7d50c044526a738cd7071d47be9"
format_stamp: "Formatted at 2026-07-09 12:59:10 on dist-test-slave-021n"
I20260709 12:59:10.693902   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:10.711578   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:10.712831   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:10.714340   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:10.716789   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:10.716990   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.717258   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:10.717407   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:10.760900   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45103
I20260709 12:59:10.761008  1230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45103 every 8 connection(s)
I20260709 12:59:10.776379  1231 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45527
I20260709 12:59:10.776883  1231 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:10.777987  1231 heartbeater.cc:507] Master 127.0.107.254:45527 requested a full tablet report, sending...
I20260709 12:59:10.780282   955 ts_manager.cc:194] Registered new tserver with Master: 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:10.780853   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016337224s
I20260709 12:59:10.781873   955 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35230
I20260709 12:59:10.811836   955 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35240:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:10.814925   955 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:10.899883  1122 tablet_service.cc:1511] Processing CreateTablet for tablet b479a3b5407f44feb56da85138b6e765 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:10.901566  1122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b479a3b5407f44feb56da85138b6e765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.903061  1196 tablet_service.cc:1511] Processing CreateTablet for tablet b479a3b5407f44feb56da85138b6e765 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:10.903187  1195 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca003e31064a3ab038a0c729481c55 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:10.904817  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b479a3b5407f44feb56da85138b6e765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.904575  1120 tablet_service.cc:1511] Processing CreateTablet for tablet 3abb8696c8e448c7bf5240a71792e18a (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:10.906077  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abb8696c8e448c7bf5240a71792e18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.908705  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca003e31064a3ab038a0c729481c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.911196  1194 tablet_service.cc:1511] Processing CreateTablet for tablet 3abb8696c8e448c7bf5240a71792e18a (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:10.899927  1121 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca003e31064a3ab038a0c729481c55 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:10.912846  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abb8696c8e448c7bf5240a71792e18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.913271  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca003e31064a3ab038a0c729481c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.929906  1246 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:10.929471  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:10.931643  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.933539  1047 tablet_service.cc:1511] Processing CreateTablet for tablet b479a3b5407f44feb56da85138b6e765 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:10.934978  1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b479a3b5407f44feb56da85138b6e765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.937184  1246 tablet_bootstrap.cc:654] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:10.937585  1046 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca003e31064a3ab038a0c729481c55 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:10.939013  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca003e31064a3ab038a0c729481c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.941774  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 3abb8696c8e448c7bf5240a71792e18a (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:10.944280  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:10.945628  1248 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:10.946713  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:10.948024  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.952781  1246 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:10.953332  1246 ts_tablet_manager.cc:1403] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 12:59:10.956537  1246 raft_consensus.cc:359] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:10.957476  1246 raft_consensus.cc:385] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:10.957878  1246 raft_consensus.cc:740] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:10.958947  1246 consensus_queue.cc:260] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:10.961256  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abb8696c8e448c7bf5240a71792e18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.963232  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff1f12c5ee24fa190b5bbf4fe85bb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.970618  1043 tablet_service.cc:1511] Processing CreateTablet for tablet f69e77f1bc7447aea639c610a534f28d (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:10.972069  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69e77f1bc7447aea639c610a534f28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.976012  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd2030e5ab4525a96d6b1d06d642af (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:10.976709  1121 tablet_service.cc:1511] Processing CreateTablet for tablet f69e77f1bc7447aea639c610a534f28d (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:10.978091  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69e77f1bc7447aea639c610a534f28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.957715  1248 tablet_bootstrap.cc:654] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:10.986316  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd2030e5ab4525a96d6b1d06d642af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.992609  1193 tablet_service.cc:1511] Processing CreateTablet for tablet f69e77f1bc7447aea639c610a534f28d (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:10.994115  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69e77f1bc7447aea639c610a534f28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.999423  1157 heartbeater.cc:499] Master 127.0.107.254:45527 was elected leader, sending a full tablet report...
I20260709 12:59:11.005728  1246 ts_tablet_manager.cc:1434] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.011s
I20260709 12:59:11.008718  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd2030e5ab4525a96d6b1d06d642af (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:11.025275  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd2030e5ab4525a96d6b1d06d642af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.024827  1046 tablet_service.cc:1511] Processing CreateTablet for tablet cc29f251f72a4b259a59accc1b2e8a90 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:11.026482  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc29f251f72a4b259a59accc1b2e8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.012033  1194 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd2030e5ab4525a96d6b1d06d642af (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:11.014839  1122 tablet_service.cc:1511] Processing CreateTablet for tablet cc29f251f72a4b259a59accc1b2e8a90 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:11.029036  1122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc29f251f72a4b259a59accc1b2e8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.018607  1196 tablet_service.cc:1511] Processing CreateTablet for tablet cc29f251f72a4b259a59accc1b2e8a90 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:11.033631  1250 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.033833  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd2030e5ab4525a96d6b1d06d642af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.036067  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc29f251f72a4b259a59accc1b2e8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.021028  1044 tablet_service.cc:1511] Processing CreateTablet for tablet fff2eb31a3374563b3c609b306d421fa (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:11.042207  1248 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.042423  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2eb31a3374563b3c609b306d421fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.042920  1248 ts_tablet_manager.cc:1403] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.006s
I20260709 12:59:11.046185  1248 raft_consensus.cc:359] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.047212  1248 raft_consensus.cc:385] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.047618  1248 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.048823  1248 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.051091  1250 tablet_bootstrap.cc:654] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.057767  1231 heartbeater.cc:499] Master 127.0.107.254:45527 was elected leader, sending a full tablet report...
I20260709 12:59:11.058835  1248 ts_tablet_manager.cc:1434] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:59:11.060534  1246 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.061393  1248 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.065490  1194 tablet_service.cc:1511] Processing CreateTablet for tablet fff2eb31a3374563b3c609b306d421fa (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:11.066932  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2eb31a3374563b3c609b306d421fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.069278  1248 tablet_bootstrap.cc:654] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.069888  1120 tablet_service.cc:1511] Processing CreateTablet for tablet fff2eb31a3374563b3c609b306d421fa (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:11.071230  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2eb31a3374563b3c609b306d421fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.076377  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 642cc9404be9465583a72e2326757339 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:11.077819  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642cc9404be9465583a72e2326757339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.080768  1121 tablet_service.cc:1511] Processing CreateTablet for tablet 642cc9404be9465583a72e2326757339 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:11.081097  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 88efae44bee24cf4832b4eb6507ec9a7 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:11.085152  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642cc9404be9465583a72e2326757339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.088390  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 642cc9404be9465583a72e2326757339 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:11.088574  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 88efae44bee24cf4832b4eb6507ec9a7 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:11.089896  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efae44bee24cf4832b4eb6507ec9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.089854  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642cc9404be9465583a72e2326757339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.096635  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efae44bee24cf4832b4eb6507ec9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.097752  1195 tablet_service.cc:1511] Processing CreateTablet for tablet 88efae44bee24cf4832b4eb6507ec9a7 (DEFAULT_TABLE table=test-workload [id=b9b1d17985c7457c8561f11853c305a0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:11.099002  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efae44bee24cf4832b4eb6507ec9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.117830  1246 tablet_bootstrap.cc:654] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.128407  1248 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.128955  1248 ts_tablet_manager.cc:1403] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.001s
I20260709 12:59:11.133126  1248 raft_consensus.cc:359] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.133898  1248 raft_consensus.cc:385] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.134194  1248 raft_consensus.cc:740] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.135025  1248 consensus_queue.cc:260] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.137264  1248 ts_tablet_manager.cc:1434] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:59:11.138302  1248 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.152041  1250 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.152572  1250 ts_tablet_manager.cc:1403] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.000s
I20260709 12:59:11.154238  1248 tablet_bootstrap.cc:654] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.155469  1250 raft_consensus.cc:359] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.156090  1250 raft_consensus.cc:385] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.156368  1250 raft_consensus.cc:740] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.157318  1250 consensus_queue.cc:260] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.160475  1246 tablet_bootstrap.cc:492] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.160923  1246 ts_tablet_manager.cc:1403] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.013s
I20260709 12:59:11.161206  1248 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.161783  1248 ts_tablet_manager.cc:1403] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:59:11.163978  1246 raft_consensus.cc:359] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.164777  1246 raft_consensus.cc:385] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.165035  1248 raft_consensus.cc:359] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.165058  1246 raft_consensus.cc:740] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.165905  1248 raft_consensus.cc:385] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.166429  1246 consensus_queue.cc:260] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.166275  1248 raft_consensus.cc:740] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.167729  1082 heartbeater.cc:499] Master 127.0.107.254:45527 was elected leader, sending a full tablet report...
I20260709 12:59:11.168154  1250 ts_tablet_manager.cc:1434] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:59:11.168404  1246 ts_tablet_manager.cc:1434] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:11.168082  1248 consensus_queue.cc:260] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.169620  1250 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.170575  1248 ts_tablet_manager.cc:1434] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:11.171454  1246 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.171525  1248 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.177058  1250 tablet_bootstrap.cc:654] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.178570  1246 tablet_bootstrap.cc:654] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.178629  1248 tablet_bootstrap.cc:654] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.188105  1246 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.188649  1246 ts_tablet_manager.cc:1403] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 12:59:11.192799  1246 raft_consensus.cc:359] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.193531  1246 raft_consensus.cc:385] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.193825  1246 raft_consensus.cc:740] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.195957  1246 consensus_queue.cc:260] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.197439  1248 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.198029  1248 ts_tablet_manager.cc:1403] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:59:11.200685  1246 ts_tablet_manager.cc:1434] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:59:11.201812  1246 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.201426  1248 raft_consensus.cc:359] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.202322  1248 raft_consensus.cc:385] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.202666  1248 raft_consensus.cc:740] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.203680  1248 consensus_queue.cc:260] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.206081  1248 ts_tablet_manager.cc:1434] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:11.207325  1248 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.208794  1246 tablet_bootstrap.cc:654] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.214944  1248 tablet_bootstrap.cc:654] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.224551  1249 raft_consensus.cc:493] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.225235  1249 raft_consensus.cc:515] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.227840  1248 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.228549  1248 ts_tablet_manager.cc:1403] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 12:59:11.227835  1249 leader_election.cc:290] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.231778  1248 raft_consensus.cc:359] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.232650  1248 raft_consensus.cc:385] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.233016  1248 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.234020  1248 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.236403  1248 ts_tablet_manager.cc:1434] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:11.237497  1248 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.241050  1252 raft_consensus.cc:493] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.241605  1252 raft_consensus.cc:515] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.245146  1248 tablet_bootstrap.cc:654] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.259128  1246 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.259649  1246 ts_tablet_manager.cc:1403] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.005s
I20260709 12:59:11.262652  1246 raft_consensus.cc:359] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.263425  1246 raft_consensus.cc:385] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.263751  1246 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.264719  1246 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.269153  1252 leader_election.cc:290] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305)
I20260709 12:59:11.272053  1246 ts_tablet_manager.cc:1434] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:59:11.273128  1246 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.279047  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.279968  1132 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.282015  1171 leader_election.cc:304] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.283449  1252 raft_consensus.cc:2804] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.283882  1252 raft_consensus.cc:493] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.284336  1252 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.285064  1246 tablet_bootstrap.cc:654] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.285650  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.286378  1206 raft_consensus.cc:2468] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 0.
I20260709 12:59:11.288192  1095 leader_election.cc:304] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.289299  1249 raft_consensus.cc:2804] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.289709  1249 raft_consensus.cc:493] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.290067  1249 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.295918  1250 tablet_bootstrap.cc:492] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.296741  1250 ts_tablet_manager.cc:1403] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.040s
I20260709 12:59:11.299831  1249 raft_consensus.cc:515] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.304402  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:11.305148  1206 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.313094  1206 raft_consensus.cc:2468] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.314447  1095 leader_election.cc:304] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.319960  1249 leader_election.cc:290] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.321007  1249 raft_consensus.cc:2804] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.321550  1249 raft_consensus.cc:697] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:11.322496  1249 consensus_queue.cc:237] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.329906  1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.331598  1057 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.332474  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.331524  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.330837  1252 raft_consensus.cc:515] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.335435  1246 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.335939  1246 ts_tablet_manager.cc:1403] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.032s
I20260709 12:59:11.336452  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.336794  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.337188  1132 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.336549  1252 leader_election.cc:290] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305)
I20260709 12:59:11.337486  1056 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.339037  1246 raft_consensus.cc:359] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.340109  1246 raft_consensus.cc:385] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.340559  1246 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.341950  1246 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.340468  1248 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.343477  1248 ts_tablet_manager.cc:1403] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.106s	user 0.044s	sys 0.048s
I20260709 12:59:11.345057  1056 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.345217  1246 ts_tablet_manager.cc:1434] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:59:11.346585  1170 leader_election.cc:304] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:11.346562  1248 raft_consensus.cc:359] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.347779  1252 raft_consensus.cc:2804] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.348039  1248 raft_consensus.cc:385] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.348450  1248 raft_consensus.cc:740] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.328244  1250 raft_consensus.cc:359] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.349691  1250 raft_consensus.cc:385] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.349273  1248 consensus_queue.cc:260] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.350003  1250 raft_consensus.cc:740] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.350735  1250 consensus_queue.cc:260] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.351608  1055 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.353003  1246 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.352088   953 catalog_manager.cc:5697] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.358771  1055 raft_consensus.cc:2468] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.363983  1250 ts_tablet_manager.cc:1434] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.005s
I20260709 12:59:11.365732  1250 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.366626  1246 tablet_bootstrap.cc:654] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.374567  1250 tablet_bootstrap.cc:654] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.380877  1246 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.381424  1246 ts_tablet_manager.cc:1403] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 12:59:11.353441  1132 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.384470  1246 raft_consensus.cc:359] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
W20260709 12:59:11.389935  1003 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:11.390618  1246 raft_consensus.cc:385] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.391002  1246 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.391827  1246 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.393306  1252 raft_consensus.cc:697] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.393567  1271 raft_consensus.cc:493] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.394059  1271 raft_consensus.cc:515] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.394235  1252 consensus_queue.cc:237] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:11.397670  1249 raft_consensus.cc:493] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.398168  1249 raft_consensus.cc:515] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.399451  1246 ts_tablet_manager.cc:1434] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:59:11.400192  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.400596  1246 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
W20260709 12:59:11.401752  1170 leader_election.cc:343] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.402673  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
W20260709 12:59:11.404062  1096 leader_election.cc:343] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.405263  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.405889  1206 raft_consensus.cc:2468] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 0.
I20260709 12:59:11.406946  1095 leader_election.cc:304] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.408238  1269 raft_consensus.cc:2804] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.408744  1269 raft_consensus.cc:493] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.409093  1269 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.400116  1249 leader_election.cc:290] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.416003   953 catalog_manager.cc:5697] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.417142  1269 raft_consensus.cc:515] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.423311  1246 tablet_bootstrap.cc:654] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.429281  1252 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.430053  1252 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.431952  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.433816  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.434585  1132 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
W20260709 12:59:11.435575  1096 leader_election.cc:343] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.436638  1171 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.437928  1275 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.438374  1275 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.438719  1275 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.442301  1252 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.443150  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
W20260709 12:59:11.444620  1170 leader_election.cc:343] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.444986  1246 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.445492  1246 ts_tablet_manager.cc:1403] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.000s
I20260709 12:59:11.447391  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.448262  1132 raft_consensus.cc:2393] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ab9f7d50c044526a738cd7071d47be9 in current term 1: Already voted for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in this term.
I20260709 12:59:11.448626  1246 raft_consensus.cc:359] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.449488  1246 raft_consensus.cc:385] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.449416  1171 leader_election.cc:304] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9; no voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:11.449947  1246 raft_consensus.cc:740] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.450636  1252 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.450877  1246 consensus_queue.cc:260] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.453323  1246 ts_tablet_manager.cc:1434] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:59:11.454352  1246 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.457360  1252 raft_consensus.cc:2749] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.458133  1252 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.458545  1252 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.461163  1246 tablet_bootstrap.cc:654] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.461500  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
W20260709 12:59:11.462798  1170 leader_election.cc:343] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.463490  1271 leader_election.cc:290] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.465739  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.466435  1132 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.467656  1171 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.469518  1272 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.469950  1272 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.470280  1272 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.470820  1248 ts_tablet_manager.cc:1434] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.127s	user 0.046s	sys 0.070s
I20260709 12:59:11.472482  1252 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.475001  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:11.475574  1248 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.480217  1246 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.480710  1246 ts_tablet_manager.cc:1403] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 12:59:11.482290  1206 raft_consensus.cc:2468] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.483186  1246 raft_consensus.cc:359] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.483704  1248 tablet_bootstrap.cc:654] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.483560  1095 leader_election.cc:304] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.483913  1246 raft_consensus.cc:385] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.484283  1246 raft_consensus.cc:740] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.484678  1249 raft_consensus.cc:2804] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.485138  1246 consensus_queue.cc:260] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.486915  1249 raft_consensus.cc:697] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:11.487905  1249 consensus_queue.cc:237] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.491791  1269 leader_election.cc:290] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.493552  1246 ts_tablet_manager.cc:1434] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.008s
I20260709 12:59:11.494675  1246 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.495635  1250 tablet_bootstrap.cc:492] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.496272  1250 ts_tablet_manager.cc:1403] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.131s	user 0.033s	sys 0.051s
I20260709 12:59:11.499748  1250 raft_consensus.cc:359] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.500524  1250 raft_consensus.cc:385] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.500869  1250 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.501335  1248 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.501493  1246 tablet_bootstrap.cc:654] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.501931  1248 ts_tablet_manager.cc:1403] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260709 12:59:11.501758  1250 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.504516  1250 ts_tablet_manager.cc:1434] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:59:11.504570   953 catalog_manager.cc:5697] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.505764  1250 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.510620  1272 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.513391  1250 tablet_bootstrap.cc:654] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.513787  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
W20260709 12:59:11.515430  1170 leader_election.cc:343] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.523240  1248 raft_consensus.cc:359] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.524376  1248 raft_consensus.cc:385] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.524855  1248 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.525887  1248 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.532027  1275 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.535410  1248 ts_tablet_manager.cc:1434] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.006s
I20260709 12:59:11.537487  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.538789  1055 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.544204  1248 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.550401  1246 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.550894  1246 ts_tablet_manager.cc:1403] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.015s
I20260709 12:59:11.551438  1055 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.552264  1248 tablet_bootstrap.cc:654] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.552922  1170 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:11.553520  1246 raft_consensus.cc:359] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.553915  1252 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.554199  1246 raft_consensus.cc:385] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.554498  1252 raft_consensus.cc:697] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.554541  1246 raft_consensus.cc:740] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.555492  1252 consensus_queue.cc:237] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.558509  1248 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.558885  1248 ts_tablet_manager.cc:1403] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 12:59:11.555636  1246 consensus_queue.cc:260] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.560427  1275 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.561693  1272 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.561393  1248 raft_consensus.cc:359] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.562206  1248 raft_consensus.cc:385] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.562454  1248 raft_consensus.cc:740] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.563036  1248 consensus_queue.cc:260] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.564291  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.564414  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.564877  1132 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.565013  1131 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.565415   953 catalog_manager.cc:5697] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.567603  1246 ts_tablet_manager.cc:1434] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:59:11.568604  1246 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: Bootstrap starting.
I20260709 12:59:11.571847  1132 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.574354  1246 tablet_bootstrap.cc:654] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.578905  1275 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.579476  1275 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.581307  1131 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.581888  1275 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.582744  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.583137  1171 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
W20260709 12:59:11.584277  1170 leader_election.cc:343] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.584980  1272 raft_consensus.cc:493] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.584517  1252 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.585722  1252 raft_consensus.cc:697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.585481  1272 raft_consensus.cc:515] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.586841  1252 consensus_queue.cc:237] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.589280  1248 ts_tablet_manager.cc:1434] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:59:11.590579  1248 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.593050  1250 tablet_bootstrap.cc:492] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.592136  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.593559  1250 ts_tablet_manager.cc:1403] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.039s
I20260709 12:59:11.594182  1249 raft_consensus.cc:493] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.597564  1249 raft_consensus.cc:515] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.598922  1246 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: No bootstrap required, opened a new log
I20260709 12:59:11.599365  1246 ts_tablet_manager.cc:1403] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.018s
I20260709 12:59:11.599674  1249 leader_election.cc:290] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.601841  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.599599  1250 raft_consensus.cc:359] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.602164  1246 raft_consensus.cc:359] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.603055  1246 raft_consensus.cc:385] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.603407  1246 raft_consensus.cc:740] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.604020  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
W20260709 12:59:11.604360  1096 leader_election.cc:343] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.604116  1246 consensus_queue.cc:260] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.605304  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.605924  1132 raft_consensus.cc:2468] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
W20260709 12:59:11.606048  1095 leader_election.cc:343] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.606571  1246 ts_tablet_manager.cc:1434] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:11.606508  1095 leader_election.cc:304] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.607733  1269 raft_consensus.cc:2749] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.595736  1272 leader_election.cc:290] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.596429  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.596489  1248 tablet_bootstrap.cc:654] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.602918  1250 raft_consensus.cc:385] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.610862  1250 raft_consensus.cc:740] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.609272  1171 leader_election.cc:304] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.611794  1250 consensus_queue.cc:260] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
W20260709 12:59:11.612847  1170 leader_election.cc:343] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.594309  1131 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.614490  1171 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.613880   953 catalog_manager.cc:5697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.612831  1252 raft_consensus.cc:2804] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.616062  1272 raft_consensus.cc:2804] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.616358  1252 raft_consensus.cc:493] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.617166  1252 raft_consensus.cc:3060] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.620606  1250 ts_tablet_manager.cc:1434] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:59:11.621196  1272 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.621676  1272 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.622032  1250 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.628984  1257 raft_consensus.cc:493] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.629606  1257 raft_consensus.cc:515] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.635596  1272 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.636345  1252 raft_consensus.cc:515] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.639359  1252 leader_election.cc:290] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.640012  1248 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.640260  1257 leader_election.cc:290] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.640537  1248 ts_tablet_manager.cc:1403] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.015s
I20260709 12:59:11.640734  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.641463  1272 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.643607  1248 raft_consensus.cc:359] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.642560  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.648324  1248 raft_consensus.cc:385] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.648661  1248 raft_consensus.cc:740] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.649026  1132 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.641513  1131 raft_consensus.cc:3060] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.652886  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.649448  1248 consensus_queue.cc:260] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.656764  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.657590  1132 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.658779  1248 ts_tablet_manager.cc:1434] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:59:11.658957  1171 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
W20260709 12:59:11.660415  1170 leader_election.cc:343] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:11.661537  1170 leader_election.cc:343] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.661818  1272 raft_consensus.cc:2804] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.662047  1250 tablet_bootstrap.cc:654] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.662401  1272 raft_consensus.cc:697] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.663280  1272 consensus_queue.cc:237] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.667857  1248 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: Bootstrap starting.
I20260709 12:59:11.673712  1131 raft_consensus.cc:2468] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.682760  1171 leader_election.cc:304] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.683352  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.683612  1272 raft_consensus.cc:2804] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.684561  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.685308  1206 raft_consensus.cc:2393] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c021745e2e654329bc44df9ff0f58f81 in current term 1: Already voted for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in this term.
I20260709 12:59:11.686362  1248 tablet_bootstrap.cc:654] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.687548  1272 raft_consensus.cc:697] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.688721  1020 leader_election.cc:304] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81; no voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:11.688500  1272 consensus_queue.cc:237] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.688866   955 catalog_manager.cc:5697] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.689884  1257 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.691150  1250 tablet_bootstrap.cc:492] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.691628  1250 ts_tablet_manager.cc:1403] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.012s
I20260709 12:59:11.694548  1250 raft_consensus.cc:359] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.695317  1250 raft_consensus.cc:385] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.695611  1250 raft_consensus.cc:740] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.696467  1250 consensus_queue.cc:260] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.698920  1257 raft_consensus.cc:2749] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.704843  1250 ts_tablet_manager.cc:1434] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.011s
I20260709 12:59:11.705932  1250 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.710373  1248 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: No bootstrap required, opened a new log
I20260709 12:59:11.710857  1248 ts_tablet_manager.cc:1403] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.002s
I20260709 12:59:11.710142   953 catalog_manager.cc:5697] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.712548  1250 tablet_bootstrap.cc:654] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.713717  1248 raft_consensus.cc:359] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.714440  1248 raft_consensus.cc:385] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.714718  1248 raft_consensus.cc:740] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.715551  1248 consensus_queue.cc:260] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.717857  1248 ts_tablet_manager.cc:1434] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:11.719120  1250 tablet_bootstrap.cc:492] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.719664  1250 ts_tablet_manager.cc:1403] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 12:59:11.723205  1250 raft_consensus.cc:359] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.723973  1250 raft_consensus.cc:385] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.724236  1250 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.724824  1250 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.726435  1250 ts_tablet_manager.cc:1434] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:59:11.727533  1250 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.732648  1250 tablet_bootstrap.cc:654] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.736956  1250 tablet_bootstrap.cc:492] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.737360  1250 ts_tablet_manager.cc:1403] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:59:11.739562  1250 raft_consensus.cc:359] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.740121  1250 raft_consensus.cc:385] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.740410  1250 raft_consensus.cc:740] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.741063  1250 consensus_queue.cc:260] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.743218  1250 ts_tablet_manager.cc:1434] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:11.744652  1250 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.745841  1249 raft_consensus.cc:493] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.746362  1249 raft_consensus.cc:515] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.748564  1249 leader_election.cc:290] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.749636  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.750166  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.750346  1250 tablet_bootstrap.cc:654] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.750310  1055 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 0.
I20260709 12:59:11.750795  1206 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 0.
I20260709 12:59:11.751766  1096 leader_election.cc:304] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.752681  1249 raft_consensus.cc:2804] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.753028  1249 raft_consensus.cc:493] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.753387  1249 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.756961  1250 tablet_bootstrap.cc:492] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.757463  1250 ts_tablet_manager.cc:1403] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:59:11.760103  1250 raft_consensus.cc:359] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.760825  1250 raft_consensus.cc:385] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.761207  1250 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.760869  1249 raft_consensus.cc:515] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.762079  1250 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.763636  1249 leader_election.cc:290] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.764111  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.764142  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:11.764207  1250 ts_tablet_manager.cc:1434] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:11.764844  1055 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.765012  1206 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.766232  1250 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.772748  1250 tablet_bootstrap.cc:654] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.772362  1055 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.772614  1206 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.774081  1096 leader_election.cc:304] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.775892  1249 raft_consensus.cc:2804] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.776573  1249 raft_consensus.cc:697] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:11.777531  1249 consensus_queue.cc:237] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.780172  1250 tablet_bootstrap.cc:492] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.780697  1250 ts_tablet_manager.cc:1403] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:59:11.781533  1272 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:11.783334  1250 raft_consensus.cc:359] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.783824  1250 raft_consensus.cc:385] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.784077  1250 raft_consensus.cc:740] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.784853  1250 consensus_queue.cc:260] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.787294  1296 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.787739  1296 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.789170  1250 ts_tablet_manager.cc:1434] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:11.789978  1296 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.790125  1250 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: Bootstrap starting.
I20260709 12:59:11.789496   953 catalog_manager.cc:5697] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.791443  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.792191  1132 raft_consensus.cc:2393] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c021745e2e654329bc44df9ff0f58f81 in current term 1: Already voted for candidate 6ab9f7d50c044526a738cd7071d47be9 in this term.
I20260709 12:59:11.793830  1249 raft_consensus.cc:493] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.794420  1249 raft_consensus.cc:515] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.797492  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642cc9404be9465583a72e2326757339" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.797850  1250 tablet_bootstrap.cc:654] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:11.797931  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642cc9404be9465583a72e2326757339" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.798628  1205 raft_consensus.cc:2468] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 0.
W20260709 12:59:11.799559  1096 leader_election.cc:343] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:11.800819  1095 leader_election.cc:304] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:11.804337  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.805756  1280 consensus_queue.cc:1048] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:11.801761  1269 raft_consensus.cc:2804] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.810565  1269 raft_consensus.cc:493] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.810913  1269 raft_consensus.cc:3060] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.810079  1020 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81; no voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:11.810101  1249 leader_election.cc:290] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.840590  1296 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.846231  1269 raft_consensus.cc:515] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.849721  1269 leader_election.cc:290] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.851330  1250 tablet_bootstrap.cc:492] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: No bootstrap required, opened a new log
I20260709 12:59:11.851794  1250 ts_tablet_manager.cc:1403] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: Time spent bootstrapping tablet: real 0.062s	user 0.029s	sys 0.013s
I20260709 12:59:11.851840  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642cc9404be9465583a72e2326757339" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:11.854784  1206 raft_consensus.cc:3060] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.854568  1250 raft_consensus.cc:359] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.855299  1250 raft_consensus.cc:385] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:11.855587  1250 raft_consensus.cc:740] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Initialized, Role: FOLLOWER
I20260709 12:59:11.856400  1250 consensus_queue.cc:260] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.858337  1296 raft_consensus.cc:2749] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.858625  1250 ts_tablet_manager.cc:1434] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:11.861552  1269 consensus_queue.cc:1048] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:11.864511  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642cc9404be9465583a72e2326757339" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.865087  1056 raft_consensus.cc:3060] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.870283  1271 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:11.871690  1056 raft_consensus.cc:2468] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.872759  1096 leader_election.cc:304] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:11.873651  1280 raft_consensus.cc:2804] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.874099  1280 raft_consensus.cc:697] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:11.874917  1280 consensus_queue.cc:237] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.879755  1206 raft_consensus.cc:2468] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 1.
I20260709 12:59:11.881454  1271 raft_consensus.cc:493] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.881857  1271 raft_consensus.cc:515] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.884621  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81" is_pre_election: true
I20260709 12:59:11.884840  1271 leader_election.cc:290] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.885200  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.885457  1056 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.886133  1132 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 0.
I20260709 12:59:11.887127  1170 leader_election.cc:304] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:11.888019  1271 raft_consensus.cc:2804] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:11.888453  1271 raft_consensus.cc:493] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.888758  1271 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.897810  1271 raft_consensus.cc:515] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.899971  1271 leader_election.cc:290] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:11.900841  1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:11.900202   954 catalog_manager.cc:5697] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.901321  1057 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.902071  1257 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.902575  1257 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.903409  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:11.903992  1132 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.904455  1296 raft_consensus.cc:493] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.904919  1296 raft_consensus.cc:515] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.905933  1269 consensus_queue.cc:1048] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:11.906939  1296 leader_election.cc:290] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.907883  1257 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:11.909420  1057 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.910154  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.910610  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" is_pre_election: true
I20260709 12:59:11.911006  1130 raft_consensus.cc:2393] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c021745e2e654329bc44df9ff0f58f81 in current term 1: Already voted for candidate 6ab9f7d50c044526a738cd7071d47be9 in this term.
I20260709 12:59:11.911417  1129 raft_consensus.cc:2393] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c021745e2e654329bc44df9ff0f58f81 in current term 1: Already voted for candidate 6ab9f7d50c044526a738cd7071d47be9 in this term.
I20260709 12:59:11.912068  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88efae44bee24cf4832b4eb6507ec9a7" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.912212  1170 leader_election.cc:304] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:11.913094  1271 raft_consensus.cc:2804] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:11.913594  1271 raft_consensus.cc:697] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:11.914633  1271 consensus_queue.cc:237] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:11.916721  1022 leader_election.cc:304] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81; no voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:11.918040  1257 raft_consensus.cc:3060] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.920006  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab9f7d50c044526a738cd7071d47be9" is_pre_election: true
I20260709 12:59:11.923061  1132 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 1.
I20260709 12:59:11.925819  1257 raft_consensus.cc:2749] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.927138  1020 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81; no voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:11.928537  1257 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:11.935458  1257 raft_consensus.cc:2749] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:11.949731   953 catalog_manager.cc:5697] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.950774  1249 consensus_queue.cc:1048] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:11.975824  1271 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:11.977886  1271 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.015180  1271 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.026716  1271 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.080226  1271 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.090432  1271 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:12.111776  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:12.112265  1205 raft_consensus.cc:606] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:12.118259  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:12.118809  1205 raft_consensus.cc:606] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:12.132992  1132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:59:12.133538  1132 raft_consensus.cc:606] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:12.139153  1132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:59:12.139667  1132 raft_consensus.cc:606] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:12.145238  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:12.145857  1205 raft_consensus.cc:606] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:12.154588  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:12.155140  1205 raft_consensus.cc:606] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Received request to transfer leadership to TS ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:12.160396  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:12.160889  1205 raft_consensus.cc:606] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Received request to transfer leadership to TS ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:12.268271  1271 consensus_queue.cc:1048] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.270315  1249 consensus_queue.cc:1048] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.281734  1252 consensus_queue.cc:1048] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.282349  1249 consensus_queue.cc:1048] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.299347  1249 consensus_queue.cc:1048] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.312851  1279 consensus_queue.cc:1048] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.314489  1269 raft_consensus.cc:993] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.314939  1280 raft_consensus.cc:1081] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.317152  1057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:59:12.317700  1057 raft_consensus.cc:493] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.318089  1057 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.325081  1057 raft_consensus.cc:515] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.327574  1057 leader_election.cc:290] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.327878  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:12.328151  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff1f12c5ee24fa190b5bbf4fe85bb6c" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.328527  1132 raft_consensus.cc:3055] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.328703  1205 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.328886  1132 raft_consensus.cc:740] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:12.329751  1132 consensus_queue.cc:260] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.330974  1132 raft_consensus.cc:3060] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.335974  1205 raft_consensus.cc:2468] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.337225  1020 leader_election.cc:304] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:12.337558  1132 raft_consensus.cc:2468] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.337880  1257 raft_consensus.cc:2804] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.338346  1257 raft_consensus.cc:697] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:12.339027  1257 consensus_queue.cc:237] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.344998   955 catalog_manager.cc:5697] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.367108  1280 raft_consensus.cc:993] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.367580  1249 raft_consensus.cc:1081] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.368141  1252 raft_consensus.cc:993] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.368633  1272 raft_consensus.cc:1081] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.369199  1057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:59:12.369752  1057 raft_consensus.cc:493] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.370096  1057 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.370128  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52436
I20260709 12:59:12.370719  1055 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.370978  1055 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.374591  1057 raft_consensus.cc:515] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.375159  1055 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.376333  1057 leader_election.cc:290] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.377228  1055 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.377381  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.377413  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:12.378027  1205 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.378044  1129 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.378258  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.379187  1203 raft_consensus.cc:3055] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.379490  1203 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:12.380364  1203 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.380749  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3abb8696c8e448c7bf5240a71792e18a" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:12.381517  1132 raft_consensus.cc:3055] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.381747  1203 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.381927  1132 raft_consensus.cc:740] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:12.382913  1132 consensus_queue.cc:260] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.384142  1132 raft_consensus.cc:3060] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.384796  1205 raft_consensus.cc:2468] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.384791  1129 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.386073  1020 leader_election.cc:304] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, c021745e2e654329bc44df9ff0f58f81; no voters: 
I20260709 12:59:12.386272  1022 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:12.386835  1257 raft_consensus.cc:2804] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.387032  1296 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.389403  1203 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.391108  1257 raft_consensus.cc:697] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:12.392074  1257 consensus_queue.cc:237] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.392874  1132 raft_consensus.cc:2468] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.394989  1296 raft_consensus.cc:697] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:12.395843  1296 consensus_queue.cc:237] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.400069   955 catalog_manager.cc:5697] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.411449   955 catalog_manager.cc:5697] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.472347  1252 raft_consensus.cc:993] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.472759  1272 raft_consensus.cc:1081] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.474045  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52436
I20260709 12:59:12.474570  1055 raft_consensus.cc:493] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.474920  1055 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.479177  1055 raft_consensus.cc:515] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:12.480712  1055 leader_election.cc:290] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:12.481594  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.481601  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:12.482225  1203 raft_consensus.cc:3055] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.482250  1132 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.482590  1203 raft_consensus.cc:740] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:12.483253  1203 consensus_queue.cc:260] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:12.484059  1203 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.486958  1132 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.488152  1022 leader_election.cc:304] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:12.488649  1203 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.489104  1257 raft_consensus.cc:2804] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.489537  1257 raft_consensus.cc:697] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:12.490267  1257 consensus_queue.cc:237] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:12.495978   955 catalog_manager.cc:5697] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.502830  1272 raft_consensus.cc:993] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:12.503371  1252 raft_consensus.cc:1081] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Signalling peer ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:12.505067  1132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57458
I20260709 12:59:12.505570  1132 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.505885  1132 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.511006  1132 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.513346  1132 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 2 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.514667  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:12.515044  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.515422  1055 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.515647  1203 raft_consensus.cc:3055] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.516036  1203 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:12.516887  1272 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:12.517503  1275 raft_consensus.cc:993] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.516885  1203 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.518146  1275 raft_consensus.cc:1081] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:12.518868  1203 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.520009  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52436
I20260709 12:59:12.520568  1056 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.520947  1056 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.522369  1055 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 2.
I20260709 12:59:12.523658  1096 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:12.524514  1249 raft_consensus.cc:2804] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.524953  1249 raft_consensus.cc:697] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:12.525334  1203 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 2.
I20260709 12:59:12.525775  1249 consensus_queue.cc:237] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.528136  1056 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.530709  1056 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.530906  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:12.531502  1132 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.535706  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.536334  1203 raft_consensus.cc:3055] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.536631  1203 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:12.537431  1203 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.537604  1272 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:12.538610  1203 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.541719   954 catalog_manager.cc:5697] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 1 to 2, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.546273  1132 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.547734  1022 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:12.548589  1257 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.549149  1257 raft_consensus.cc:697] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:12.550040  1257 consensus_queue.cc:237] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.553807  1203 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:12.560750  1275 raft_consensus.cc:993] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:12.562311   955 catalog_manager.cc:5697] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.563668  1275 raft_consensus.cc:1081] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Signalling peer ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:12.565585  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57458
I20260709 12:59:12.566185  1129 raft_consensus.cc:493] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.566588  1129 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.572768  1129 raft_consensus.cc:515] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.574894  1129 leader_election.cc:290] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 2 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:12.575711  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:12.575935  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:12.576422  1056 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.576558  1203 raft_consensus.cc:3055] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.576960  1203 raft_consensus.cc:740] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:12.577764  1203 consensus_queue.cc:260] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.578995  1203 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.584086  1056 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 2.
I20260709 12:59:12.584839  1203 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 2.
I20260709 12:59:12.585605  1096 leader_election.cc:304] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:12.586421  1249 raft_consensus.cc:2804] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.586959  1249 raft_consensus.cc:697] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:12.587805  1249 consensus_queue.cc:237] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:12.595059   955 catalog_manager.cc:5697] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 1 to 2, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.819357  1203 raft_consensus.cc:1275] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.820740  1257 consensus_queue.cc:1048] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.831207  1129 raft_consensus.cc:1275] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.832731  1257 consensus_queue.cc:1048] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.854647  1203 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.856083  1257 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.864382  1129 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.865995  1328 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.870118  1203 raft_consensus.cc:1275] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.872747  1329 consensus_queue.cc:1048] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.885902  1129 raft_consensus.cc:1275] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.887372  1328 consensus_queue.cc:1048] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.903470  1129 raft_consensus.cc:1275] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.904747  1328 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.914459  1203 raft_consensus.cc:1275] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.916430  1296 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.968832  1203 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.969094  1205 raft_consensus.cc:1275] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.970227  1328 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.970402  1249 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.980037  1129 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.981799  1328 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.987339  1056 raft_consensus.cc:1275] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.988871  1279 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.999935  1056 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.001633  1279 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:13.009752  1203 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.011106  1280 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.206885   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:59:15.207664   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.224992  1057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:15.225518  1057 raft_consensus.cc:606] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Received request to transfer leadership to TS 6ab9f7d50c044526a738cd7071d47be9
I20260709 12:59:15.227984  1057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:15.228488  1057 raft_consensus.cc:606] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Received request to transfer leadership to TS 6ab9f7d50c044526a738cd7071d47be9
I20260709 12:59:15.229490   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:15.230098   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:15.267493  1334 raft_consensus.cc:993] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: : Instructing follower 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:15.267854  1334 raft_consensus.cc:1081] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Signalling peer 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:15.269304  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:45652
I20260709 12:59:15.269731  1203 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.269987  1203 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.275257  1203 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.277015  1203 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 3 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:15.277832  1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:15.278020  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:15.278388  1057 raft_consensus.cc:3055] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:15.278529  1129 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.278707  1057 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:15.279471  1057 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.280515  1057 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.285254  1129 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 3.
I20260709 12:59:15.286382  1171 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:15.286405  1057 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 3.
I20260709 12:59:15.287151  1252 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.288074  1252 raft_consensus.cc:697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:15.288811  1252 consensus_queue.cc:237] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.297552   953 catalog_manager.cc:5697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 2 to 3, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.366968  1337 raft_consensus.cc:993] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: : Instructing follower 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:15.367422  1337 raft_consensus.cc:1081] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Signalling peer 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:15.368952  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:45652
I20260709 12:59:15.369406  1203 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.369755  1203 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.374675  1203 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.376528  1203 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 3 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:15.377476  1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:15.377821  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:15.378165  1057 raft_consensus.cc:3055] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:15.378414  1129 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.378607  1057 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:15.379694  1057 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.380836  1057 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.385449  1129 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 3.
I20260709 12:59:15.386668  1057 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 3.
I20260709 12:59:15.386862  1171 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:15.387754  1252 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.388238  1252 raft_consensus.cc:697] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:15.388968  1252 consensus_queue.cc:237] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:15.396842   953 catalog_manager.cc:5697] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 2 to 3, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.700700  1057 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:15.702173  1252 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:15.714960  1129 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:15.716797  1252 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:15.873538  1129 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:15.874949  1252 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:15.890970  1057 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:15.892619  1252 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.231191   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:16.245239  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:16.245728  1203 raft_consensus.cc:606] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:16.257719  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:57454
I20260709 12:59:16.258314  1203 raft_consensus.cc:606] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:16.263236  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:59:16.263759  1129 raft_consensus.cc:606] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:16.268599  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:59:16.269174  1129 raft_consensus.cc:606] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:16.274937  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
mode: GRACEFUL
new_leader_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:59:16.275452  1129 raft_consensus.cc:606] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Received request to transfer leadership to TS c021745e2e654329bc44df9ff0f58f81
I20260709 12:59:16.307860  1280 raft_consensus.cc:993] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.308286  1280 raft_consensus.cc:1081] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.310002  1057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:59:16.310532  1057 raft_consensus.cc:493] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.310842  1057 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.337706  1352 raft_consensus.cc:993] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.338240  1338 raft_consensus.cc:1081] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.340366  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52436
I20260709 12:59:16.340796  1056 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.341053  1056 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.349365  1352 raft_consensus.cc:993] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.349782  1352 raft_consensus.cc:1081] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.351238  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52436
I20260709 12:59:16.351720  1055 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.352085  1055 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.385200  1057 raft_consensus.cc:515] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.388586  1057 leader_election.cc:290] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:16.391718  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:16.391719  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd2030e5ab4525a96d6b1d06d642af" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:16.392598  1203 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.392696  1129 raft_consensus.cc:3055] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.393412  1129 raft_consensus.cc:740] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:16.394310  1129 consensus_queue.cc:260] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.395658  1129 raft_consensus.cc:3060] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.483520  1129 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:16.483520  1203 raft_consensus.cc:2468] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 2.
I20260709 12:59:16.483565  1055 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.483935  1056 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.485176  1022 leader_election.cc:304] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:16.486099  1337 raft_consensus.cc:2804] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.486512  1055 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 4 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:16.486757  1056 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 4 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:16.488029  1337 raft_consensus.cc:697] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:16.488298  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:16.488891  1203 raft_consensus.cc:3055] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.489223  1203 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:16.489001  1337 consensus_queue.cc:237] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.490264  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:16.489923  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:16.489877  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:16.491300  1205 raft_consensus.cc:3055] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.491935  1132 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.491930  1129 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.492026  1205 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:16.493152  1205 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.494699  1205 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.499794  1203 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.501909  1203 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.505766   954 catalog_manager.cc:5697] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 1 to 2, leader changed from ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.516999  1353 raft_consensus.cc:993] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.517458  1280 raft_consensus.cc:1081] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.519402  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:59:16.519968  1056 raft_consensus.cc:493] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.520295  1056 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.526558  1353 raft_consensus.cc:993] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: : Instructing follower c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.526988  1280 raft_consensus.cc:1081] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Signalling peer c021745e2e654329bc44df9ff0f58f81 to start an election
I20260709 12:59:16.528441  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:59:16.528968  1055 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.529222  1055 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.586177  1132 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 4.
I20260709 12:59:16.587706  1022 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:16.586150  1205 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 4.
I20260709 12:59:16.586149  1129 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 4.
I20260709 12:59:16.589792  1022 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:16.590639  1337 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.590904  1354 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.592666  1056 raft_consensus.cc:515] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.595453  1337 raft_consensus.cc:697] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:16.596597  1337 consensus_queue.cc:237] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.597136  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:16.597892  1129 raft_consensus.cc:3055] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:16.597774  1354 raft_consensus.cc:697] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:16.598289  1129 raft_consensus.cc:740] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:16.599049  1056 leader_election.cc:290] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 3 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:16.599589  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2eb31a3374563b3c609b306d421fa" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:16.599164  1129 consensus_queue.cc:260] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.600263  1354 consensus_queue.cc:237] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.600677  1129 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.600176  1205 raft_consensus.cc:3060] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.606057   954 catalog_manager.cc:5697] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 3 to 4, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.619125   954 catalog_manager.cc:5697] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 3 to 4, leader changed from 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.672137  1129 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 3.
I20260709 12:59:16.672084  1055 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.673779  1203 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 4.
I20260709 12:59:16.673936  1022 leader_election.cc:304] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:16.675002  1354 raft_consensus.cc:2804] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:16.675547  1354 raft_consensus.cc:697] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:16.676486  1354 consensus_queue.cc:237] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.677492  1055 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 3 election: Requested vote from peers ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:16.677853  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:16.678435  1203 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.678804  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "c021745e2e654329bc44df9ff0f58f81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:16.679636  1129 raft_consensus.cc:3055] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:16.679998  1129 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:16.680873  1129 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.682101  1129 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.687486   954 catalog_manager.cc:5697] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 2 to 3, leader changed from ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.720140  1205 raft_consensus.cc:2468] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 3.
I20260709 12:59:16.720278  1203 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 3.
I20260709 12:59:16.720129  1129 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021745e2e654329bc44df9ff0f58f81 in term 3.
I20260709 12:59:16.721925  1022 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021745e2e654329bc44df9ff0f58f81, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:16.722730  1354 raft_consensus.cc:2804] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:16.723278  1354 raft_consensus.cc:697] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Becoming Leader. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:16.724581  1354 consensus_queue.cc:237] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:16.731122   954 catalog_manager.cc:5697] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 reported cstate change: term changed from 2 to 3, leader changed from ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194) to c021745e2e654329bc44df9ff0f58f81 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c021745e2e654329bc44df9ff0f58f81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.944525  1203 raft_consensus.cc:1275] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:16.945875  1354 consensus_queue.cc:1048] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.955946  1129 raft_consensus.cc:1275] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:16.958170  1337 consensus_queue.cc:1048] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.013532  1129 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.015045  1337 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.024765  1203 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.026664  1337 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.045632  1132 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.047025  1337 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.057963  1203 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:17.060657  1360 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.144377  1203 raft_consensus.cc:1275] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.144378  1132 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.147491  1361 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:17.148881  1354 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:17.174571  1132 raft_consensus.cc:1275] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.176481  1361 consensus_queue.cc:1048] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.176929  1205 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Refusing update from remote peer c021745e2e654329bc44df9ff0f58f81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.179100  1337 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.284739   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.292928  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:19.293560  1055 raft_consensus.cc:606] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Received request to transfer leadership to TS ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:19.296370  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:19.296829  1055 raft_consensus.cc:606] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Received request to transfer leadership to TS ff4ff3e5464d493dbbac1796e6f1bf54
I20260709 12:59:19.299297  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:19.299885  1055 raft_consensus.cc:606] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Received request to transfer leadership to TS 6ab9f7d50c044526a738cd7071d47be9
I20260709 12:59:19.302609  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
mode: GRACEFUL
new_leader_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:59822
I20260709 12:59:19.303103  1055 raft_consensus.cc:606] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Received request to transfer leadership to TS 6ab9f7d50c044526a738cd7071d47be9
I20260709 12:59:19.304221   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:19.304859   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.503654  1337 raft_consensus.cc:993] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: : Instructing follower ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:19.504136  1378 raft_consensus.cc:1081] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Signalling peer ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:19.505940  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57472
I20260709 12:59:19.506444  1129 raft_consensus.cc:493] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.506722  1129 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.512050  1129 raft_consensus.cc:515] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.513701  1129 leader_election.cc:290] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 5 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103)
I20260709 12:59:19.515057  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:19.514967  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca003e31064a3ab038a0c729481c55" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:19.515676  1203 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.515753  1055 raft_consensus.cc:3055] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.516165  1055 raft_consensus.cc:740] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:19.516963  1055 consensus_queue.cc:260] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.518271  1055 raft_consensus.cc:3060] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.520407  1337 raft_consensus.cc:993] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: : Instructing follower 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:19.521576  1337 raft_consensus.cc:1081] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Signalling peer 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:19.522724  1203 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 5.
I20260709 12:59:19.523487  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:45652
I20260709 12:59:19.524073  1205 raft_consensus.cc:493] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.524080  1095 leader_election.cc:304] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:19.524821  1205 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.525357  1280 raft_consensus.cc:2804] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.525696  1055 raft_consensus.cc:2468] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 5.
I20260709 12:59:19.526430  1280 raft_consensus.cc:697] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:19.527652  1280 consensus_queue.cc:237] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.531365  1205 raft_consensus.cc:515] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.534128  1205 leader_election.cc:290] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 5 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:19.534267  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:19.534821  1055 raft_consensus.cc:3055] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.535099  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69e77f1bc7447aea639c610a534f28d" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:19.535400  1055 raft_consensus.cc:740] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:19.535796  1129 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.535761   954 catalog_manager.cc:5697] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 4 to 5, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.536577  1055 consensus_queue.cc:260] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.537735  1055 raft_consensus.cc:3060] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.542872  1129 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 5.
I20260709 12:59:19.544512  1055 raft_consensus.cc:2468] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 5.
I20260709 12:59:19.544653  1171 leader_election.cc:304] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:19.545616  1352 raft_consensus.cc:2804] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.547461  1352 raft_consensus.cc:697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 5 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:19.548548  1352 consensus_queue.cc:237] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.557571   954 catalog_manager.cc:5697] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 4 to 5, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.676560  1378 raft_consensus.cc:993] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: : Instructing follower ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:19.677115  1337 raft_consensus.cc:1081] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Signalling peer ff4ff3e5464d493dbbac1796e6f1bf54 to start an election
I20260709 12:59:19.678694  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765"
dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
 from {username='slave'} at 127.0.0.1:57472
I20260709 12:59:19.679255  1129 raft_consensus.cc:493] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.679510  1129 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.683562  1129 raft_consensus.cc:515] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:19.685106  1129 leader_election.cc:290] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 3 election: Requested vote from peers 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195:45103), c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305)
I20260709 12:59:19.686136  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:19.686594  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b479a3b5407f44feb56da85138b6e765" candidate_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
I20260709 12:59:19.686679  1055 raft_consensus.cc:3055] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:19.687016  1055 raft_consensus.cc:740] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:19.687062  1205 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.687829  1055 consensus_queue.cc:260] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:19.688742  1055 raft_consensus.cc:3060] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.692270  1205 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 3.
I20260709 12:59:19.693739  1095 leader_election.cc:304] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:19.694711  1280 raft_consensus.cc:2804] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:19.694957  1055 raft_consensus.cc:2468] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4ff3e5464d493dbbac1796e6f1bf54 in term 3.
I20260709 12:59:19.695325  1280 raft_consensus.cc:697] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 LEADER]: Becoming Leader. State: Replica: ff4ff3e5464d493dbbac1796e6f1bf54, State: Running, Role: LEADER
I20260709 12:59:19.696501  1280 consensus_queue.cc:237] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } }
I20260709 12:59:19.704891   954 catalog_manager.cc:5697] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 reported cstate change: term changed from 2 to 3, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.746809  1378 raft_consensus.cc:993] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: : Instructing follower 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:19.747334  1337 raft_consensus.cc:1081] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Signalling peer 6ab9f7d50c044526a738cd7071d47be9 to start an election
I20260709 12:59:19.749127  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90"
dest_uuid: "6ab9f7d50c044526a738cd7071d47be9"
 from {username='slave'} at 127.0.0.1:45652
I20260709 12:59:19.749662  1205 raft_consensus.cc:493] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.749943  1205 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.756093  1205 raft_consensus.cc:515] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.757866  1205 leader_election.cc:290] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 4 election: Requested vote from peers c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305), ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691)
I20260709 12:59:19.758889  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54"
I20260709 12:59:19.758912  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc29f251f72a4b259a59accc1b2e8a90" candidate_uuid: "6ab9f7d50c044526a738cd7071d47be9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c021745e2e654329bc44df9ff0f58f81"
I20260709 12:59:19.759558  1129 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.759713  1055 raft_consensus.cc:3055] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:19.760093  1055 raft_consensus.cc:740] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c021745e2e654329bc44df9ff0f58f81, State: Running, Role: LEADER
I20260709 12:59:19.760751  1055 consensus_queue.cc:260] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.761648  1055 raft_consensus.cc:3060] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.764601  1129 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 4.
I20260709 12:59:19.765738  1171 leader_election.cc:304] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab9f7d50c044526a738cd7071d47be9, ff4ff3e5464d493dbbac1796e6f1bf54; no voters: 
I20260709 12:59:19.766050  1055 raft_consensus.cc:2468] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab9f7d50c044526a738cd7071d47be9 in term 4.
I20260709 12:59:19.766553  1352 raft_consensus.cc:2804] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:19.767016  1352 raft_consensus.cc:697] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 LEADER]: Becoming Leader. State: Replica: 6ab9f7d50c044526a738cd7071d47be9, State: Running, Role: LEADER
I20260709 12:59:19.767834  1352 consensus_queue.cc:237] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } }
I20260709 12:59:19.775250   954 catalog_manager.cc:5697] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 reported cstate change: term changed from 3 to 4, leader changed from c021745e2e654329bc44df9ff0f58f81 (127.0.107.193) to 6ab9f7d50c044526a738cd7071d47be9 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "6ab9f7d50c044526a738cd7071d47be9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.931869  1129 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:19.933889  1385 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:19.945808  1055 raft_consensus.cc:1275] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:19.947139  1385 consensus_queue.cc:1048] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.030629  1205 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:20.032107  1280 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:20.043144  1055 raft_consensus.cc:1275] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:20.045272  1397 consensus_queue.cc:1048] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:20.110481  1055 raft_consensus.cc:1275] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:20.112354  1397 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.122493  1205 raft_consensus.cc:1275] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Refusing update from remote peer ff4ff3e5464d493dbbac1796e6f1bf54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:20.124143  1380 consensus_queue.cc:1048] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab9f7d50c044526a738cd7071d47be9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.190203  1129 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:20.192247  1385 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4ff3e5464d493dbbac1796e6f1bf54" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.201038  1055 raft_consensus.cc:1275] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Refusing update from remote peer 6ab9f7d50c044526a738cd7071d47be9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:20.203485  1392 consensus_queue.cc:1048] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021745e2e654329bc44df9ff0f58f81" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:20.305713   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.312166   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:20.344064   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:20.344877   431 tablet_replica.cc:333] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.345631   431 raft_consensus.cc:2243] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.346236   431 raft_consensus.cc:2272] T 642cc9404be9465583a72e2326757339 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.348024   431 tablet_replica.cc:333] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.348664   431 raft_consensus.cc:2243] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.349052   431 raft_consensus.cc:2272] T cc29f251f72a4b259a59accc1b2e8a90 P c021745e2e654329bc44df9ff0f58f81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.351800   431 tablet_replica.cc:333] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.352530   431 raft_consensus.cc:2243] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.353577   431 raft_consensus.cc:2272] T fff2eb31a3374563b3c609b306d421fa P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:20.353883  1170 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 12:59:20.355731   431 tablet_replica.cc:333] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.356487   431 raft_consensus.cc:2243] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.356954   431 raft_consensus.cc:2272] T 88efae44bee24cf4832b4eb6507ec9a7 P c021745e2e654329bc44df9ff0f58f81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:20.357547  1170 consensus_peers.cc:597] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 -> Peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Couldn't send request to peer c021745e2e654329bc44df9ff0f58f81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:20.358932   431 tablet_replica.cc:333] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.359800   431 raft_consensus.cc:2243] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.360275   431 raft_consensus.cc:2272] T f69e77f1bc7447aea639c610a534f28d P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.362668   431 tablet_replica.cc:333] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.363173   431 raft_consensus.cc:2243] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.363943   431 raft_consensus.cc:2272] T 6ffd2030e5ab4525a96d6b1d06d642af P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.365561   431 tablet_replica.cc:333] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.366016   431 raft_consensus.cc:2243] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.366691   431 raft_consensus.cc:2272] T 3abb8696c8e448c7bf5240a71792e18a P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.368364   431 tablet_replica.cc:333] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.368786   431 raft_consensus.cc:2243] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.369138   431 raft_consensus.cc:2272] T 6cca003e31064a3ab038a0c729481c55 P c021745e2e654329bc44df9ff0f58f81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.371548   431 tablet_replica.cc:333] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.372346   431 raft_consensus.cc:2243] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.373135   431 raft_consensus.cc:2272] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P c021745e2e654329bc44df9ff0f58f81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.375730   431 tablet_replica.cc:333] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81: stopping tablet replica
I20260709 12:59:20.376159   431 raft_consensus.cc:2243] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.376545   431 raft_consensus.cc:2272] T b479a3b5407f44feb56da85138b6e765 P c021745e2e654329bc44df9ff0f58f81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.406054   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:59:20.427433   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:20.455010   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:20.455945   431 tablet_replica.cc:333] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
W20260709 12:59:20.456748  1171 consensus_peers.cc:597] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 -> Peer ff4ff3e5464d493dbbac1796e6f1bf54 (127.0.107.194:33691): Couldn't send request to peer ff4ff3e5464d493dbbac1796e6f1bf54. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:20.457046   431 raft_consensus.cc:2243] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.457540   431 raft_consensus.cc:2272] T 88efae44bee24cf4832b4eb6507ec9a7 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.459422   431 tablet_replica.cc:333] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.459899   431 raft_consensus.cc:2243] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.460443   431 raft_consensus.cc:2272] T fff2eb31a3374563b3c609b306d421fa P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.462039   431 tablet_replica.cc:333] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.462555   431 raft_consensus.cc:2243] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.462957   431 raft_consensus.cc:2272] T 6ffd2030e5ab4525a96d6b1d06d642af P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.464550   431 tablet_replica.cc:333] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.465018   431 raft_consensus.cc:2243] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.465684   431 raft_consensus.cc:2272] T 642cc9404be9465583a72e2326757339 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.467343   431 tablet_replica.cc:333] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.467844   431 raft_consensus.cc:2243] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.468216   431 raft_consensus.cc:2272] T cc29f251f72a4b259a59accc1b2e8a90 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.470224   431 tablet_replica.cc:333] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.471238   431 raft_consensus.cc:2243] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.471747   431 raft_consensus.cc:2272] T f69e77f1bc7447aea639c610a534f28d P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.474711   431 tablet_replica.cc:333] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.475188   431 raft_consensus.cc:2243] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.475569   431 raft_consensus.cc:2272] T 3abb8696c8e448c7bf5240a71792e18a P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.478186   431 tablet_replica.cc:333] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.478818   431 raft_consensus.cc:2243] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.479806   431 raft_consensus.cc:2272] T 6cca003e31064a3ab038a0c729481c55 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.481916   431 tablet_replica.cc:333] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.482540   431 raft_consensus.cc:2243] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.483079   431 raft_consensus.cc:2272] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P ff4ff3e5464d493dbbac1796e6f1bf54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.484968   431 tablet_replica.cc:333] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54: stopping tablet replica
I20260709 12:59:20.485374   431 raft_consensus.cc:2243] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.486064   431 raft_consensus.cc:2272] T b479a3b5407f44feb56da85138b6e765 P ff4ff3e5464d493dbbac1796e6f1bf54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.518541   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:20.539264   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:20.575003   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:20.576025   431 tablet_replica.cc:333] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.577056   431 raft_consensus.cc:2243] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.577731   431 raft_consensus.cc:2272] T fff2eb31a3374563b3c609b306d421fa P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:20.578478  1170 consensus_peers.cc:597] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 -> Peer c021745e2e654329bc44df9ff0f58f81 (127.0.107.193:34305): Couldn't send request to peer c021745e2e654329bc44df9ff0f58f81. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:20.580538   431 tablet_replica.cc:333] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.581166   431 raft_consensus.cc:2243] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.582029   431 raft_consensus.cc:2272] T 88efae44bee24cf4832b4eb6507ec9a7 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.583982   431 tablet_replica.cc:333] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.584511   431 raft_consensus.cc:2243] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.584903   431 raft_consensus.cc:2272] T 642cc9404be9465583a72e2326757339 P 6ab9f7d50c044526a738cd7071d47be9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.586688   431 tablet_replica.cc:333] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.587219   431 raft_consensus.cc:2243] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.588109   431 raft_consensus.cc:2272] T cc29f251f72a4b259a59accc1b2e8a90 P 6ab9f7d50c044526a738cd7071d47be9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.590216   431 tablet_replica.cc:333] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.590728   431 raft_consensus.cc:2243] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.591341   431 raft_consensus.cc:2272] T 6ffd2030e5ab4525a96d6b1d06d642af P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.593513   431 tablet_replica.cc:333] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.594038   431 raft_consensus.cc:2243] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.594877   431 raft_consensus.cc:2272] T f69e77f1bc7447aea639c610a534f28d P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.597429   431 tablet_replica.cc:333] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.597986   431 raft_consensus.cc:2243] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.598415   431 raft_consensus.cc:2272] T 6cca003e31064a3ab038a0c729481c55 P 6ab9f7d50c044526a738cd7071d47be9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.601210   431 tablet_replica.cc:333] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.601680   431 raft_consensus.cc:2243] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.602094   431 raft_consensus.cc:2272] T 3abb8696c8e448c7bf5240a71792e18a P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.604174   431 tablet_replica.cc:333] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.604773   431 raft_consensus.cc:2243] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.605189   431 raft_consensus.cc:2272] T 5ff1f12c5ee24fa190b5bbf4fe85bb6c P 6ab9f7d50c044526a738cd7071d47be9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.606971   431 tablet_replica.cc:333] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9: stopping tablet replica
I20260709 12:59:20.607434   431 raft_consensus.cc:2243] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.607861   431 raft_consensus.cc:2272] T b479a3b5407f44feb56da85138b6e765 P 6ab9f7d50c044526a738cd7071d47be9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.640581   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:20.662341   431 master.cc:562] Master@127.0.107.254:45527 shutting down...
I20260709 12:59:20.682998   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:20.683528   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.683840   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8932167264b0418a92cd85a92ef3d6d6: stopping tablet replica
I20260709 12:59:20.704478   431 master.cc:584] Master@127.0.107.254:45527 shutdown complete.
6ab9f7d50c044526a738cd7071d47be9  1
c021745e2e654329bc44df9ff0f58f81  5
ff4ff3e5464d493dbbac1796e6f1bf54  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10521 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:59:20.748647   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41741
I20260709 12:59:20.749792   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:20.756454  1407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:20.756660  1408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:20.757634  1410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.759441   431 server_base.cc:1061] running on GCE node
I20260709 12:59:20.760578   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:20.760820   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:20.760979   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601960760961 us; error 0 us; skew 500 ppm
I20260709 12:59:20.761587   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:20.764569   431 webserver.cc:533] Webserver started at http://127.0.107.254:39783/ using document root <none> and password file <none>
I20260709 12:59:20.765129   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:20.765304   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:20.765638   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:20.766795   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "3fc8854ff8e34244b91acf19f7f50f8a"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-021n"
I20260709 12:59:20.772100   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:59:20.776052  1415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:20.777251   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:59:20.777602   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "3fc8854ff8e34244b91acf19f7f50f8a"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-021n"
I20260709 12:59:20.777912   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:20.805929   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:20.807204   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:20.855110   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41741
I20260709 12:59:20.855249  1466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41741 every 8 connection(s)
I20260709 12:59:20.859676  1467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:20.871628  1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Bootstrap starting.
I20260709 12:59:20.877133  1467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:20.882436  1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: No bootstrap required, opened a new log
I20260709 12:59:20.884698  1467 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER }
I20260709 12:59:20.885124  1467 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:20.885326  1467 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc8854ff8e34244b91acf19f7f50f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:20.885890  1467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER }
I20260709 12:59:20.886335  1467 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:20.886546  1467 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:20.886940  1467 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:20.891474  1467 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER }
I20260709 12:59:20.892081  1467 leader_election.cc:304] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fc8854ff8e34244b91acf19f7f50f8a; no voters: 
I20260709 12:59:20.893427  1467 leader_election.cc:290] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:20.893851  1470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:20.895857  1470 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 1 LEADER]: Becoming Leader. State: Replica: 3fc8854ff8e34244b91acf19f7f50f8a, State: Running, Role: LEADER
I20260709 12:59:20.897287  1470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER }
I20260709 12:59:20.898190  1467 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:20.903589  1472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fc8854ff8e34244b91acf19f7f50f8a. Latest consensus state: current_term: 1 leader_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER } }
I20260709 12:59:20.904368  1472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:20.905627  1471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc8854ff8e34244b91acf19f7f50f8a" member_type: VOTER } }
I20260709 12:59:20.906469  1471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:20.908665  1479 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:20.917219  1479 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:20.918375   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:20.926383  1479 catalog_manager.cc:1383] Generated new cluster ID: c619b1f11ff349b2abe51a93cc81e1fb
I20260709 12:59:20.926743  1479 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:20.947193  1479 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:20.948555  1479 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:20.960687  1479 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Generated new TSK 0
I20260709 12:59:20.961359  1479 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:20.985872   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:20.991843  1488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:20.992858  1489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.994675   431 server_base.cc:1061] running on GCE node
W20260709 12:59:20.994570  1491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:20.995792   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:20.995995   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:20.996163   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601960996143 us; error 0 us; skew 500 ppm
I20260709 12:59:20.996779   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:20.999588   431 webserver.cc:533] Webserver started at http://127.0.107.193:37235/ using document root <none> and password file <none>
I20260709 12:59:21.000344   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:21.000543   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:21.000880   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:21.002137   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "b8ff9782cd95483c905cd1d906f41aaf"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-021n"
I20260709 12:59:21.007483   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:21.011507  1496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.012426   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:59:21.012799   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "b8ff9782cd95483c905cd1d906f41aaf"
format_stamp: "Formatted at 2026-07-09 12:59:20 on dist-test-slave-021n"
I20260709 12:59:21.013144   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:21.044478   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:21.045750   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:21.047410   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:21.049700   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:21.049911   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.050132   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:21.050292   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.100942   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36133
I20260709 12:59:21.101166  1558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36133 every 8 connection(s)
I20260709 12:59:21.106247   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:21.115176  1563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:21.117014  1564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:21.120751  1566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:21.122054   431 server_base.cc:1061] running on GCE node
I20260709 12:59:21.123123   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:21.123351   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:21.123558   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601961123537 us; error 0 us; skew 500 ppm
I20260709 12:59:21.124100   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:21.126394  1559 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41741
I20260709 12:59:21.126734  1559 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:21.127519   431 webserver.cc:533] Webserver started at http://127.0.107.194:32781/ using document root <none> and password file <none>
I20260709 12:59:21.127619  1559 heartbeater.cc:507] Master 127.0.107.254:41741 requested a full tablet report, sending...
I20260709 12:59:21.128052   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:21.128260   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:21.128535   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:21.129647   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "428f0180c2cd487c8b48e91f14dff65d"
format_stamp: "Formatted at 2026-07-09 12:59:21 on dist-test-slave-021n"
I20260709 12:59:21.129678  1432 ts_manager.cc:194] Registered new tserver with Master: b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:21.131572  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56450
I20260709 12:59:21.135097   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:59:21.138984  1571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.139971   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:59:21.140255   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "428f0180c2cd487c8b48e91f14dff65d"
format_stamp: "Formatted at 2026-07-09 12:59:21 on dist-test-slave-021n"
I20260709 12:59:21.140578   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:21.164413   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:21.166059   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:21.168113   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:21.170598   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:21.170828   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.171069   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:21.171226   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.215220   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36091
I20260709 12:59:21.215384  1633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36091 every 8 connection(s)
I20260709 12:59:21.220050   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:21.228176  1637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:21.228935  1638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:21.233153   431 server_base.cc:1061] running on GCE node
I20260709 12:59:21.233232  1634 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41741
I20260709 12:59:21.233765  1634 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:21.235340  1634 heartbeater.cc:507] Master 127.0.107.254:41741 requested a full tablet report, sending...
W20260709 12:59:21.232606  1640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:21.237169   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:21.237373   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:21.237540   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601961237522 us; error 0 us; skew 500 ppm
I20260709 12:59:21.237943  1432 ts_manager.cc:194] Registered new tserver with Master: 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:21.238065   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:21.239722  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56452
I20260709 12:59:21.241295   431 webserver.cc:533] Webserver started at http://127.0.107.195:34369/ using document root <none> and password file <none>
I20260709 12:59:21.241820   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:21.241995   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:21.242270   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:21.243472   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
format_stamp: "Formatted at 2026-07-09 12:59:21 on dist-test-slave-021n"
I20260709 12:59:21.248374   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:59:21.252117  1645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.253126   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:59:21.253438   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
format_stamp: "Formatted at 2026-07-09 12:59:21 on dist-test-slave-021n"
I20260709 12:59:21.253715   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:21.269593   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:21.271028   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:21.272847   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:21.275511   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:21.275744   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.275998   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:21.276160   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:21.321451   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41753
I20260709 12:59:21.321617  1707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41753 every 8 connection(s)
I20260709 12:59:21.336427  1708 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41741
I20260709 12:59:21.336905  1708 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:21.337960  1708 heartbeater.cc:507] Master 127.0.107.254:41741 requested a full tablet report, sending...
I20260709 12:59:21.340454  1432 ts_manager.cc:194] Registered new tserver with Master: b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:21.340983   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016111236s
I20260709 12:59:21.342060  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56462
I20260709 12:59:21.369513  1432 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56464:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:21.375584  1432 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:21.601353  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 2d85e1fb5b4b419c96d985561042498a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:21.602836  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d85e1fb5b4b419c96d985561042498a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.605432  1523 tablet_service.cc:1511] Processing CreateTablet for tablet dbb94d58e3454c868591a7960956aa47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:21.607065  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb94d58e3454c868591a7960956aa47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.609021  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:21.610472  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.613541  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:21.615051  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.618475  1598 tablet_service.cc:1511] Processing CreateTablet for tablet dbb94d58e3454c868591a7960956aa47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:21.619910  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb94d58e3454c868591a7960956aa47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.621460  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 2d85e1fb5b4b419c96d985561042498a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:21.623045  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d85e1fb5b4b419c96d985561042498a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.624238  1521 tablet_service.cc:1511] Processing CreateTablet for tablet eb7bd80f58e444e6a587b05deed3c5f5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:21.625577  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7bd80f58e444e6a587b05deed3c5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.628234  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 74bb1ccc79844935814ecd1a9a89fcd9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:21.629745  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bb1ccc79844935814ecd1a9a89fcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.639694  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:21.641193  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.645021  1667 tablet_service.cc:1511] Processing CreateTablet for tablet a266117eb57049ceb80c4acd77766559 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:21.645290  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 2d85e1fb5b4b419c96d985561042498a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:21.647063  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 724d710084f24dcaa0170aeb7fb5ffc9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:21.647063  1672 tablet_service.cc:1511] Processing CreateTablet for tablet dbb94d58e3454c868591a7960956aa47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:21.649001  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d85e1fb5b4b419c96d985561042498a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.648833  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:21.650103  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.651700  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb94d58e3454c868591a7960956aa47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.653077  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724d710084f24dcaa0170aeb7fb5ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.653712  1670 tablet_service.cc:1511] Processing CreateTablet for tablet eb7bd80f58e444e6a587b05deed3c5f5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:21.657230  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:21.657560  1518 tablet_service.cc:1511] Processing CreateTablet for tablet a266117eb57049ceb80c4acd77766559 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:21.658788  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a266117eb57049ceb80c4acd77766559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.659649  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 74bb1ccc79844935814ecd1a9a89fcd9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:21.661475  1516 tablet_service.cc:1511] Processing CreateTablet for tablet f99da1afef0249c084ef81484859e823 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:21.662727  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99da1afef0249c084ef81484859e823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.663046  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7bd80f58e444e6a587b05deed3c5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.665443  1665 tablet_service.cc:1511] Processing CreateTablet for tablet f99da1afef0249c084ef81484859e823 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:21.666720  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99da1afef0249c084ef81484859e823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.668639  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bb1ccc79844935814ecd1a9a89fcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.669472  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 4390bd9839c84c1e88aa862d642a1b1e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:21.669876  1596 tablet_service.cc:1511] Processing CreateTablet for tablet eb7bd80f58e444e6a587b05deed3c5f5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:21.670853  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4390bd9839c84c1e88aa862d642a1b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.671142  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7bd80f58e444e6a587b05deed3c5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.672839  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.673175  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 4390bd9839c84c1e88aa862d642a1b1e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:21.674265  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:21.674777  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4390bd9839c84c1e88aa862d642a1b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.675707  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.657553  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 724d710084f24dcaa0170aeb7fb5ffc9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:21.677592  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724d710084f24dcaa0170aeb7fb5ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.680765  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a266117eb57049ceb80c4acd77766559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.680641  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 74bb1ccc79844935814ecd1a9a89fcd9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:21.682092  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bb1ccc79844935814ecd1a9a89fcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.698767  1593 tablet_service.cc:1511] Processing CreateTablet for tablet a266117eb57049ceb80c4acd77766559 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:21.700572  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a266117eb57049ceb80c4acd77766559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.732551  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 724d710084f24dcaa0170aeb7fb5ffc9 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:21.734472  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724d710084f24dcaa0170aeb7fb5ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.737295  1591 tablet_service.cc:1511] Processing CreateTablet for tablet f99da1afef0249c084ef81484859e823 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:21.739293  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99da1afef0249c084ef81484859e823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.781642  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 4390bd9839c84c1e88aa862d642a1b1e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:21.791042  1723 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:21.791352  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 13e1eb7aa954478d88a68ebc9f886898 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:21.837879  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e1eb7aa954478d88a68ebc9f886898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.846369  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 967a91b43b06439992ab8ede24bc873d (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:21.849989  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4390bd9839c84c1e88aa862d642a1b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.868433  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 967a91b43b06439992ab8ede24bc873d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.881676  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 967a91b43b06439992ab8ede24bc873d (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:21.906678  1725 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:21.909030  1670 tablet_service.cc:1511] Processing CreateTablet for tablet e5c7c569add7422d840ba6ea7ea7ac47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:21.909940  1597 tablet_service.cc:1511] Processing CreateTablet for tablet e5c7c569add7422d840ba6ea7ea7ac47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:21.912869  1725 tablet_bootstrap.cc:654] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.910434  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c7c569add7422d840ba6ea7ea7ac47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:21.914603  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:21.900218  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 13e1eb7aa954478d88a68ebc9f886898 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:21.916236  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 967a91b43b06439992ab8ede24bc873d (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:21.917692  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 967a91b43b06439992ab8ede24bc873d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.920028  1724 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:21.922144  1518 tablet_service.cc:1511] Processing CreateTablet for tablet e5c7c569add7422d840ba6ea7ea7ac47 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:21.923795  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c7c569add7422d840ba6ea7ea7ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.901268  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 13e1eb7aa954478d88a68ebc9f886898 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:21.956861  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e1eb7aa954478d88a68ebc9f886898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.957118  1664 tablet_service.cc:1511] Processing CreateTablet for tablet e2ca98d137184e478468c21f485fafa4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:21.958662  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ca98d137184e478468c21f485fafa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.960032  1724 tablet_bootstrap.cc:654] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.961131  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c7c569add7422d840ba6ea7ea7ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.962774  1723 tablet_bootstrap.cc:654] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:21.964632  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e1eb7aa954478d88a68ebc9f886898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.967535  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:21.983220  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:21.983623  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 15aeeeb202e74ebd91872b6a150c5ddc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:22.004539  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aeeeb202e74ebd91872b6a150c5ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.987794  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 4203acf1edca42708e1990f548ab96b3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:22.008085  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4203acf1edca42708e1990f548ab96b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.007889  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 82df41f800684066955da1e5fcf37da0 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:22.008862  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 82df41f800684066955da1e5fcf37da0 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:22.009387  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82df41f800684066955da1e5fcf37da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.010203  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82df41f800684066955da1e5fcf37da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.011070  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bacb2b5d0c24f8685d90eeadc14dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.011190  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 15aeeeb202e74ebd91872b6a150c5ddc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:22.000613  1595 tablet_service.cc:1511] Processing CreateTablet for tablet e2ca98d137184e478468c21f485fafa4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:22.015297  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 967a91b43b06439992ab8ede24bc873d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.016592  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bacb2b5d0c24f8685d90eeadc14dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.018337  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ca98d137184e478468c21f485fafa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.018736  1524 tablet_service.cc:1511] Processing CreateTablet for tablet c0c802947c11486798c253f6688083e7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:22.020004  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c802947c11486798c253f6688083e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.020952  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aeeeb202e74ebd91872b6a150c5ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.021574  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 4203acf1edca42708e1990f548ab96b3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:22.022869  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4203acf1edca42708e1990f548ab96b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.996500  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 4203acf1edca42708e1990f548ab96b3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:22.035132  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4203acf1edca42708e1990f548ab96b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.996074  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 15aeeeb202e74ebd91872b6a150c5ddc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:22.037407  1599 tablet_service.cc:1511] Processing CreateTablet for tablet c0c802947c11486798c253f6688083e7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:22.037952  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aeeeb202e74ebd91872b6a150c5ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.972016  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:22.039112  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bacb2b5d0c24f8685d90eeadc14dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.039529  1523 tablet_service.cc:1511] Processing CreateTablet for tablet e2ca98d137184e478468c21f485fafa4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:22.041239  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ca98d137184e478468c21f485fafa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.029546  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 82df41f800684066955da1e5fcf37da0 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:22.031708  1668 tablet_service.cc:1511] Processing CreateTablet for tablet ec0ffdd8e20a4befaef11295a994679c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:22.051314  1515 tablet_service.cc:1511] Processing CreateTablet for tablet ec0ffdd8e20a4befaef11295a994679c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:22.052146  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 55c2050eecb74fbbae8aea2d609c6833 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:22.063870  1672 tablet_service.cc:1511] Processing CreateTablet for tablet c0c802947c11486798c253f6688083e7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:22.061439  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c2050eecb74fbbae8aea2d609c6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.077544  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0ffdd8e20a4befaef11295a994679c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.076197  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0ffdd8e20a4befaef11295a994679c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.086225  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82df41f800684066955da1e5fcf37da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.101024  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c802947c11486798c253f6688083e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.109166  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c802947c11486798c253f6688083e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.110745  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 55c2050eecb74fbbae8aea2d609c6833 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:22.111958  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c2050eecb74fbbae8aea2d609c6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.113305  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 055cfab17a334683a9350a659118ac99 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:22.123509  1665 tablet_service.cc:1511] Processing CreateTablet for tablet d36fd60901f543758f2f446ee106cf32 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:22.125180  1597 tablet_service.cc:1511] Processing CreateTablet for tablet ec0ffdd8e20a4befaef11295a994679c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:22.126662  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0ffdd8e20a4befaef11295a994679c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.127787  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 55c2050eecb74fbbae8aea2d609c6833 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:22.128170  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fd60901f543758f2f446ee106cf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.155145  1724 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:22.155663  1724 ts_tablet_manager.cc:1403] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.236s	user 0.015s	sys 0.010s
I20260709 12:59:22.148097  1559 heartbeater.cc:499] Master 127.0.107.254:41741 was elected leader, sending a full tablet report...
I20260709 12:59:22.156131  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 055cfab17a334683a9350a659118ac99 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:22.157546  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055cfab17a334683a9350a659118ac99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.165750  1723 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:22.166409  1723 ts_tablet_manager.cc:1403] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.376s	user 0.017s	sys 0.014s
I20260709 12:59:22.166626  1724 raft_consensus.cc:359] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.167466  1724 raft_consensus.cc:385] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:22.167809  1724 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.168725  1724 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.171161  1670 tablet_service.cc:1511] Processing CreateTablet for tablet a20d1cf89bf84cc0b80b0dceda3cad18 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:22.192412  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c2050eecb74fbbae8aea2d609c6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.192430  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055cfab17a334683a9350a659118ac99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.196481  1725 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:22.197016  1725 ts_tablet_manager.cc:1403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.291s	user 0.028s	sys 0.012s
I20260709 12:59:22.198324  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 01534d11942740ccb67a981fcde65180 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:22.205360  1725 raft_consensus.cc:359] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.206102  1725 raft_consensus.cc:385] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:22.206399  1725 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.207130  1725 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.215703  1595 tablet_service.cc:1511] Processing CreateTablet for tablet a20d1cf89bf84cc0b80b0dceda3cad18 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:22.218469  1522 tablet_service.cc:1511] Processing CreateTablet for tablet a20d1cf89bf84cc0b80b0dceda3cad18 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:22.223387  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d1cf89bf84cc0b80b0dceda3cad18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.238329  1593 tablet_service.cc:1511] Processing CreateTablet for tablet d36fd60901f543758f2f446ee106cf32 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:22.243676  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01534d11942740ccb67a981fcde65180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.243808  1634 heartbeater.cc:499] Master 127.0.107.254:41741 was elected leader, sending a full tablet report...
I20260709 12:59:22.245657  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d1cf89bf84cc0b80b0dceda3cad18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.224783  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:22.247633  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.246408  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29577369ec4664a5f1ed7e27dd3265 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:22.249073  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29577369ec4664a5f1ed7e27dd3265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.251309  1598 tablet_service.cc:1511] Processing CreateTablet for tablet fd52876d8a2049db9c781a36366069cc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:22.252636  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd52876d8a2049db9c781a36366069cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.253902  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:22.261438  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 055cfab17a334683a9350a659118ac99 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:22.257436  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:22.258515  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d1cf89bf84cc0b80b0dceda3cad18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.262795  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.259018  1724 ts_tablet_manager.cc:1434] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.103s	user 0.017s	sys 0.000s
I20260709 12:59:22.263427  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.263289  1520 tablet_service.cc:1511] Processing CreateTablet for tablet d36fd60901f543758f2f446ee106cf32 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:22.264612  1724 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:22.274016  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 01534d11942740ccb67a981fcde65180 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:22.275522  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01534d11942740ccb67a981fcde65180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.276870  1723 raft_consensus.cc:359] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.277702  1723 raft_consensus.cc:385] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:22.278010  1723 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.279186  1724 tablet_bootstrap.cc:654] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:22.278834  1723 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.280714  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fd60901f543758f2f446ee106cf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.283128  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fd60901f543758f2f446ee106cf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.290635  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29577369ec4664a5f1ed7e27dd3265 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:22.267845  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29577369ec4664a5f1ed7e27dd3265 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:22.297549  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29577369ec4664a5f1ed7e27dd3265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.297667  1723 ts_tablet_manager.cc:1434] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.131s	user 0.012s	sys 0.012s
I20260709 12:59:22.298540  1708 heartbeater.cc:499] Master 127.0.107.254:41741 was elected leader, sending a full tablet report...
I20260709 12:59:22.304533  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 986af52b7e6d4c60a353dbc998405797 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:22.307476  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055cfab17a334683a9350a659118ac99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.321653  1520 tablet_service.cc:1511] Processing CreateTablet for tablet fd52876d8a2049db9c781a36366069cc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:22.322952  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd52876d8a2049db9c781a36366069cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.324738  1723 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:22.239410  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 01534d11942740ccb67a981fcde65180 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:22.330986  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01534d11942740ccb67a981fcde65180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.331243  1723 tablet_bootstrap.cc:654] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:22.339504  1518 tablet_service.cc:1511] Processing CreateTablet for tablet e796444a6ddd47bd9129de2ab82200a6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:22.340610  1664 tablet_service.cc:1511] Processing CreateTablet for tablet fd52876d8a2049db9c781a36366069cc (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:22.342123  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd52876d8a2049db9c781a36366069cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.345331  1725 ts_tablet_manager.cc:1434] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.148s	user 0.046s	sys 0.017s
I20260709 12:59:22.346468  1725 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:22.356264  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 986af52b7e6d4c60a353dbc998405797 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:22.357617  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986af52b7e6d4c60a353dbc998405797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.369913  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 986af52b7e6d4c60a353dbc998405797 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:22.373895  1672 tablet_service.cc:1511] Processing CreateTablet for tablet e796444a6ddd47bd9129de2ab82200a6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:22.376140  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e796444a6ddd47bd9129de2ab82200a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.380525  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29577369ec4664a5f1ed7e27dd3265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.384815  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e796444a6ddd47bd9129de2ab82200a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.388736  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986af52b7e6d4c60a353dbc998405797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.394646  1598 tablet_service.cc:1511] Processing CreateTablet for tablet e796444a6ddd47bd9129de2ab82200a6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:22.395927  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e796444a6ddd47bd9129de2ab82200a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.380642  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986af52b7e6d4c60a353dbc998405797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.402170  1725 tablet_bootstrap.cc:654] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:22.412518  1731 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.413089  1731 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.416929  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 12bf9f3ae6ad4d89af59a7b75960caa6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:22.418522  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bf9f3ae6ad4d89af59a7b75960caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.439815  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 12bf9f3ae6ad4d89af59a7b75960caa6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:22.441434  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bf9f3ae6ad4d89af59a7b75960caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.445973  1724 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:22.446555  1724 ts_tablet_manager.cc:1403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.011s
I20260709 12:59:22.456683  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 12bf9f3ae6ad4d89af59a7b75960caa6 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:22.461194  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bf9f3ae6ad4d89af59a7b75960caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.469022  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 460ae43de4d04023a24854ca2a19da88 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:22.470429  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460ae43de4d04023a24854ca2a19da88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.474741  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 460ae43de4d04023a24854ca2a19da88 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:22.479373  1666 tablet_service.cc:1511] Processing CreateTablet for tablet abe16ef1967f47ba893ba6ba999c125c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:22.486656  1591 tablet_service.cc:1511] Processing CreateTablet for tablet abe16ef1967f47ba893ba6ba999c125c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:22.456808  1731 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:22.488770  1520 tablet_service.cc:1511] Processing CreateTablet for tablet abe16ef1967f47ba893ba6ba999c125c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:22.492015  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 5b26794ff1394cec94107fd122031015 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:22.497978  1668 tablet_service.cc:1511] Processing CreateTablet for tablet fa9afdc16bf6430d9b895aefc4432c77 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:22.501098  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 5b26794ff1394cec94107fd122031015 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:22.500284  1521 tablet_service.cc:1511] Processing CreateTablet for tablet fa9afdc16bf6430d9b895aefc4432c77 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:22.506386  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 460ae43de4d04023a24854ca2a19da88 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:22.515580  1724 raft_consensus.cc:359] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.520871  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 5b26794ff1394cec94107fd122031015 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:22.519735  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 6a63db4a447849f8a1a34a53cd5ccefa (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:22.525964  1724 raft_consensus.cc:385] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:22.540868  1729 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.541410  1729 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.542834  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b26794ff1394cec94107fd122031015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.535298  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b26794ff1394cec94107fd122031015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.521596  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 368dba0d8eac439897c0b05b32e05500 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:22.544139  1729 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:22.563755  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9afdc16bf6430d9b895aefc4432c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.537462  1724 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.553951  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460ae43de4d04023a24854ca2a19da88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.533897  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 6a63db4a447849f8a1a34a53cd5ccefa (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:22.577983  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 6a63db4a447849f8a1a34a53cd5ccefa (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:22.579604  1723 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:22.580139  1723 ts_tablet_manager.cc:1403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.256s	user 0.038s	sys 0.042s
I20260709 12:59:22.581655  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe16ef1967f47ba893ba6ba999c125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.581560  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 368dba0d8eac439897c0b05b32e05500 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:22.582397  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460ae43de4d04023a24854ca2a19da88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.582957  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368dba0d8eac439897c0b05b32e05500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.591480  1518 tablet_service.cc:1511] Processing CreateTablet for tablet e0746dbce2334050a0a5359c93c14f2c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:22.594344  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76a019fbba44c8bb56f66d12c271c5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:22.589120  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9afdc16bf6430d9b895aefc4432c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.610638  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe16ef1967f47ba893ba6ba999c125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.611095  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b26794ff1394cec94107fd122031015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.610769  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a63db4a447849f8a1a34a53cd5ccefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.624049  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a63db4a447849f8a1a34a53cd5ccefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.610574  1595 tablet_service.cc:1511] Processing CreateTablet for tablet fa9afdc16bf6430d9b895aefc4432c77 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:22.637137  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 368dba0d8eac439897c0b05b32e05500 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:22.638916  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76a019fbba44c8bb56f66d12c271c5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:22.655201  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76a019fbba44c8bb56f66d12c271c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.611697  1724 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.578047  1599 tablet_service.cc:1511] Processing CreateTablet for tablet e0746dbce2334050a0a5359c93c14f2c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:22.644992  1516 tablet_service.cc:1511] Processing CreateTablet for tablet df548e1d094249d5ac1f6ffa2f7d9885 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:22.671449  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0746dbce2334050a0a5359c93c14f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.673599  1723 raft_consensus.cc:359] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.690613  1723 raft_consensus.cc:385] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:22.690995  1723 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.691807  1723 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.692611  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df548e1d094249d5ac1f6ffa2f7d9885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.666805  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368dba0d8eac439897c0b05b32e05500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.679829  1729 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.672127  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76a019fbba44c8bb56f66d12c271c5 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:22.665297  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9afdc16bf6430d9b895aefc4432c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.694043  1723 ts_tablet_manager.cc:1434] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 12:59:22.698670  1729 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.707643  1730 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.724133  1730 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.725173  1666 tablet_service.cc:1511] Processing CreateTablet for tablet df548e1d094249d5ac1f6ffa2f7d9885 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:22.726403  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76a019fbba44c8bb56f66d12c271c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.726998  1730 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:22.727399  1729 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:22.735728  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 75b33947f35745f4809f8a533ebbdaf8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:22.737231  1517 tablet_service.cc:1511] Processing CreateTablet for tablet b401d5a3c6a44966a0c0a7453f379808 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:22.737706  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b33947f35745f4809f8a533ebbdaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.727900  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe16ef1967f47ba893ba6ba999c125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.740914  1723 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:22.741415  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df548e1d094249d5ac1f6ffa2f7d9885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.746579  1668 tablet_service.cc:1511] Processing CreateTablet for tablet e185a2b036a741ffba1ca49f0dd4cce8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:22.752383  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e185a2b036a741ffba1ca49f0dd4cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.752959  1672 tablet_service.cc:1511] Processing CreateTablet for tablet e0746dbce2334050a0a5359c93c14f2c (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:22.732841  1515 tablet_service.cc:1511] Processing CreateTablet for tablet e185a2b036a741ffba1ca49f0dd4cce8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:22.735167  1598 tablet_service.cc:1511] Processing CreateTablet for tablet df548e1d094249d5ac1f6ffa2f7d9885 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:22.765673  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 75b33947f35745f4809f8a533ebbdaf8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:22.767140  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b33947f35745f4809f8a533ebbdaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.771493  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0746dbce2334050a0a5359c93c14f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.773694  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 8b12ac06d9474e6a97e219688d43cf30 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:22.776290  1673 tablet_service.cc:1511] Processing CreateTablet for tablet b401d5a3c6a44966a0c0a7453f379808 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:22.792219  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b401d5a3c6a44966a0c0a7453f379808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.778469  1725 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:22.786343  1723 tablet_bootstrap.cc:654] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:22.777169  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b401d5a3c6a44966a0c0a7453f379808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.793169  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:22.794731  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:22.802304  1522 tablet_service.cc:1511] Processing CreateTablet for tablet a1cc245b7bc74c4689e1a1db6fa21301 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:22.801695  1731 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.803418  1731 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:22.805446  1731 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:22.809989  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368dba0d8eac439897c0b05b32e05500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.812652  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df548e1d094249d5ac1f6ffa2f7d9885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.813392  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:22.815196  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:22.794430  1724 ts_tablet_manager.cc:1434] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.348s	user 0.013s	sys 0.000s
W20260709 12:59:22.816567  1648 leader_election.cc:343] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.817209  1724 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
W20260709 12:59:22.817764  1648 leader_election.cc:343] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.817902  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a63db4a447849f8a1a34a53cd5ccefa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:22.819209  1499 leader_election.cc:343] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:22.819900  1499 leader_election.cc:343] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.822118  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cc245b7bc74c4689e1a1db6fa21301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.853984  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:22.855765  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b12ac06d9474e6a97e219688d43cf30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:22.855748  1500 leader_election.cc:343] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.856292  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:22.857071  1607 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:22.858768  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:22.860421  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:22.862190  1649 leader_election.cc:343] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.862675  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:22.863884  1731 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:22.864413  1731 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.864678  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e185a2b036a741ffba1ca49f0dd4cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.864961  1731 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:22.865963  1669 tablet_service.cc:1511] Processing CreateTablet for tablet f28aac236b62437d9a0603913d696ce7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:22.869719  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 87db66ba9ff145009d8e513e5d0ef1e4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:22.847819  1671 tablet_service.cc:1511] Processing CreateTablet for tablet a1cc245b7bc74c4689e1a1db6fa21301 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:22.873764  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 75b33947f35745f4809f8a533ebbdaf8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:22.856353  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:22.784181  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 8b12ac06d9474e6a97e219688d43cf30 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:22.836488  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76a019fbba44c8bb56f66d12c271c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.886366  1724 tablet_bootstrap.cc:654] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:22.892866  1725 ts_tablet_manager.cc:1403] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.547s	user 0.014s	sys 0.028s
I20260709 12:59:22.898793  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b33947f35745f4809f8a533ebbdaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.848784  1519 tablet_service.cc:1511] Processing CreateTablet for tablet c57c0601cf944c57a1314b6605861f28 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:22.850456  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0746dbce2334050a0a5359c93c14f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.852644  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:22.906685  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87db66ba9ff145009d8e513e5d0ef1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.864153  1591 tablet_service.cc:1511] Processing CreateTablet for tablet e185a2b036a741ffba1ca49f0dd4cce8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:22.824754  1521 tablet_service.cc:1511] Processing CreateTablet for tablet f28aac236b62437d9a0603913d696ce7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:22.881089  1665 tablet_service.cc:1511] Processing CreateTablet for tablet c57c0601cf944c57a1314b6605861f28 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:22.884965  1729 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:22.914016  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28aac236b62437d9a0603913d696ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.920969  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e185a2b036a741ffba1ca49f0dd4cce8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:22.926621  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:59:22.928543  1500 leader_election.cc:343] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:22.929072  1500 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:22.929956  1729 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:22.931831  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28aac236b62437d9a0603913d696ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.916180  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 87db66ba9ff145009d8e513e5d0ef1e4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:22.947759  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cc245b7bc74c4689e1a1db6fa21301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.950738  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 2832a231368f4f5dbf9972f28f64f60e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:22.952111  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2832a231368f4f5dbf9972f28f64f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.953019  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87db66ba9ff145009d8e513e5d0ef1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.964646  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57c0601cf944c57a1314b6605861f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.940224  1593 tablet_service.cc:1511] Processing CreateTablet for tablet b401d5a3c6a44966a0c0a7453f379808 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:22.972630  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b12ac06d9474e6a97e219688d43cf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.977233  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 8b12ac06d9474e6a97e219688d43cf30 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:22.978866  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b401d5a3c6a44966a0c0a7453f379808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.959147  1594 tablet_service.cc:1511] Processing CreateTablet for tablet a1cc245b7bc74c4689e1a1db6fa21301 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:22.983940  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 2832a231368f4f5dbf9972f28f64f60e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:23.004428  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 2cddab79a6054062949d1d1c2453cc06 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:23.007952  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cc245b7bc74c4689e1a1db6fa21301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.014842  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b12ac06d9474e6a97e219688d43cf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.991405  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57c0601cf944c57a1314b6605861f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.024739  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61a4d068974252b4a051adf9e9b27b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:23.009224  1725 raft_consensus.cc:359] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.028752  1745 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.028761  1725 raft_consensus.cc:385] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.032708  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cddab79a6054062949d1d1c2453cc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.032879  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61a4d068974252b4a051adf9e9b27b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:23.034636  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61a4d068974252b4a051adf9e9b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.035456  1723 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.036007  1723 ts_tablet_manager.cc:1403] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.295s	user 0.008s	sys 0.012s
I20260709 12:59:23.036031  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61a4d068974252b4a051adf9e9b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.039414  1723 raft_consensus.cc:359] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:22.991052  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 128904us
I20260709 12:59:23.040259  1723 raft_consensus.cc:385] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.040663  1723 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:22.987547  1599 tablet_service.cc:1511] Processing CreateTablet for tablet f28aac236b62437d9a0603913d696ce7 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:23.032825  1725 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.044495  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 87db66ba9ff145009d8e513e5d0ef1e4 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:23.045538  1592 tablet_service.cc:1511] Processing CreateTablet for tablet c57c0601cf944c57a1314b6605861f28 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:23.048143  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 2832a231368f4f5dbf9972f28f64f60e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:23.049862  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2832a231368f4f5dbf9972f28f64f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.050809  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 53808273f23f45848ad55ddef1799643 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:23.052083  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53808273f23f45848ad55ddef1799643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.057358  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.058094  1725 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.059051  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.085503  1725 ts_tablet_manager.cc:1434] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.185s	user 0.007s	sys 0.000s
W20260709 12:59:23.084213  1574 leader_election.cc:343] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.072669  1723 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.075021  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 2cddab79a6054062949d1d1c2453cc06 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:23.075832  1522 tablet_service.cc:1511] Processing CreateTablet for tablet d1b71784dcc643e8bb9bd12d0b0db655 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:23.106279  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b71784dcc643e8bb9bd12d0b0db655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.080770  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2832a231368f4f5dbf9972f28f64f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.092566  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 14da2914452f44cca76332a550a28b6b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:23.109333  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14da2914452f44cca76332a550a28b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.111537  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 14da2914452f44cca76332a550a28b6b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:23.115949  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac98493907d499f8fa4ad8002393318 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:23.117476  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57c0601cf944c57a1314b6605861f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.108523  1731 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.118165  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28aac236b62437d9a0603913d696ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.118451  1682 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:23.119053  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87db66ba9ff145009d8e513e5d0ef1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.122134  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.098841  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac98493907d499f8fa4ad8002393318 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:23.123636  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac98493907d499f8fa4ad8002393318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.103346  1725 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.123732  1730 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.133213  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.105083  1723 ts_tablet_manager.cc:1434] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
W20260709 12:59:23.134758  1648 leader_election.cc:343] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.137120  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.137800  1731 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.140578  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 2cddab79a6054062949d1d1c2453cc06 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:23.141791  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cddab79a6054062949d1d1c2453cc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.142473  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14da2914452f44cca76332a550a28b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.096031  1670 tablet_service.cc:1511] Processing CreateTablet for tablet d1b71784dcc643e8bb9bd12d0b0db655 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:23.122052  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 53808273f23f45848ad55ddef1799643 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:23.145551  1724 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.146101  1724 ts_tablet_manager.cc:1403] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.329s	user 0.026s	sys 0.029s
I20260709 12:59:23.149322  1724 raft_consensus.cc:359] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.150213  1724 raft_consensus.cc:385] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.150590  1724 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.151624  1724 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.153599  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac98493907d499f8fa4ad8002393318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.156605  1723 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.157357  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b71784dcc643e8bb9bd12d0b0db655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.158473  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61a4d068974252b4a051adf9e9b27b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:23.159981  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61a4d068974252b4a051adf9e9b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.162209  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53808273f23f45848ad55ddef1799643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.141425  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 794b13e101914a9dbf12fa727a3e9e27 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:23.164512  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794b13e101914a9dbf12fa727a3e9e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.162315  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cddab79a6054062949d1d1c2453cc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.146296  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 14da2914452f44cca76332a550a28b6b (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:23.162158  1724 ts_tablet_manager.cc:1434] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:59:23.190668  1724 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.196429  1725 tablet_bootstrap.cc:654] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.176966  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14da2914452f44cca76332a550a28b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.206429  1520 tablet_service.cc:1511] Processing CreateTablet for tablet d76204c6ec324b26bec0c1908a45574a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:23.207890  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76204c6ec324b26bec0c1908a45574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.211763  1730 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.216588  1724 tablet_bootstrap.cc:654] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.221606  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 794b13e101914a9dbf12fa727a3e9e27 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:23.235395  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794b13e101914a9dbf12fa727a3e9e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.231312  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 53808273f23f45848ad55ddef1799643 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:23.241840  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53808273f23f45848ad55ddef1799643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.248253  1673 tablet_service.cc:1511] Processing CreateTablet for tablet d76204c6ec324b26bec0c1908a45574a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:23.259871  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 6791fab1eefc49d1a3e2783c89cac6a8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:23.260859  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76204c6ec324b26bec0c1908a45574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.266007  1723 tablet_bootstrap.cc:654] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.272621  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6791fab1eefc49d1a3e2783c89cac6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.277541  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 794b13e101914a9dbf12fa727a3e9e27 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:23.278970  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794b13e101914a9dbf12fa727a3e9e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.278560  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 6791fab1eefc49d1a3e2783c89cac6a8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:23.279906  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6791fab1eefc49d1a3e2783c89cac6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.283485  1665 tablet_service.cc:1511] Processing CreateTablet for tablet c2dc6f62776f4719aaae2fc36e4d078e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:23.285039  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dc6f62776f4719aaae2fc36e4d078e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.285539  1524 tablet_service.cc:1511] Processing CreateTablet for tablet c2dc6f62776f4719aaae2fc36e4d078e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:23.275163  1593 tablet_service.cc:1511] Processing CreateTablet for tablet d1b71784dcc643e8bb9bd12d0b0db655 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:23.295287  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dc6f62776f4719aaae2fc36e4d078e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.288004  1596 tablet_service.cc:1511] Processing CreateTablet for tablet d76204c6ec324b26bec0c1908a45574a (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:23.304972  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b71784dcc643e8bb9bd12d0b0db655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.306759  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 6791fab1eefc49d1a3e2783c89cac6a8 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:23.308117  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6791fab1eefc49d1a3e2783c89cac6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.335438  1591 tablet_service.cc:1511] Processing CreateTablet for tablet c2dc6f62776f4719aaae2fc36e4d078e (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:23.336862  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dc6f62776f4719aaae2fc36e4d078e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.353163  1731 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.353677  1731 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.355686  1731 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.294570  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac98493907d499f8fa4ad8002393318 (DEFAULT_TABLE table=test-workload [id=3db9e625d24344f697ace3b984e6ad1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:23.357509  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac98493907d499f8fa4ad8002393318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.358310  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.359439  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76204c6ec324b26bec0c1908a45574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.362282  1725 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.357307  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.363157  1608 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:23.363440  1725 ts_tablet_manager.cc:1403] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.008s
W20260709 12:59:23.364001  1648 leader_election.cc:343] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.366634  1725 raft_consensus.cc:359] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.367388  1725 raft_consensus.cc:385] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.367672  1725 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.366677  1723 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.369377  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.370036  1725 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.370536  1731 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.371235  1731 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.371716  1731 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.372735  1725 ts_tablet_manager.cc:1434] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:59:23.375501  1725 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.381270  1724 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.381757  1725 tablet_bootstrap.cc:654] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.381899  1724 ts_tablet_manager.cc:1403] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.014s
I20260709 12:59:23.385790  1724 raft_consensus.cc:359] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.386758  1724 raft_consensus.cc:385] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.387094  1724 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.369222  1723 ts_tablet_manager.cc:1403] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.213s	user 0.033s	sys 0.024s
I20260709 12:59:23.388932  1724 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.391040  1725 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.391377  1724 ts_tablet_manager.cc:1434] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:59:23.391610  1725 ts_tablet_manager.cc:1403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:59:23.391772  1723 raft_consensus.cc:359] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.392573  1724 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.392558  1723 raft_consensus.cc:385] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.393126  1723 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.394624  1725 raft_consensus.cc:359] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.394901  1723 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.395648  1725 raft_consensus.cc:385] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.395995  1725 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.397302  1725 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.399535  1725 ts_tablet_manager.cc:1434] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:23.400998  1723 ts_tablet_manager.cc:1434] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:59:23.401757  1725 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.402058  1723 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.402164  1729 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.402868  1729 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.409907  1725 tablet_bootstrap.cc:654] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.410120  1723 tablet_bootstrap.cc:654] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.411036  1724 tablet_bootstrap.cc:654] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.419703  1723 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.420209  1723 ts_tablet_manager.cc:1403] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 12:59:23.421648  1731 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.423653  1731 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.425290  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.426276  1609 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 12:59:23.427003  1500 leader_election.cc:343] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.428354  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.436683  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.437337  1608 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.437232  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 12:59:23.441025  1648 leader_election.cc:343] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.445421  1729 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.447580  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.448663  1731 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.449433  1731 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:23.450328  1731 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.440236  1723 raft_consensus.cc:359] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.456918  1723 raft_consensus.cc:385] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.457261  1723 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.458240  1723 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.459192  1682 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:23.461454  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:23.461803  1723 ts_tablet_manager.cc:1434] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.006s
I20260709 12:59:23.462553  1729 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.462745  1723 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.462895  1729 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.463213  1729 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.471079  1723 tablet_bootstrap.cc:654] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.477303  1724 tablet_bootstrap.cc:492] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.477844  1724 ts_tablet_manager.cc:1403] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.064s
I20260709 12:59:23.478387  1725 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.478988  1725 ts_tablet_manager.cc:1403] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.077s	user 0.034s	sys 0.028s
I20260709 12:59:23.482179  1724 raft_consensus.cc:359] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.483001  1724 raft_consensus.cc:385] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.483309  1724 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.483525  1723 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.484056  1723 ts_tablet_manager.cc:1403] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.010s
I20260709 12:59:23.484206  1724 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.484937  1725 raft_consensus.cc:359] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.485746  1725 raft_consensus.cc:385] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.486124  1725 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.487633  1725 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.487850  1723 raft_consensus.cc:359] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.488739  1723 raft_consensus.cc:385] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.490768  1725 ts_tablet_manager.cc:1434] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:59:23.493628  1730 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.494908  1730 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.495394  1725 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.494728  1430 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.489071  1723 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.497817  1730 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.497740  1723 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.494158  1724 ts_tablet_manager.cc:1434] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:59:23.502907  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.503795  1725 tablet_bootstrap.cc:654] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.500131  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:23.505425  1574 leader_election.cc:343] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.506579  1534 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:23.507784  1724 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.507936  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:23.509323  1730 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.509675  1730 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.509999  1730 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.514031  1723 ts_tablet_manager.cc:1434] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:59:23.515803  1724 tablet_bootstrap.cc:654] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.515939  1723 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.519842  1731 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.520567  1731 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.523910  1731 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.525179  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.525894  1534 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:23.524680  1729 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.528386  1608 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:23.529752  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.531246  1723 tablet_bootstrap.cc:654] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.536613  1757 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.536996  1729 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.537242  1757 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.539333  1724 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.539499  1757 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.540025  1724 ts_tablet_manager.cc:1403] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.010s
I20260709 12:59:23.541285  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 12:59:23.542726  1649 leader_election.cc:343] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.543447  1731 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.543993  1731 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:23.544390  1724 raft_consensus.cc:359] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.545310  1724 raft_consensus.cc:385] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.544935  1731 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.545688  1724 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.546401  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:23.546562  1724 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.547931  1745 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.548375  1745 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.548751  1745 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.549551  1724 ts_tablet_manager.cc:1434] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:59:23.550218  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:23.550940  1682 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.544795  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.553488  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.553573  1608 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:23.552767  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.555550  1724 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
W20260709 12:59:23.555848  1499 leader_election.cc:343] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:23.557230  1500 leader_election.cc:343] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.563652  1724 tablet_bootstrap.cc:654] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.567214  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:23.568611  1729 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.569038  1729 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.569392  1729 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.574105  1723 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.574800  1723 ts_tablet_manager.cc:1403] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.007s
I20260709 12:59:23.576913  1724 tablet_bootstrap.cc:492] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.577335  1724 ts_tablet_manager.cc:1403] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:59:23.578218  1723 raft_consensus.cc:359] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.579134  1723 raft_consensus.cc:385] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.579478  1723 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.581037  1724 raft_consensus.cc:359] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.582021  1724 raft_consensus.cc:385] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.581292  1725 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.582417  1724 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.582754  1725 ts_tablet_manager.cc:1403] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.088s	user 0.044s	sys 0.018s
I20260709 12:59:23.586148  1724 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.587114  1725 raft_consensus.cc:359] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.587893  1725 raft_consensus.cc:385] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.588192  1725 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.588542  1724 ts_tablet_manager.cc:1434] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:59:23.589002  1725 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.589660  1724 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.593101  1725 ts_tablet_manager.cc:1434] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:59:23.581082  1723 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.595299  1725 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.596660  1724 tablet_bootstrap.cc:654] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.596704  1723 ts_tablet_manager.cc:1434] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:59:23.603185  1723 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.603266  1725 tablet_bootstrap.cc:654] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.604843  1724 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.605362  1724 ts_tablet_manager.cc:1403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:59:23.608232  1724 raft_consensus.cc:359] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.608902  1724 raft_consensus.cc:385] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.609202  1724 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.609805  1724 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.611368  1723 tablet_bootstrap.cc:654] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.611508  1724 ts_tablet_manager.cc:1434] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:23.611655  1725 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.612179  1725 ts_tablet_manager.cc:1403] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:59:23.612684  1724 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.615965  1725 raft_consensus.cc:359] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.616878  1725 raft_consensus.cc:385] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.617198  1725 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.618022  1725 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.619060  1724 tablet_bootstrap.cc:654] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.621165  1725 ts_tablet_manager.cc:1434] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:59:23.622599  1725 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.623562  1729 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.624728  1745 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.625993  1729 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.628247  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 12:59:23.631677  1499 leader_election.cc:343] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.632980  1745 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.634565  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.635322  1534 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.640695  1725 tablet_bootstrap.cc:654] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.641429  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.632189  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.643136  1608 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:23.649181  1649 leader_election.cc:343] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.623615  1730 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.651669  1730 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.654094  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.654397  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:23.654946  1533 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:23.656136  1574 leader_election.cc:343] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.660948  1725 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.661559  1725 ts_tablet_manager.cc:1403] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.018s
I20260709 12:59:23.664651  1725 raft_consensus.cc:359] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.665473  1725 raft_consensus.cc:385] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.665763  1725 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.670267  1725 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.672446  1725 ts_tablet_manager.cc:1434] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:59:23.673403  1725 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.680508  1725 tablet_bootstrap.cc:654] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.684538  1730 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.685175  1730 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.688917  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.690182  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.690958  1683 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:23.689746  1532 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:23.693044  1725 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.693614  1725 ts_tablet_manager.cc:1403] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:59:23.693771  1730 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.696831  1725 raft_consensus.cc:359] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.697619  1725 raft_consensus.cc:385] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.697973  1725 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.692883  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:23.699977  1730 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.700476  1730 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.700865  1730 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.700488  1725 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.703200  1723 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.703222  1725 ts_tablet_manager.cc:1434] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:23.703706  1723 ts_tablet_manager.cc:1403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.101s	user 0.042s	sys 0.048s
I20260709 12:59:23.704044  1724 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.704407  1725 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:23.704665  1724 ts_tablet_manager.cc:1403] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.092s	user 0.036s	sys 0.046s
I20260709 12:59:23.706393  1723 raft_consensus.cc:359] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.707305  1723 raft_consensus.cc:385] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.707813  1723 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.707285  1724 raft_consensus.cc:359] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.708572  1724 raft_consensus.cc:385] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.709088  1724 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.708882  1723 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.710697  1745 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.710508  1724 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.711293  1745 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.712517  1725 tablet_bootstrap.cc:654] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.713397  1745 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.714265  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.716032  1724 ts_tablet_manager.cc:1434] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:59:23.716240  1723 ts_tablet_manager.cc:1434] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:59:23.716514  1648 leader_election.cc:343] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.717308  1723 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.717312  1724 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.717788  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.719200  1768 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.719261  1649 leader_election.cc:343] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.719883  1649 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.721024  1745 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.719882  1768 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.724540  1723 tablet_bootstrap.cc:654] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.725302  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.726038  1532 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:23.727934  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:23.729607  1682 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:23.729665  1533 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:23.731287  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:23.732192  1729 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.732702  1729 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:23.733486  1729 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.736631  1534 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:23.729251  1608 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:23.737634  1432 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.729483  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.739974  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:23.741154  1745 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.741639  1745 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:23.744762  1745 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.728945  1768 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.748735  1768 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.749127  1768 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.749505  1768 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.754305  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:23.755136  1757 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.763499  1777 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.763998  1777 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.766379  1777 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.766835  1777 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.767217  1777 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.770156  1725 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
W20260709 12:59:23.763051  1574 leader_election.cc:343] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.770772  1725 ts_tablet_manager.cc:1403] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.020s
I20260709 12:59:23.771891  1724 tablet_bootstrap.cc:654] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.773253  1432 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.774103  1725 raft_consensus.cc:359] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.775561  1725 raft_consensus.cc:385] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.774371  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:23.774986  1745 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.775856  1725 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.777997  1745 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.780769  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.777547  1725 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.775195  1777 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.784530  1725 ts_tablet_manager.cc:1434] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:59:23.785590  1725 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
W20260709 12:59:23.786095  1648 leader_election.cc:343] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.786923  1776 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.789180  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.789525  1776 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:23.789876  1608 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:23.789394  1429 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.785107  1757 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:23.797438  1725 tablet_bootstrap.cc:654] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.793138  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.829777  1765 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:23.830155  1765 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.830457  1765 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.823626  1723 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.790539  1745 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.831254  1723 ts_tablet_manager.cc:1403] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.014s
I20260709 12:59:23.830452  1730 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.842572  1757 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.843681  1730 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.830602  1768 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.827721  1729 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.847721  1768 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:23.844370  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72601.1us
I20260709 12:59:23.850063  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:23.851469  1574 leader_election.cc:343] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.852020  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.852561  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.853070  1532 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:23.853433  1574 leader_election.cc:343] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.853405  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.847671  1729 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.859476  1724 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.862185  1724 ts_tablet_manager.cc:1403] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.009s
I20260709 12:59:23.822091  1776 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.863093  1532 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:23.858285  1723 raft_consensus.cc:359] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.864570  1724 raft_consensus.cc:359] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.865119  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:23.869235  1723 raft_consensus.cc:385] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.855069  1533 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.866509  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.867609  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.870658  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:23.863924  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:23.871978  1608 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 12:59:23.872083  1574 leader_election.cc:343] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.872364  1765 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.872628  1574 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.873481  1768 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.873854  1683 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:23.869374  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:23.874804  1681 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.875528  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:23.875258  1429 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.876408  1729 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:23.876959  1648 leader_election.cc:343] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.869225  1724 raft_consensus.cc:385] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.880460  1724 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.881263  1724 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.882421  1765 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:23.883492  1724 ts_tablet_manager.cc:1434] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:59:23.884433  1724 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.875895  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.870019  1782 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.884833  1432 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.885778  1782 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:23.886098  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:23.885562  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:23.886828  1608 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.887704  1729 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.887567  1782 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.894248  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.896658  1725 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.897166  1725 ts_tablet_manager.cc:1403] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.016s
I20260709 12:59:23.898758  1681 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:23.900053  1724 tablet_bootstrap.cc:654] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.900630  1729 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.901288  1608 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:23.904150  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:23.904523  1768 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.905052  1782 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.905848  1782 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:23.906795  1782 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.907961  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.914227  1765 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:23.915165  1765 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:23.916281  1765 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.901991  1533 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:23.901616  1725 raft_consensus.cc:359] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.902679  1723 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.921649  1725 raft_consensus.cc:385] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.921975  1725 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.922017  1723 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.922676  1725 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.922194  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.925271  1725 ts_tablet_manager.cc:1434] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:59:23.925457  1680 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.926169  1725 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
W20260709 12:59:23.929925  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:23.925304  1723 ts_tablet_manager.cc:1434] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.005s
I20260709 12:59:23.934484  1429 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.935546  1723 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.935902  1725 tablet_bootstrap.cc:654] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.935876  1765 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:23.945890  1680 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:23.948695  1723 tablet_bootstrap.cc:654] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.952570  1725 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:23.953060  1725 ts_tablet_manager.cc:1403] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 12:59:23.959764  1724 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:23.960196  1724 ts_tablet_manager.cc:1403] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.020s
I20260709 12:59:23.960405  1723 tablet_bootstrap.cc:492] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:23.960865  1723 ts_tablet_manager.cc:1403] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.002s
I20260709 12:59:23.961787  1782 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.962283  1782 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.963546  1723 raft_consensus.cc:359] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.964345  1723 raft_consensus.cc:385] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.964587  1723 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.964735  1782 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.965435  1723 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.966249  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:23.967828  1723 ts_tablet_manager.cc:1434] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:23.968744  1723 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:23.969492  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:23.970234  1680 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 12:59:23.970088  1429 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.971319  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:23.972841  1776 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.977399  1723 tablet_bootstrap.cc:654] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.979064  1724 raft_consensus.cc:359] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.979816  1724 raft_consensus.cc:385] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.980103  1724 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:23.980827  1724 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.983311  1776 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:23.985659  1725 raft_consensus.cc:359] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.986603  1725 raft_consensus.cc:385] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:23.988211  1724 ts_tablet_manager.cc:1434] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:59:23.989456  1724 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:23.992075  1729 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.992579  1729 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:23.995128  1729 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:23.995134  1724 tablet_bootstrap.cc:654] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:23.995790  1532 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:23.996117  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 12:59:23.997810  1499 leader_election.cc:343] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:23.999221  1776 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.999692  1776 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.001219  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.001524  1745 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.001993  1745 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.002947  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.003293  1776 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.003942  1745 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.004492  1765 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:24.005393  1574 leader_election.cc:343] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.006527  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.004449  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.007597  1608 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 12:59:24.009037  1574 leader_election.cc:343] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.009613  1574 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.010552  1776 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.011349  1723 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
W20260709 12:59:24.006491  1500 leader_election.cc:343] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.011929  1723 ts_tablet_manager.cc:1403] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.009s
I20260709 12:59:24.011934  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:24.012989  1757 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.014062  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.016393  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.017256  1723 raft_consensus.cc:359] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.017670  1745 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.017900  1723 raft_consensus.cc:385] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.019985  1723 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.020704  1723 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.022051  1725 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.022718  1725 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.024880  1725 ts_tablet_manager.cc:1434] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:59:24.025740  1725 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.025696  1723 ts_tablet_manager.cc:1434] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:24.035768  1800 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.037499  1724 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.037992  1724 ts_tablet_manager.cc:1403] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.015s
I20260709 12:59:24.040660  1724 raft_consensus.cc:359] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.041363  1724 raft_consensus.cc:385] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.041627  1724 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.045221  1724 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.045462  1800 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.047580  1724 ts_tablet_manager.cc:1434] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:59:24.048090  1800 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.048692  1724 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:24.053277  1729 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.055858  1723 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.058823  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.061731  1729 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.062842  1765 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.064919  1724 tablet_bootstrap.cc:654] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.074972  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.075806  1532 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:24.076022  1725 tablet_bootstrap.cc:654] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.076233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.068110  1745 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.093694  1723 tablet_bootstrap.cc:654] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.095949  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.097857  1499 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:24.094358  1729 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.098780  1757 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.099310  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.099116  1745 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:24.101137  1745 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.126955  1725 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:24.127115  1729 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.127637  1725 ts_tablet_manager.cc:1403] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.009s
I20260709 12:59:24.127566  1745 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.130796  1724 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.131283  1724 ts_tablet_manager.cc:1403] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.012s
I20260709 12:59:24.130800  1725 raft_consensus.cc:359] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.131899  1725 raft_consensus.cc:385] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.132252  1725 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.133319  1725 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.134548  1724 raft_consensus.cc:359] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.135303  1724 raft_consensus.cc:385] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.135567  1724 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.136894  1725 ts_tablet_manager.cc:1434] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:59:24.137964  1725 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.139396  1723 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.139858  1723 ts_tablet_manager.cc:1403] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.010s
I20260709 12:59:24.142683  1723 raft_consensus.cc:359] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.143538  1723 raft_consensus.cc:385] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.143340  1724 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.143921  1723 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.144878  1723 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.146186  1724 ts_tablet_manager.cc:1434] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:59:24.146931  1723 ts_tablet_manager.cc:1434] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:59:24.147497  1724 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:24.155000  1723 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.155256  1725 tablet_bootstrap.cc:654] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.155215  1724 tablet_bootstrap.cc:654] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.169119  1781 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:24.175024  1725 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:24.175516  1723 tablet_bootstrap.cc:654] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.175632  1725 ts_tablet_manager.cc:1403] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.005s
I20260709 12:59:24.182781  1725 raft_consensus.cc:359] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.184051  1725 raft_consensus.cc:385] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.184394  1725 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.185245  1725 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.189453  1725 ts_tablet_manager.cc:1434] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.006s
I20260709 12:59:24.190521  1725 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.194599  1776 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.195312  1776 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.197474  1776 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.197712  1725 tablet_bootstrap.cc:654] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.199702  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.199573  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.203299  1534 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:24.204670  1574 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.206976  1776 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.211563  1724 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.212077  1724 ts_tablet_manager.cc:1403] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.019s
I20260709 12:59:24.216805  1776 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.216583  1724 raft_consensus.cc:359] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.217936  1724 raft_consensus.cc:385] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.218245  1724 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.218902  1724 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.220919  1724 ts_tablet_manager.cc:1434] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:24.221680  1724 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:24.225006  1723 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.225500  1723 ts_tablet_manager.cc:1403] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.006s
I20260709 12:59:24.230014  1723 raft_consensus.cc:359] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.230679  1723 raft_consensus.cc:385] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.230964  1723 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.231544  1723 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.232615  1781 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.233419  1723 ts_tablet_manager.cc:1434] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:59:24.234266  1724 tablet_bootstrap.cc:654] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.235414  1723 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.242461  1723 tablet_bootstrap.cc:654] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.246332  1725 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:24.246919  1725 ts_tablet_manager.cc:1403] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.003s
I20260709 12:59:24.250098  1725 raft_consensus.cc:359] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.250898  1725 raft_consensus.cc:385] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.251199  1725 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.252084  1725 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.254792  1725 ts_tablet_manager.cc:1434] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:24.256834  1724 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.257355  1724 ts_tablet_manager.cc:1403] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.017s
I20260709 12:59:24.257650  1723 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.257808  1725 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.258111  1723 ts_tablet_manager.cc:1403] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 12:59:24.260929  1723 raft_consensus.cc:359] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.261615  1723 raft_consensus.cc:385] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.261946  1723 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.260694  1724 raft_consensus.cc:359] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.263195  1724 raft_consensus.cc:385] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.262960  1723 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.264936  1723 ts_tablet_manager.cc:1434] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:24.264940  1725 tablet_bootstrap.cc:654] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.265969  1723 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.263531  1724 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.269992  1724 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.272234  1724 ts_tablet_manager.cc:1434] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:59:24.272367  1723 tablet_bootstrap.cc:654] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.273264  1724 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:24.276062  1729 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.279902  1724 tablet_bootstrap.cc:654] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.282786  1745 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.285584  1723 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.286338  1723 ts_tablet_manager.cc:1403] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:59:24.287532  1782 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:24.289526  1723 raft_consensus.cc:359] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.290386  1723 raft_consensus.cc:385] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.290678  1723 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.292069  1723 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.294540  1723 ts_tablet_manager.cc:1434] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:24.295563  1723 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.296579  1729 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.297079  1729 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.300032  1729 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.300742  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.301436  1680 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:24.301637  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.302469  1723 tablet_bootstrap.cc:654] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.303112  1499 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 12:59:24.303959  1500 leader_election.cc:343] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.305148  1729 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.306141  1729 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.307881  1729 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.309307  1776 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.309921  1776 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.312340  1776 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.314409  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.314687  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.315052  1723 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.315166  1680 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:24.315673  1723 ts_tablet_manager.cc:1403] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
W20260709 12:59:24.316252  1574 leader_election.cc:343] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.317075  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.318470  1782 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.318866  1782 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.319207  1782 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.338901  1757 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.390914  1745 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.391112  1757 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.391469  1745 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.392452  1781 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.392970  1725 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:24.392927  1781 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.394418  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.395136  1781 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.396123  1745 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.395099  1531 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.397460  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.397719  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.398375  1608 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:24.398139  1729 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.398566  1745 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.398976  1745 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.399422  1745 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.401573  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.401693  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:24.402248  1609 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:24.400897  1757 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.393482  1725 ts_tablet_manager.cc:1403] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.136s	user 0.037s	sys 0.044s
W20260709 12:59:24.403699  1500 leader_election.cc:343] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.403949  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.400125  1729 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.410212  1723 raft_consensus.cc:359] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.410754  1723 raft_consensus.cc:385] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.410970  1723 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.411469  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:24.412137  1683 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.412611  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.414810  1499 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:24.417816  1723 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.351854  1768 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
I20260709 12:59:24.429613  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.430438  1609 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.432371  1723 ts_tablet_manager.cc:1434] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.001s
I20260709 12:59:24.434545  1723 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.435774  1799 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:24.395272  1782 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.438160  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.428570  1757 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.428881  1729 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.468276  1801 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.465188  1729 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.507561  1725 raft_consensus.cc:359] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.510703  1725 raft_consensus.cc:385] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.510946  1725 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.511473  1725 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.468969  1801 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.510288  1729 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.547858  1725 ts_tablet_manager.cc:1434] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.000s
W20260709 12:59:24.560750  1499 leader_election.cc:343] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.541085  1768 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:59:24.550715  1800 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:59:24.565982  1724 tablet_bootstrap.cc:492] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.566452  1724 ts_tablet_manager.cc:1403] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.293s	user 0.032s	sys 0.058s
W20260709 12:59:24.568274  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 99955.4us
I20260709 12:59:24.561318  1826 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.569128  1826 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.571399  1723 tablet_bootstrap.cc:654] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.570318  1724 raft_consensus.cc:359] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.571682  1826 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.572008  1724 raft_consensus.cc:385] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.572376  1724 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.574056  1724 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.580493  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:24.581840  1724 ts_tablet_manager.cc:1434] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:24.573729  1801 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.582722  1801 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.564262  1782 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.582800  1724 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:24.583220  1801 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.578956  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:24.566944  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54169.7us
I20260709 12:59:24.596558  1729 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.596295  1531 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.599324  1801 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.610476  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.611305  1725 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.610569  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.611393  1533 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.613384  1683 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:24.614569  1499 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:24.616652  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.617537  1801 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.572026  1745 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.615890  1781 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:24.623955  1745 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.670171  1723 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.622017  1801 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.632543  1781 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:24.671960  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:24.670758  1723 ts_tablet_manager.cc:1403] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.236s	user 0.036s	sys 0.029s
I20260709 12:59:24.626576  1729 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.672375  1781 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.655483  1757 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.671581  1801 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.678440  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.679267  1831 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.682245  1831 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.685246  1745 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.679780  1729 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.686316  1724 tablet_bootstrap.cc:654] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.685714  1745 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.689801  1725 tablet_bootstrap.cc:654] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:24.691004  1499 leader_election.cc:343] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.692526  1831 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.695050  1729 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.700546  1729 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.696082  1745 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.704234  1801 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.710155  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:24.711131  1609 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.718675  1609 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
W20260709 12:59:24.708941  1574 leader_election.cc:343] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.719875  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.806599  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.721328  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:24.746119  1781 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.780736  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.742152  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:24.809090  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.817027  1530 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.809266  1680 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:24.774417  1745 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.806341  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:24.746305  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:24.807399  1801 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.815119  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.815587  1723 raft_consensus.cc:359] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.819593  1723 raft_consensus.cc:385] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.819888  1723 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
W20260709 12:59:24.816498  1499 leader_election.cc:343] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.807435  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.820438  1723 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.819242  1681 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.818468  1534 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.824005  1723 ts_tablet_manager.cc:1434] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.001s
I20260709 12:59:24.822088  1729 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:24.824715  1729 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:24.825326  1723 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.825628  1729 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.828619  1605 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.831295  1534 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 12:59:24.809631  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 101906us
I20260709 12:59:24.743207  1831 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 12:59:24.818892  1781 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.840520  1781 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.841511  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:24.842896  1745 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.741722  1430 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.841893  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.850176  1833 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.842708  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.848805  1681 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
W20260709 12:59:24.834740  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88526.9us
I20260709 12:59:24.852293  1723 tablet_bootstrap.cc:654] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:24.849995  1605 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.853536  1768 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.850476  1827 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:24.845880  1801 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.850696  1833 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.853088  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:24.853889  1782 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:24.855666  1801 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.861927  1680 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:24.862284  1801 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.866056  1499 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.866580  1725 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:24.866699  1724 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:24.866993  1725 ts_tablet_manager.cc:1403] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.256s	user 0.014s	sys 0.009s
I20260709 12:59:24.867144  1724 ts_tablet_manager.cc:1403] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.285s	user 0.024s	sys 0.013s
I20260709 12:59:24.866884  1781 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.852403  1609 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.885293  1724 raft_consensus.cc:359] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.886240  1724 raft_consensus.cc:385] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:24.886797  1648 leader_election.cc:343] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.887135  1724 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.853977  1768 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.888025  1724 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.863921  1606 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.892217  1724 ts_tablet_manager.cc:1434] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
I20260709 12:59:24.894130  1724 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
W20260709 12:59:24.893121  1649 leader_election.cc:343] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.870190  1781 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.898324  1781 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.902915  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.905122  1530 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:24.905346  1829 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:24.905829  1829 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:24.908545  1768 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.900108  1801 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.910130  1649 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.910573  1605 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:24.911859  1723 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:24.912398  1723 ts_tablet_manager.cc:1403] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.016s
I20260709 12:59:24.913395  1725 raft_consensus.cc:359] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.913913  1725 raft_consensus.cc:385] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.914110  1725 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.916157  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.916162  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.917680  1723 raft_consensus.cc:359] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.917968  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:24.918407  1723 raft_consensus.cc:385] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:24.918757  1723 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:24.919431  1723 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.921746  1723 ts_tablet_manager.cc:1434] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:24.922698  1723 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:24.912040  1801 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.930589  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:24.929893  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:24.933534  1782 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:24.933698  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:24.923046  1831 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:24.936566  1831 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.936951  1831 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.937258  1782 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:24.906490  1829 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.929407  1801 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.940994  1782 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:24.945278  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:24.946257  1530 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:24.949105  1782 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.949738  1781 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.955462  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.956172  1781 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:24.956387  1531 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 12:59:24.957258  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:24.957729  1680 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:24.940995  1649 leader_election.cc:343] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.970428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:24.970919  1574 leader_election.cc:343] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:24.971362  1609 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:24.972832  1831 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.976881  1831 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:24.978668  1725 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.981472  1725 ts_tablet_manager.cc:1434] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.003s
I20260709 12:59:24.982514  1725 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:24.983104  1680 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:24.984519  1499 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:24.985288  1781 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:24.985863  1781 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:24.989498  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:24.989274  1781 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:24.991827  1724 tablet_bootstrap.cc:654] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:24.992673  1649 leader_election.cc:343] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.010720  1833 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:24.995100  1500 leader_election.cc:343] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.011674  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:25.012494  1729 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:24.994546  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 12:59:25.014200  1500 leader_election.cc:343] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.015515  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:25.015791  1831 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:25.021286  1725 tablet_bootstrap.cc:654] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.017114  1801 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:25.024763  1831 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.036140  1831 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:25.037282  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:25.037542  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.038192  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:25.038842  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:25.039698  1574 leader_election.cc:343] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.040213  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.035494  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.044533  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:25.035686  1801 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 12:59:25.046065  1500 leader_election.cc:343] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.042904  1648 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.043530  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:25.048033  1648 leader_election.cc:343] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.038806  1604 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.043864  1782 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.029712  1530 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:25.057827  1745 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:25.066826  1648 leader_election.cc:343] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.067673  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:25.070938  1745 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:25.046396  1801 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.071421  1745 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:25.072425  1745 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.060571  1606 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:25.074854  1768 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:25.097422  1574 leader_election.cc:343] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.117219  1723 tablet_bootstrap.cc:654] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.123588  1831 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.124297  1757 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:25.128598  1829 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.129040  1829 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.131484  1829 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.132982  1680 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:25.135968  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.138216  1831 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 12:59:25.138721  1648 leader_election.cc:343] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.138939  1757 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.139518  1757 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.139757  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:25.139786  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:25.114434  1604 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:25.140728  1603 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:25.141924  1648 leader_election.cc:343] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.138361  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.145452  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.144065  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.148502  1649 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.149461  1801 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:59:25.149925  1649 leader_election.cc:343] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.150020  1801 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:25.151471  1801 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.152321  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.153113  1680 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:25.153738  1757 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.150470  1649 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.154222  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:25.155413  1829 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.155640  1757 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.168448  1603 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:25.168982  1768 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.170538  1607 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.181540  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.184231  1432 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.193123  1781 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.198952  1801 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:25.200196  1801 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:25.201053  1801 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.200652  1429 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.209952  1429 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.220798  1725 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.221287  1725 ts_tablet_manager.cc:1403] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.239s	user 0.023s	sys 0.028s
I20260709 12:59:25.223840  1725 raft_consensus.cc:359] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.225016  1725 raft_consensus.cc:385] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.225296  1725 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.228654  1725 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.234509  1724 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:25.235016  1724 ts_tablet_manager.cc:1403] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.341s	user 0.029s	sys 0.018s
I20260709 12:59:25.235442  1725 ts_tablet_manager.cc:1434] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:25.236477  1725 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:25.237907  1724 raft_consensus.cc:359] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.238611  1724 raft_consensus.cc:385] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.238878  1724 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.239948  1724 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.243274  1781 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.243752  1723 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.244338  1723 ts_tablet_manager.cc:1403] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.322s	user 0.020s	sys 0.038s
I20260709 12:59:25.243813  1757 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.248756  1723 raft_consensus.cc:359] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.249490  1723 raft_consensus.cc:385] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.249775  1723 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.242328  1724 ts_tablet_manager.cc:1434] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:25.250646  1725 tablet_bootstrap.cc:654] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.251658  1724 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:25.250620  1723 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.257869  1723 ts_tablet_manager.cc:1434] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:25.258742  1723 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.266813  1723 tablet_bootstrap.cc:654] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.267967  1724 tablet_bootstrap.cc:654] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.268211  1725 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.268675  1725 ts_tablet_manager.cc:1403] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.000s
I20260709 12:59:25.271212  1725 raft_consensus.cc:359] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.271907  1725 raft_consensus.cc:385] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.272166  1725 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.272929  1725 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.275892  1725 ts_tablet_manager.cc:1434] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:25.282017  1683 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.282327  1725 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:25.289423  1725 tablet_bootstrap.cc:654] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.299552  1430 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.307166  1801 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.307684  1801 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.311252  1781 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.313596  1725 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.314059  1725 ts_tablet_manager.cc:1403] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.000s
I20260709 12:59:25.316035  1801 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.317094  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.318761  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.320429  1723 tablet_bootstrap.cc:492] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.320919  1723 ts_tablet_manager.cc:1403] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.035s
I20260709 12:59:25.320600  1725 raft_consensus.cc:359] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.321403  1725 raft_consensus.cc:385] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.321486  1724 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:25.321718  1725 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.321966  1724 ts_tablet_manager.cc:1403] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.027s
I20260709 12:59:25.322247  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.322499  1725 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.324136  1723 raft_consensus.cc:359] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.323640  1430 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.324679  1725 ts_tablet_manager.cc:1434] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:59:25.324997  1723 raft_consensus.cc:385] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.324712  1724 raft_consensus.cc:359] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.325376  1723 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.325507  1724 raft_consensus.cc:385] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.325750  1725 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:25.325930  1724 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.325575  1430 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.326488  1723 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.326704  1724 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.329097  1723 ts_tablet_manager.cc:1434] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:59:25.329120  1724 ts_tablet_manager.cc:1434] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:25.330282  1723 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.330282  1724 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:25.333245  1725 tablet_bootstrap.cc:654] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.332774  1430 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.334414  1430 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.337430  1724 tablet_bootstrap.cc:654] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.344661  1827 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.354964  1723 tablet_bootstrap.cc:654] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.375936  1781 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.376814  1723 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.376585  1781 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.377384  1723 ts_tablet_manager.cc:1403] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.010s
I20260709 12:59:25.378839  1781 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.380110  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.379977  1723 raft_consensus.cc:359] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.380450  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.380991  1723 raft_consensus.cc:385] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.381325  1723 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
W20260709 12:59:25.381675  1499 leader_election.cc:343] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:25.382131  1500 leader_election.cc:343] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.382082  1723 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.383244  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:25.384006  1781 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.384240  1723 ts_tablet_manager.cc:1434] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:25.385121  1723 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.386909  1801 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:25.391072  1781 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:25.399570  1500 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.408831  1723 tablet_bootstrap.cc:654] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.409660  1724 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:25.410163  1724 ts_tablet_manager.cc:1403] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.017s
I20260709 12:59:25.413604  1724 raft_consensus.cc:359] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.414309  1724 raft_consensus.cc:385] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.414637  1724 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.414332  1725 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.415612  1725 ts_tablet_manager.cc:1403] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.002s
I20260709 12:59:25.418989  1725 raft_consensus.cc:359] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.420197  1725 raft_consensus.cc:385] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.420267  1782 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.420569  1725 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.415371  1724 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.421443  1725 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.426309  1723 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.426600  1725 ts_tablet_manager.cc:1434] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:59:25.426759  1723 ts_tablet_manager.cc:1403] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.005s
I20260709 12:59:25.427561  1725 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:25.429354  1723 raft_consensus.cc:359] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.430038  1723 raft_consensus.cc:385] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.430312  1723 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.429293  1724 ts_tablet_manager.cc:1434] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:59:25.430927  1723 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.431427  1724 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:25.432915  1723 ts_tablet_manager.cc:1434] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:25.433751  1723 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.438283  1725 tablet_bootstrap.cc:654] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.452528  1723 tablet_bootstrap.cc:654] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.453614  1724 tablet_bootstrap.cc:654] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.481884  1725 tablet_bootstrap.cc:492] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.482424  1725 ts_tablet_manager.cc:1403] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.004s
I20260709 12:59:25.485519  1801 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.485600  1725 raft_consensus.cc:359] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.486394  1725 raft_consensus.cc:385] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.486668  1725 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.488449  1724 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:25.488905  1724 ts_tablet_manager.cc:1403] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.003s
I20260709 12:59:25.488633  1725 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.491909  1725 ts_tablet_manager.cc:1434] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:59:25.492937  1725 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:25.493314  1724 raft_consensus.cc:359] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.494025  1724 raft_consensus.cc:385] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.494283  1724 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.494949  1724 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.497603  1723 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.498180  1723 ts_tablet_manager.cc:1403] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.029s
I20260709 12:59:25.500018  1725 tablet_bootstrap.cc:654] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.502907  1782 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.503469  1782 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.505144  1724 ts_tablet_manager.cc:1434] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:59:25.505355  1801 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.506044  1724 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:25.507118  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.507706  1534 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:25.508921  1768 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.509383  1768 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.501847  1723 raft_consensus.cc:359] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.510381  1723 raft_consensus.cc:385] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.510675  1723 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.511416  1723 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.513590  1723 ts_tablet_manager.cc:1434] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 12:59:25.514676  1723 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.521852  1831 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.522331  1831 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.524868  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:25.526922  1782 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.527812  1824 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:25.528327  1824 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.528697  1824 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.528053  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.531934  1534 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:25.532030  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.515514  1768 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.533774  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:25.529330  1831 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.534412  1829 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:25.540167  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:25.542167  1648 leader_election.cc:343] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.542371  1768 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:25.542773  1768 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.543105  1768 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.555480  1530 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:25.556250  1649 leader_election.cc:343] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.570075  1649 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.570953  1829 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.572608  1829 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.575037  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.575402  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.575644  1680 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:25.576773  1603 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:25.581717  1574 leader_election.cc:343] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.584422  1824 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.585038  1829 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:25.586192  1882 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:25.588032  1534 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.595585  1824 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.596726  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:25.599478  1533 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.632802  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 12:59:25.653425  1574 leader_election.cc:343] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.658613  1829 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.659160  1745 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.674165  1745 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.683878  1782 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.684469  1782 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.688547  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:25.714672  1724 tablet_bootstrap.cc:654] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.717168  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:25.718164  1824 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:25.718858  1782 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.718910  1824 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:25.719978  1824 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.720441  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.731438  1723 tablet_bootstrap.cc:654] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.740082  1887 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:25.589829  1768 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:25.751579  1574 leader_election.cc:343] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.756132  1725 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:25.756716  1725 ts_tablet_manager.cc:1403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.264s	user 0.028s	sys 0.050s
I20260709 12:59:25.758873  1801 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.760102  1725 raft_consensus.cc:359] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.759409  1801 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.766360  1768 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.767359  1725 raft_consensus.cc:385] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.767793  1725 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.767484  1801 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.767650  1834 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.770416  1834 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.772584  1834 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.774737  1725 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.775378  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.775638  1724 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:25.775875  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.776021  1603 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:25.776178  1724 ts_tablet_manager.cc:1403] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.270s	user 0.008s	sys 0.010s
I20260709 12:59:25.777071  1725 ts_tablet_manager.cc:1434] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:59:25.778007  1725 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
W20260709 12:59:25.779186  1499 leader_election.cc:343] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.782335  1724 raft_consensus.cc:359] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.783022  1724 raft_consensus.cc:385] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.783279  1724 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.783872  1724 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.788295  1430 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.802416  1824 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.803014  1824 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:25.776947  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 119619us
I20260709 12:59:25.811532  1724 ts_tablet_manager.cc:1434] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.004s
I20260709 12:59:25.808172  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:25.813568  1724 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:25.806942  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:25.811987  1824 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.818739  1729 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:25.824851  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.825896  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.826488  1681 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:25.820123  1729 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.834789  1729 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.836472  1725 tablet_bootstrap.cc:654] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.833278  1723 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:25.819432  1532 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.833755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:25.838210  1723 ts_tablet_manager.cc:1403] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.324s	user 0.004s	sys 0.009s
I20260709 12:59:25.840591  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:25.841239  1680 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:25.843017  1723 raft_consensus.cc:359] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.843899  1723 raft_consensus.cc:385] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:25.844220  1723 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:25.845232  1723 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.854369  1723 ts_tablet_manager.cc:1434] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:59:25.855543  1723 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:25.858117  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.867988  1887 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.870523  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:25.868976  1887 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:25.876622  1648 leader_election.cc:343] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.866379  1680 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:25.903332  1887 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.912415  1781 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.916731  1729 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.931236  1723 tablet_bootstrap.cc:654] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:25.932610  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:25.926831  1781 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.964802  1724 tablet_bootstrap.cc:654] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:25.965375  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 88786.1us
I20260709 12:59:25.966948  1532 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:25.967775  1831 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:25.968618  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62943.4us
W20260709 12:59:25.969553  1649 leader_election.cc:343] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.969915  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:25.970485  1831 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:25.970929  1729 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:25.975898  1574 leader_election.cc:343] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:25.975158  1781 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:25.984591  1888 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.985064  1888 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:25.986950  1888 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:25.980422  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:25.973881  1499 leader_election.cc:343] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.000994  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:26.003502  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.003763  1604 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.004124  1681 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:25.999061  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:25.999893  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:26.005626  1724 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.006120  1768 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.006088  1724 ts_tablet_manager.cc:1403] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.025s
I20260709 12:59:26.006727  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.008481  1782 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.008881  1782 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.006659  1768 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 12:59:26.009903  1574 leader_election.cc:343] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.010033  1768 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.010715  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.009220  1782 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.012262  1824 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.000113  1530 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:26.019716  1604 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:26.020537  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.024161  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:26.026347  1729 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.026703  1729 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.027009  1729 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.027478  1723 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.027894  1723 ts_tablet_manager.cc:1403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.011s
I20260709 12:59:26.037729  1729 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.039378  1723 raft_consensus.cc:359] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.040102  1723 raft_consensus.cc:385] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.040372  1723 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.041039  1723 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.052278  1723 ts_tablet_manager.cc:1434] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 12:59:26.063867  1724 raft_consensus.cc:359] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.064687  1724 raft_consensus.cc:385] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.064936  1724 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.065573  1724 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.069464  1782 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:26.043000  1500 leader_election.cc:343] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.073029  1723 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.072860  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.078608  1725 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.079162  1725 ts_tablet_manager.cc:1403] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.301s	user 0.028s	sys 0.027s
I20260709 12:59:26.073975  1428 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.080457  1834 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.086856  1724 ts_tablet_manager.cc:1434] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 12:59:26.091840  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.093680  1831 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.094128  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.094803  1681 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.096464  1824 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.096956  1824 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.099050  1824 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.100229  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:26.100664  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.101261  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:26.101955  1574 leader_election.cc:343] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:26.107926  1574 leader_election.cc:343] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.110316  1724 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.104480  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.105019  1729 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.106621  1782 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.116065  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.113381  1834 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:26.124743  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:26.125414  1834 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.117642  1683 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
W20260709 12:59:26.122745  1648 leader_election.cc:343] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:26.147681  1649 leader_election.cc:343] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.148857  1831 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.149701  1768 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.151966  1725 raft_consensus.cc:359] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.152630  1725 raft_consensus.cc:385] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.152881  1725 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.153668  1725 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.157985  1725 ts_tablet_manager.cc:1434] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.002s
W20260709 12:59:26.158826  1500 leader_election.cc:343] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.160064  1723 tablet_bootstrap.cc:654] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.161652  1725 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.162941  1681 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:26.148141  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.164036  1745 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.168653  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.169909  1724 tablet_bootstrap.cc:654] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.170424  1908 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.170799  1908 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.174393  1908 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.180888  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:26.182902  1781 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.183382  1781 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:26.184738  1781 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.187354  1768 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.190171  1723 tablet_bootstrap.cc:492] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.190644  1723 ts_tablet_manager.cc:1403] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.004s
I20260709 12:59:26.191425  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.192890  1834 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.192683  1681 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.211091  1725 tablet_bootstrap.cc:654] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.193372  1834 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.216727  1834 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.216439  1428 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.204083  1908 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.217933  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.224260  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.227522  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
W20260709 12:59:26.227699  1499 leader_election.cc:343] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.229533  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.230521  1681 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
W20260709 12:59:26.231527  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:26.232862  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.233497  1781 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.233897  1768 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.233963  1781 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.234584  1781 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.234673  1768 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:26.235538  1768 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.236102  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:26.237483  1574 leader_election.cc:343] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.238798  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.239398  1680 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.239359  1723 raft_consensus.cc:359] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.240531  1723 raft_consensus.cc:385] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.240839  1723 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.239801  1908 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.242383  1724 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.242866  1724 ts_tablet_manager.cc:1403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.010s
I20260709 12:59:26.244441  1723 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.246603  1723 ts_tablet_manager.cc:1434] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:59:26.246695  1724 raft_consensus.cc:359] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.247350  1724 raft_consensus.cc:385] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.247604  1724 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.248786  1723 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.248332  1724 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.251106  1724 ts_tablet_manager.cc:1434] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:26.252166  1724 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.262907  1725 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.263494  1725 ts_tablet_manager.cc:1403] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.004s
I20260709 12:59:26.266106  1781 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.268653  1781 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.269747  1725 raft_consensus.cc:359] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.270493  1725 raft_consensus.cc:385] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.270699  1725 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.271703  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:26.272334  1608 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.275818  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.274806  1725 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.280901  1725 ts_tablet_manager.cc:1434] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:59:26.281688  1725 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.283095  1680 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
W20260709 12:59:26.285262  1499 leader_election.cc:343] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.285784  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.287887  1908 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.288453  1908 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:26.289350  1908 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.297483  1724 tablet_bootstrap.cc:654] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.297698  1723 tablet_bootstrap.cc:654] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.303402  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:26.305696  1428 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.306638  1725 tablet_bootstrap.cc:654] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.316411  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.317799  1781 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.318555  1781 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:26.319746  1781 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.331102  1724 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.331573  1724 ts_tablet_manager.cc:1403] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.016s
I20260709 12:59:26.331863  1725 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.332264  1725 ts_tablet_manager.cc:1403] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 12:59:26.334609  1724 raft_consensus.cc:359] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.334558  1429 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.335283  1724 raft_consensus.cc:385] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.335597  1724 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.335670  1725 raft_consensus.cc:359] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.336367  1723 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.336391  1724 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.337024  1723 ts_tablet_manager.cc:1403] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.023s
I20260709 12:59:26.336333  1429 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.338871  1724 ts_tablet_manager.cc:1434] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:26.336288  1725 raft_consensus.cc:385] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.339488  1725 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.339746  1724 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.339779  1723 raft_consensus.cc:359] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.340651  1723 raft_consensus.cc:385] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.340968  1723 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.341609  1723 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.346845  1724 tablet_bootstrap.cc:654] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.349627  1723 ts_tablet_manager.cc:1434] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:26.350766  1723 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.351156  1428 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.340209  1725 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.356549  1723 tablet_bootstrap.cc:654] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.357667  1724 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.358099  1724 ts_tablet_manager.cc:1403] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:59:26.359791  1725 ts_tablet_manager.cc:1434] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.003s
I20260709 12:59:26.360468  1725 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.363668  1724 raft_consensus.cc:359] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.364372  1724 raft_consensus.cc:385] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.364614  1724 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.365296  1724 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.367570  1724 ts_tablet_manager.cc:1434] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:26.368405  1724 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.376291  1724 tablet_bootstrap.cc:654] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.382959  1725 tablet_bootstrap.cc:654] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.392454  1725 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.392905  1725 ts_tablet_manager.cc:1403] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 12:59:26.393599  1723 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.394062  1723 ts_tablet_manager.cc:1403] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.013s
I20260709 12:59:26.396920  1723 raft_consensus.cc:359] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.397552  1723 raft_consensus.cc:385] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.397815  1723 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.397867  1725 raft_consensus.cc:359] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.398554  1725 raft_consensus.cc:385] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.399348  1725 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.398554  1723 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.400259  1725 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.400954  1724 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.401644  1724 ts_tablet_manager.cc:1403] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.013s
I20260709 12:59:26.402292  1723 ts_tablet_manager.cc:1434] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:59:26.402748  1725 ts_tablet_manager.cc:1434] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:26.403961  1725 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.403901  1724 raft_consensus.cc:359] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.404873  1724 raft_consensus.cc:385] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.405236  1724 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.406212  1723 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.405876  1724 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.415055  1723 tablet_bootstrap.cc:654] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.415197  1725 tablet_bootstrap.cc:654] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.419728  1724 ts_tablet_manager.cc:1434] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:26.427479  1724 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.431855  1723 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.432466  1723 ts_tablet_manager.cc:1403] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.016s
I20260709 12:59:26.433579  1724 tablet_bootstrap.cc:654] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.436196  1723 raft_consensus.cc:359] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.437377  1723 raft_consensus.cc:385] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.437602  1723 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.438192  1723 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.439378  1725 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.439905  1725 ts_tablet_manager.cc:1403] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260709 12:59:26.439998  1723 ts_tablet_manager.cc:1434] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 12:59:26.441017  1831 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.441493  1831 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.442096  1723 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.444617  1725 raft_consensus.cc:359] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.445670  1725 raft_consensus.cc:385] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.446008  1725 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.446913  1725 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.451998  1723 tablet_bootstrap.cc:654] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.456162  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:26.457578  1648 leader_election.cc:343] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.457726  1831 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.462182  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:26.464226  1649 leader_election.cc:343] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.464692  1649 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.465435  1725 ts_tablet_manager.cc:1434] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 12:59:26.466148  1745 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.466485  1725 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.471503  1723 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.472102  1723 ts_tablet_manager.cc:1403] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 12:59:26.474676  1723 raft_consensus.cc:359] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.475329  1723 raft_consensus.cc:385] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.475587  1723 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.476588  1723 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.478467  1781 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.479272  1723 ts_tablet_manager.cc:1434] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:59:26.478936  1781 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.480192  1723 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.480422  1725 tablet_bootstrap.cc:654] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.481057  1781 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.482034  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.482641  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.483392  1680 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
W20260709 12:59:26.483870  1500 leader_election.cc:343] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.484622  1499 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:26.485538  1781 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.486192  1781 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.486609  1781 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.494824  1781 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.496780  1723 tablet_bootstrap.cc:654] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.500751  1834 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.501317  1834 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.501665  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 12:59:26.503759  1500 leader_election.cc:343] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.503496  1834 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.505370  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.505771  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.507483  1680 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:26.507596  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.508258  1681 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.515156  1724 tablet_bootstrap.cc:492] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.516813  1724 ts_tablet_manager.cc:1403] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.090s	user 0.036s	sys 0.048s
I20260709 12:59:26.517937  1723 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.518409  1723 ts_tablet_manager.cc:1403] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.012s
I20260709 12:59:26.518534  1681 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:26.520125  1781 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.519896  1724 raft_consensus.cc:359] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.520771  1724 raft_consensus.cc:385] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.521126  1724 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.520929  1723 raft_consensus.cc:359] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.521576  1723 raft_consensus.cc:385] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.521860  1723 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.521947  1724 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.522545  1723 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.524081  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.525300  1723 ts_tablet_manager.cc:1434] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:26.526054  1725 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.526214  1723 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.526505  1725 ts_tablet_manager.cc:1403] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.000s
I20260709 12:59:26.521339  1499 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:26.528996  1834 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.529256  1725 raft_consensus.cc:359] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.529889  1725 raft_consensus.cc:385] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.530134  1725 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.530943  1781 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.532828  1724 ts_tablet_manager.cc:1434] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:59:26.533787  1724 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.531908  1781 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:26.538836  1723 tablet_bootstrap.cc:654] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.539223  1781 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.540153  1724 tablet_bootstrap.cc:654] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.544917  1834 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.532884  1725 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.550325  1723 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.550987  1723 ts_tablet_manager.cc:1403] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:59:26.552901  1725 ts_tablet_manager.cc:1434] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:59:26.553763  1723 raft_consensus.cc:359] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.554430  1723 raft_consensus.cc:385] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.554703  1723 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.555325  1723 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.558701  1725 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.559326  1724 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.559751  1724 ts_tablet_manager.cc:1403] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:59:26.562677  1723 ts_tablet_manager.cc:1434] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:26.563820  1723 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:26.564894  1725 tablet_bootstrap.cc:654] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.567178  1724 raft_consensus.cc:359] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.568076  1724 raft_consensus.cc:385] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.568404  1724 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.571410  1724 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.573772  1724 ts_tablet_manager.cc:1434] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:59:26.575049  1724 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:26.583499  1834 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:26.584421  1908 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.587450  1908 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.589449  1908 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.584635  1910 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.591779  1910 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.595053  1910 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.597594  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.601116  1680 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:26.601039  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.602348  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:26.603152  1908 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.603521  1908 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:26.603667  1499 leader_election.cc:343] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.603889  1908 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.605679  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.606310  1531 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:26.601006  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.608111  1768 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:26.613364  1723 tablet_bootstrap.cc:654] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.619180  1831 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.619788  1831 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:26.621831  1500 leader_election.cc:343] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.624683  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.625115  1745 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.625636  1745 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.625732  1831 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.629371  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.630118  1608 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:26.625636  1609 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 12:59:26.622457  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.631786  1768 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.639734  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:26.627697  1745 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.643520  1430 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.649016  1729 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.650594  1680 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.655709  1782 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:26.651330  1908 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.645180  1768 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.655498  1745 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.672349  1607 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.673398  1608 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.683209  1745 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.689724  1768 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.690208  1745 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.701784  1729 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.702317  1729 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.704119  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.707856  1724 tablet_bootstrap.cc:654] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.696827  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.714195  1729 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.718004  1725 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.718634  1725 ts_tablet_manager.cc:1403] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.031s
I20260709 12:59:26.720453  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.721364  1681 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:26.721691  1725 raft_consensus.cc:359] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.722833  1725 raft_consensus.cc:385] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.723155  1725 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.723843  1725 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.721683  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.728435  1528 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:26.733513  1725 ts_tablet_manager.cc:1434] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:26.734426  1725 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.722244  1908 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.745021  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:26.745669  1681 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.745842  1768 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.747053  1782 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.749783  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.750028  1781 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.756578  1831 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.757419  1908 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.757200  1831 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.758076  1908 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.759603  1831 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.760516  1908 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.754601  1729 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:59:26.763993  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.765146  1723 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.765664  1723 ts_tablet_manager.cc:1403] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.014s
I20260709 12:59:26.765334  1888 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.771055  1745 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.771484  1888 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.772439  1682 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:26.772392  1723 raft_consensus.cc:359] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.773412  1723 raft_consensus.cc:385] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.773605  1888 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.774012  1723 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.774938  1723 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.777565  1723 ts_tablet_manager.cc:1434] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:59:26.773488  1745 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:26.778539  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.779260  1530 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:26.779503  1723 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
W20260709 12:59:26.779904  1649 leader_election.cc:343] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.788964  1725 tablet_bootstrap.cc:654] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.783277  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:26.795600  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:26.797200  1530 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.800421  1607 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.802449  1723 tablet_bootstrap.cc:654] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:26.805560  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.813083  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.813545  1528 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.817451  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.819825  1682 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.792402  1681 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
W20260709 12:59:26.829270  1649 leader_election.cc:343] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.841202  1831 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.850829  1530 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:26.852576  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.859566  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.862480  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:26.863128  1531 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:26.871622  1831 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.882827  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.893361  1725 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:26.893843  1725 ts_tablet_manager.cc:1403] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.006s
I20260709 12:59:26.876852  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:26.902627  1531 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:26.906279  1782 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.906867  1782 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.909157  1782 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.892426  1607 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:26.917192  1724 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:26.917658  1724 ts_tablet_manager.cc:1403] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.343s	user 0.024s	sys 0.013s
I20260709 12:59:26.921543  1910 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.923369  1782 raft_consensus.cc:2764] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:59:26.915606  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:26.925489  1725 raft_consensus.cc:359] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.926116  1834 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.926188  1725 raft_consensus.cc:385] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.926560  1781 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.926940  1725 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.927716  1725 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.930428  1725 ts_tablet_manager.cc:1434] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
W20260709 12:59:26.930887  1648 leader_election.cc:343] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.930145  1834 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.931391  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.932811  1725 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:26.886212  1831 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:26.934810  1648 leader_election.cc:343] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.935276  1648 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:26.935828  1723 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:26.935758  1834 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:26.937719  1723 ts_tablet_manager.cc:1403] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.010s
I20260709 12:59:26.936501  1888 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.936928  1745 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:26.938367  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:26.945508  1888 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.947006  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:26.947741  1607 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:26.938442  1831 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 12:59:26.939200  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62462.9us
I20260709 12:59:26.958853  1953 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.959378  1953 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.959879  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:26.959882  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:26.962945  1745 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:26.963346  1745 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.963734  1745 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:26.964794  1947 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:59:26.965250  1954 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:26.967724  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:26.920364  1724 raft_consensus.cc:359] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.970522  1723 raft_consensus.cc:359] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.971220  1723 raft_consensus.cc:385] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.971532  1723 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.971045  1724 raft_consensus.cc:385] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:26.972069  1724 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:26.971395  1888 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:26.974146  1723 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.974663  1888 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.973598  1724 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.964936  1768 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:59:26.970721  1954 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:26.984134  1954 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:26.986377  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:26.987156  1679 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:26.987457  1953 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:26.975973  1745 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:26.992962  1648 leader_election.cc:343] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:26.994343  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.002395  1745 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.003460  1725 tablet_bootstrap.cc:654] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.005678  1723 ts_tablet_manager.cc:1434] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.008s
I20260709 12:59:27.005828  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:27.006487  1608 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.006701  1723 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.011368  1530 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:27.016733  1574 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.031447  1953 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:27.041287  1724 ts_tablet_manager.cc:1434] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.123s	user 0.013s	sys 0.000s
I20260709 12:59:27.042304  1724 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.054562  1428 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.057641  1608 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:27.070185  1723 tablet_bootstrap.cc:654] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.080227  1725 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.080729  1725 ts_tablet_manager.cc:1403] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.009s
I20260709 12:59:27.080595  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:27.084252  1958 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.084626  1609 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.084792  1958 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:27.093521  1958 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.070842  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:27.101720  1428 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.109263  1782 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.109854  1782 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.113335  1782 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:27.108850  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44947.5us
I20260709 12:59:27.118575  1725 raft_consensus.cc:359] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.119297  1725 raft_consensus.cc:385] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.119585  1725 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.120177  1725 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.121814  1725 ts_tablet_manager.cc:1434] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 12:59:27.122859  1725 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.127493  1429 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.133886  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:27.135800  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.138846  1724 tablet_bootstrap.cc:654] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.140398  1723 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.140817  1723 ts_tablet_manager.cc:1403] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.003s
I20260709 12:59:27.142094  1954 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.148986  1782 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.155839  1725 tablet_bootstrap.cc:654] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:27.157776  1648 leader_election.cc:343] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.163393  1723 raft_consensus.cc:359] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.164120  1723 raft_consensus.cc:385] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.164443  1723 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.166908  1723 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.169478  1723 ts_tablet_manager.cc:1434] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:59:27.170888  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.171821  1723 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.173806  1782 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.174741  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:27.175352  1679 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.184494  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:27.185194  1534 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.185577  1679 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:27.186717  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:27.189355  1723 tablet_bootstrap.cc:654] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.191409  1782 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.193328  1782 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:27.194347  1782 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.195214  1725 tablet_bootstrap.cc:492] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.195786  1725 ts_tablet_manager.cc:1403] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.008s
I20260709 12:59:27.198941  1725 raft_consensus.cc:359] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.199717  1725 raft_consensus.cc:385] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.200037  1725 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.200910  1725 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.203299  1725 ts_tablet_manager.cc:1434] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:27.204375  1725 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.203291  1534 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:27.212218  1724 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.212769  1724 ts_tablet_manager.cc:1403] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.171s	user 0.017s	sys 0.005s
I20260709 12:59:27.213753  1910 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.218173  1724 raft_consensus.cc:359] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.218927  1724 raft_consensus.cc:385] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.218950  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.219287  1724 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.220573  1768 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.233110  1724 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.235287  1724 ts_tablet_manager.cc:1434] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:59:27.236744  1724 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.218350  1723 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.240708  1723 ts_tablet_manager.cc:1403] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.005s
I20260709 12:59:27.229518  1725 tablet_bootstrap.cc:654] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.244431  1723 raft_consensus.cc:359] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.245189  1723 raft_consensus.cc:385] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.245518  1723 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.246490  1723 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.248926  1723 ts_tablet_manager.cc:1434] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:59:27.249418  1724 tablet_bootstrap.cc:654] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.251806  1723 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.257810  1724 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.258153  1723 tablet_bootstrap.cc:654] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.258318  1724 ts_tablet_manager.cc:1403] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 12:59:27.261597  1724 raft_consensus.cc:359] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.262398  1724 raft_consensus.cc:385] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.262729  1724 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.263616  1725 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.263592  1724 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.264214  1725 ts_tablet_manager.cc:1403] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.000s
I20260709 12:59:27.265833  1724 ts_tablet_manager.cc:1434] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:27.266770  1724 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.266903  1725 raft_consensus.cc:359] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.267585  1725 raft_consensus.cc:385] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.267848  1725 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.306689  1953 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.308497  1953 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.268522  1725 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.318424  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.319746  1680 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:27.315423  1768 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.320636  1428 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.321539  1768 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.324105  1768 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.325886  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.329824  1679 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:27.315842  1953 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.327217  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:27.332926  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.333199  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.334607  1954 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.334518  1768 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.335351  1954 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.335381  1768 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.341060  1768 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.346489  1954 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.347044  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:27.363327  1952 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.364142  1952 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.364770  1952 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.372853  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 12:59:27.377948  1574 leader_election.cc:343] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:27.379668  1574 leader_election.cc:343] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:27.382153  1574 leader_election.cc:343] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.385859  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.386940  1724 tablet_bootstrap.cc:654] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:27.390740  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:27.393754  1768 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.395351  1958 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.395874  1958 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.396368  1768 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:27.397789  1574 leader_election.cc:343] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.398440  1958 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.398248  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.399721  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.400346  1954 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.400740  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:27.401538  1679 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.405172  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:27.394145  1952 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.408790  1723 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.409464  1952 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.409565  1723 ts_tablet_manager.cc:1403] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.030s
W20260709 12:59:27.412004  1649 leader_election.cc:343] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.415334  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.416961  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:27.417253  1725 ts_tablet_manager.cc:1434] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.153s	user 0.004s	sys 0.005s
I20260709 12:59:27.418865  1725 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.418952  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:27.419625  1680 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.419472  1723 raft_consensus.cc:359] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:27.420840  1574 leader_election.cc:343] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.411041  1679 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:27.422327  1745 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.420213  1723 raft_consensus.cc:385] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:27.422497  1648 leader_election.cc:343] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.429368  1723 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.429652  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.430593  1958 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.429662  1745 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.430258  1723 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:27.433027  1574 leader_election.cc:343] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.434589  1958 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:27.435881  1723 ts_tablet_manager.cc:1434] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:59:27.441903  1958 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.442451  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.442513  1958 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.444432  1952 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.445602  1952 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:27.454536  1952 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.454456  1680 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:27.455293  1723 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.449083  1745 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.456049  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.445245  1958 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.463240  1724 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.472301  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.472765  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.474117  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.474182  1948 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.476215  1948 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:27.477932  1958 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.479070  1724 ts_tablet_manager.cc:1403] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.210s	user 0.010s	sys 0.006s
I20260709 12:59:27.478628  1958 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.481492  1958 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 12:59:27.478168  1648 leader_election.cc:343] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.482576  1723 tablet_bootstrap.cc:654] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.477325  1948 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.486047  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.495502  1724 raft_consensus.cc:359] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.502889  1724 raft_consensus.cc:385] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.504380  1724 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
W20260709 12:59:27.502525  1648 leader_election.cc:343] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.507812  1724 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.509979  1724 ts_tablet_manager.cc:1434] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 12:59:27.511819  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.512676  1530 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:27.512787  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.513566  1607 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:27.519686  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:27.519937  1954 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:27.522238  1888 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.522794  1888 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.523180  1888 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:27.523456  1649 leader_election.cc:343] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.523977  1649 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.524801  1745 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:27.525884  1649 leader_election.cc:343] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.526312  1649 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.528419  1745 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.534247  1724 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.540443  1725 tablet_bootstrap.cc:654] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.555028  1429 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.557261  1723 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.557868  1723 ts_tablet_manager.cc:1403] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.018s
I20260709 12:59:27.557237  1888 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.565979  1888 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.574180  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:27.575047  1534 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.576723  1724 tablet_bootstrap.cc:654] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.588498  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:27.590329  1607 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.592486  1952 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.602442  1534 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:27.610733  1607 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:27.614831  1429 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.618340  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47949.7us
I20260709 12:59:27.628144  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:27.631757  1888 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.632375  1888 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:27.633422  1888 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.635418  1725 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.636112  1725 ts_tablet_manager.cc:1403] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.218s	user 0.016s	sys 0.009s
I20260709 12:59:27.639165  1725 raft_consensus.cc:359] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.640157  1725 raft_consensus.cc:385] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.645768  1724 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.646327  1724 ts_tablet_manager.cc:1403] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.112s	user 0.029s	sys 0.043s
I20260709 12:59:27.641659  1725 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.649638  1724 raft_consensus.cc:359] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.651213  1724 raft_consensus.cc:385] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.650962  1725 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.651603  1723 raft_consensus.cc:359] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.651539  1724 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.652194  1723 raft_consensus.cc:385] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.652540  1723 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.652616  1724 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.653162  1723 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.654110  1725 ts_tablet_manager.cc:1434] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:59:27.655311  1725 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.659183  1724 ts_tablet_manager.cc:1434] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:59:27.660393  1724 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.666932  1724 tablet_bootstrap.cc:654] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.667130  1725 tablet_bootstrap.cc:654] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:27.676573  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74606.1us
I20260709 12:59:27.684278  1725 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.684252  1834 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.685079  1725 ts_tablet_manager.cc:1403] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.012s
I20260709 12:59:27.684952  1834 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.687237  1834 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.687909  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.688722  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.688710  1607 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:27.690855  1500 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:27.693737  1834 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.696014  1952 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.699101  1723 ts_tablet_manager.cc:1434] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.141s	user 0.013s	sys 0.015s
I20260709 12:59:27.703114  1723 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.703243  1834 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.704841  1725 raft_consensus.cc:359] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.706492  1725 raft_consensus.cc:385] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.706920  1725 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.708145  1725 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.718946  1725 ts_tablet_manager.cc:1434] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:59:27.724957  1781 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.725538  1781 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.729741  1781 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.736902  1725 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.740600  1986 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:59:27.741396  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.740754  1989 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.737708  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.743284  1679 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:27.745190  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 12:59:27.746825  1500 leader_election.cc:343] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.747215  1910 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.747644  1910 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.747968  1910 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.780459  1724 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.780894  1724 ts_tablet_manager.cc:1403] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.121s	user 0.035s	sys 0.028s
I20260709 12:59:27.791538  1724 raft_consensus.cc:359] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.792361  1724 raft_consensus.cc:385] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.792631  1724 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.792749  1910 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.798103  1723 tablet_bootstrap.cc:654] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.799877  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:27.800477  1958 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.800479  1679 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.800820  1724 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.801195  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:27.799285  1910 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:27.803793  1500 leader_election.cc:343] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.805420  1768 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:27.808044  1724 ts_tablet_manager.cc:1434] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:59:27.809310  1724 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.820744  1428 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.831435  1910 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.831995  1910 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.834857  1910 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.836078  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:27.837626  1500 leader_election.cc:343] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.839174  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.839998  1683 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:27.843593  1499 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:27.844769  1910 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.845197  1910 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.845536  1910 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.858474  1679 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:27.861797  1910 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.862875  1723 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.863399  1723 ts_tablet_manager.cc:1403] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.014s
I20260709 12:59:27.865134  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:27.865334  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:27.865849  1680 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:27.866613  1500 leader_election.cc:343] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.868839  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:27.870091  1729 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.870554  1729 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:27.871713  1729 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.878402  1680 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:27.871310  1910 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.880288  1499 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:27.881270  1834 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:27.881793  1834 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:27.882992  1834 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.885991  1723 raft_consensus.cc:359] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.886562  1723 raft_consensus.cc:385] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.886811  1723 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.887382  1723 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.881816  1725 tablet_bootstrap.cc:654] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.889045  1724 tablet_bootstrap.cc:654] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.896956  1724 tablet_bootstrap.cc:492] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.897313  1724 ts_tablet_manager.cc:1403] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.001s
I20260709 12:59:27.899334  1723 ts_tablet_manager.cc:1434] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:59:27.899574  1724 raft_consensus.cc:359] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.900949  1723 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.908052  1723 tablet_bootstrap.cc:654] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.909425  1729 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.909909  1729 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.911553  1725 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.911991  1729 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.900236  1724 raft_consensus.cc:385] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.912554  1724 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.913110  1724 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.912005  1725 ts_tablet_manager.cc:1403] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.000s
I20260709 12:59:27.914149  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.916184  1725 raft_consensus.cc:359] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.916388  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:27.917212  1679 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:27.917920  1724 ts_tablet_manager.cc:1434] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:59:27.918768  1724 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.918663  1499 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:27.920329  1781 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.916676  1725 raft_consensus.cc:385] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.921613  1725 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.922453  1725 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.924085  1723 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.924558  1723 ts_tablet_manager.cc:1403] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 12:59:27.927462  1723 raft_consensus.cc:359] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.928067  1723 raft_consensus.cc:385] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.928076  1724 tablet_bootstrap.cc:654] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.928450  1723 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.929113  1723 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.924562  1725 ts_tablet_manager.cc:1434] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:59:27.932471  1725 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.935127  1952 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.935590  1952 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.937551  1952 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:27.938964  1723 ts_tablet_manager.cc:1434] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:59:27.939954  1723 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.940721  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 12:59:27.942279  1574 leader_election.cc:343] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.942999  1428 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.943985  1725 tablet_bootstrap.cc:654] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.944350  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.944597  1428 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.945688  1574 leader_election.cc:343] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.946084  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.947634  1953 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.948657  1723 tablet_bootstrap.cc:654] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.957727  1725 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.958065  1723 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.958314  1725 ts_tablet_manager.cc:1403] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 12:59:27.958474  1723 ts_tablet_manager.cc:1403] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:59:27.961164  1725 raft_consensus.cc:359] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.961889  1725 raft_consensus.cc:385] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.962226  1725 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.962657  1528 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:27.962873  1725 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.965301  1725 ts_tablet_manager.cc:1434] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:27.967059  1725 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:27.964802  1723 raft_consensus.cc:359] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.967633  1781 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.967918  1723 raft_consensus.cc:385] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.968345  1723 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.969197  1723 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.971236  1723 ts_tablet_manager.cc:1434] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:59:27.972543  1723 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:27.978255  1724 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:27.979082  1724 ts_tablet_manager.cc:1403] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.001s
I20260709 12:59:27.979837  1725 tablet_bootstrap.cc:654] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.981549  1723 tablet_bootstrap.cc:654] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:27.982069  1724 raft_consensus.cc:359] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.982890  1724 raft_consensus.cc:385] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:27.983219  1724 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:27.984005  1724 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.984449  1958 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.984952  1958 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.986613  1724 ts_tablet_manager.cc:1434] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:27.987648  1724 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:27.988972  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:27.989470  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:27.990222  1648 leader_election.cc:343] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:27.990772  1649 leader_election.cc:343] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:27.991145  1649 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:27.991539  1725 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:27.992143  1989 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:27.993353  1989 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.993762  1989 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:27.995762  1989 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:27.997169  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:27.997785  1608 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:27.998167  1725 ts_tablet_manager.cc:1403] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 12:59:27.998713  1723 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:27.999178  1723 ts_tablet_manager.cc:1403] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 12:59:27.999477  1649 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:28.000801  1725 raft_consensus.cc:359] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.001113  1888 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:27.987515  1958 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.001484  1725 raft_consensus.cc:385] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.001787  1725 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.002156  1723 raft_consensus.cc:359] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.002385  1725 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.002990  1723 raft_consensus.cc:385] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.003396  1723 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.004292  1888 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.004069  1723 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.004678  1888 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.005384  1725 ts_tablet_manager.cc:1434] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:28.006302  1723 ts_tablet_manager.cc:1434] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:59:28.006354  1725 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:28.007413  1723 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:28.011175  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.013216  1725 tablet_bootstrap.cc:654] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.013824  1723 tablet_bootstrap.cc:654] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.014070  1724 tablet_bootstrap.cc:654] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:28.014225  1648 leader_election.cc:343] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.016292  1958 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.016834  1958 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.017441  1834 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.017970  1834 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.019464  1958 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.021193  1952 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.021678  1953 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.022184  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.022835  1679 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:28.023607  1723 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:28.024124  1723 ts_tablet_manager.cc:1403] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:59:28.024250  1499 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:28.025327  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.025384  1910 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.026031  1910 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.026113  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:28.026455  1910 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.026480  1724 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:28.027092  1724 ts_tablet_manager.cc:1403] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
I20260709 12:59:28.028513  1723 raft_consensus.cc:359] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.029309  1723 raft_consensus.cc:385] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.029637  1723 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.029927  1724 raft_consensus.cc:359] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.030609  1724 raft_consensus.cc:385] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.030910  1724 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.030436  1723 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.031622  1724 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.032423  1834 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.033577  1723 ts_tablet_manager.cc:1434] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:59:28.034734  1723 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:28.040877  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:28.041255  1723 tablet_bootstrap.cc:654] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.045506  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.045626  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.046200  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:28.046705  1910 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.050007  1724 ts_tablet_manager.cc:1434] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:59:28.048977  1888 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.057700  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 12:59:28.057940  1648 leader_election.cc:343] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.058292  1679 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.059018  1725 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:28.059504  1725 ts_tablet_manager.cc:1403] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 12:59:28.054494  1958 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.053797  1910 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.062402  1958 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.071053  1724 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:28.062989  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:28.061581  1768 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:28.064230  1952 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:59:28.071839  1958 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.073096  1953 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.075058  1953 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.076421  1608 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.077154  1953 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.078203  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.079627  1725 raft_consensus.cc:359] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.080438  1725 raft_consensus.cc:385] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.080706  1725 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.081535  1725 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.083923  1725 ts_tablet_manager.cc:1434] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 12:59:28.085491  1725 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:28.088279  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.104593  1682 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 12:59:28.104591  1723 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:28.105481  1723 ts_tablet_manager.cc:1403] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.012s
I20260709 12:59:28.113093  1952 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.113201  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.113714  1952 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.114094  1953 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.111799  1723 raft_consensus.cc:359] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.116927  1723 raft_consensus.cc:385] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.117251  1723 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.118999  1723 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.122224  1723 ts_tablet_manager.cc:1434] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:59:28.123823  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.122233  1952 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.125320  1745 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.125444  1574 leader_election.cc:343] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.125839  1745 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.127748  1745 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.129035  1745 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.129583  1745 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.131065  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.131428  1745 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.147766  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.148528  1681 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:28.143093  1888 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.144722  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.156535  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:28.157786  1528 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.189679  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.194134  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:28.194324  1648 leader_election.cc:343] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.197628  1948 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.198242  1948 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.211592  1724 tablet_bootstrap.cc:654] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:28.215246  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 82643.9us
W20260709 12:59:28.217000  1648 leader_election.cc:343] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:28.223459  1649 leader_election.cc:343] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.224954  1953 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:28.233929  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:28.225008  1781 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.241745  1781 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.243486  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:28.245146  1834 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.245692  1834 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:28.246095  1725 tablet_bootstrap.cc:654] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.244031  1781 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.216768  1958 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.246515  1834 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.245267  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.250016  1948 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.248850  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.261166  1608 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:28.261636  1680 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:28.262820  1958 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.257894  1528 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:28.263824  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:28.253692  1723 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:28.259891  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:28.266721  1781 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.268594  1781 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.269147  1781 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.270709  1723 tablet_bootstrap.cc:654] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.272775  1649 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.273643  1958 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:28.273679  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54906.1us
W20260709 12:59:28.274459  1649 leader_election.cc:343] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.274297  1958 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.274891  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:28.274989  1649 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.275708  1989 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.276226  1989 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:28.277108  1989 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.278012  1725 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:28.278520  1725 ts_tablet_manager.cc:1403] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.193s	user 0.011s	sys 0.003s
I20260709 12:59:28.280529  1958 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:28.282166  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:28.282814  1608 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.284512  1725 raft_consensus.cc:359] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.285305  1725 raft_consensus.cc:385] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.285633  1725 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.286473  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.288370  1768 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.288735  1768 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.289073  1768 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:28.290016  1574 leader_election.cc:343] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.293651  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:28.296895  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.297562  1683 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:28.300030  1989 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.300241  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:28.300792  1609 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.300979  1768 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.303277  1768 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.291514  1725 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:28.306318  1648 leader_election.cc:343] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.315060  1429 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.321023  1725 ts_tablet_manager.cc:1434] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:59:28.280550  1679 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:28.333482  1725 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:28.326052  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:28.336000  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:28.353400  1723 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:28.357614  1723 ts_tablet_manager.cc:1403] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.104s	user 0.027s	sys 0.021s
W20260709 12:59:28.359592  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48676.4us
I20260709 12:59:28.360669  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.360554  1683 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.342531  1608 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:28.367930  1723 raft_consensus.cc:359] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.373584  1723 raft_consensus.cc:385] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.370720  1724 tablet_bootstrap.cc:492] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:28.374426  1724 ts_tablet_manager.cc:1403] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.311s	user 0.018s	sys 0.000s
I20260709 12:59:28.360736  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 12:59:28.374855  1574 leader_election.cc:343] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.375056  1723 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.375208  1781 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.384025  1781 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.384223  1723 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.385663  1724 raft_consensus.cc:359] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.387533  1724 raft_consensus.cc:385] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.387779  1724 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.389235  1723 ts_tablet_manager.cc:1434] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:59:28.378623  1952 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.389660  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.392763  1724 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.397146  1745 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.397830  1745 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:28.398659  1745 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.409394  1430 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.396013  1952 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.411221  1952 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:28.461962  1500 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:28.483608  1888 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.485714  1888 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.461485  1986 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.526055  1683 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:28.538976  1986 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.539233  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:28.539891  1606 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:28.485245  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 87748.9us
I20260709 12:59:28.608264  1888 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.608656  1724 ts_tablet_manager.cc:1434] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.234s	user 0.005s	sys 0.001s
I20260709 12:59:28.609715  1724 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:28.620002  1781 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.618513  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:28.625370  1648 leader_election.cc:343] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.637528  1952 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.632126  1725 tablet_bootstrap.cc:654] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.644351  1723 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:28.646023  1606 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:28.646447  1986 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.652635  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:28.661778  1648 leader_election.cc:343] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.672325  1500 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:28.673305  1781 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.674275  1781 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:28.675180  1781 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:28.693542  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 314697us
W20260709 12:59:28.698122  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:28.705605  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.707528  1723 tablet_bootstrap.cc:654] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.713316  1952 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:28.713886  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:28.715898  1683 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.714672  1428 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.720649  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.723309  1954 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.723814  1954 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:28.724677  1954 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:28.733083  1649 leader_election.cc:343] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.733526  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.733589  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.734210  1608 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:28.740417  1910 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.743017  2033 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:28.740206  1724 tablet_bootstrap.cc:654] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.750692  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.762111  2017 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:28.762527  2017 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.762845  2017 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.765180  1725 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:28.765623  1725 ts_tablet_manager.cc:1403] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.442s	user 0.015s	sys 0.012s
I20260709 12:59:28.768775  1725 raft_consensus.cc:359] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.769457  1725 raft_consensus.cc:385] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.769732  1725 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.770800  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:28.770361  1725 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.781612  1725 ts_tablet_manager.cc:1434] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:59:28.780014  1683 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
W20260709 12:59:28.785398  1574 leader_election.cc:343] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.799726  1723 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:28.801216  1723 ts_tablet_manager.cc:1403] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.023s
I20260709 12:59:28.797746  1429 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.823304  1910 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.845046  1723 raft_consensus.cc:359] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.846531  1723 raft_consensus.cc:385] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.847375  1723 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.850015  1986 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:28.848739  1723 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.853173  1729 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.850196  2017 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.861693  1723 ts_tablet_manager.cc:1434] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:59:28.868867  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:28.857956  1958 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:59:28.874850  1723 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:28.869683  1681 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.877283  2017 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:28.887692  1725 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:28.878449  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:28.901353  1648 leader_election.cc:343] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:28.907300  1607 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.913344  1430 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.925635  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:28.926397  1609 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:28.914609  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 71560.8us
I20260709 12:59:28.935837  1729 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.936758  1723 tablet_bootstrap.cc:654] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.936335  1729 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.937239  1681 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:28.939281  2017 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.940141  1729 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 12:59:28.929956  2040 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:59:28.940879  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.943867  2035 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.944377  2035 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:28.945350  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:28.945201  2035 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.947971  1603 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:28.958550  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:28.964831  1781 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:28.966164  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:28.967183  1729 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.977888  1609 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:28.979271  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:28.980132  1958 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.981001  1958 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:28.982045  1958 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:28.984624  1729 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:29.075758  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 96564.5us
I20260709 12:59:29.078655  1725 tablet_bootstrap.cc:654] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.098841  1745 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.099483  1745 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.113205  1724 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:29.113692  1724 ts_tablet_manager.cc:1403] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.504s	user 0.036s	sys 0.024s
I20260709 12:59:29.120029  1745 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:29.121127  1725 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:29.121603  1725 ts_tablet_manager.cc:1403] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.234s	user 0.013s	sys 0.016s
I20260709 12:59:29.130336  2032 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:29.199258  1428 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.245018  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:29.311482  1724 raft_consensus.cc:359] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.312553  1724 raft_consensus.cc:385] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.312825  1724 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.316869  1724 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.333235  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:29.340649  1648 leader_election.cc:343] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.350577  1724 ts_tablet_manager.cc:1434] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.237s	user 0.003s	sys 0.007s
W20260709 12:59:29.353281  1649 leader_election.cc:343] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.353690  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:29.359786  2059 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.416464  1724 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:29.416487  1723 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:29.418174  1723 ts_tablet_manager.cc:1403] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.545s	user 0.026s	sys 0.007s
I20260709 12:59:29.423334  1953 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:59:29.420892  2055 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:59:29.436668  1724 tablet_bootstrap.cc:654] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.436595  1723 raft_consensus.cc:359] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.441974  1723 raft_consensus.cc:385] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.442860  1723 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.447786  1723 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.452808  1723 ts_tablet_manager.cc:1434] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:59:29.453867  1723 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:29.453543  1725 raft_consensus.cc:359] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.454444  1725 raft_consensus.cc:385] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.454820  1725 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.456404  1429 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.461818  1723 tablet_bootstrap.cc:654] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.455835  1725 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.475576  1725 ts_tablet_manager.cc:1434] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.354s	user 0.006s	sys 0.000s
W20260709 12:59:29.481338  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59177.1us
W20260709 12:59:29.489706  1574 consensus_peers.cc:597] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.493289  1724 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:29.493818  1724 ts_tablet_manager.cc:1403] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.008s
I20260709 12:59:29.502748  1725 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:29.517582  1724 raft_consensus.cc:359] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.533103  1724 raft_consensus.cc:385] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.539152  1725 tablet_bootstrap.cc:654] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.533416  1724 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.540393  1724 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.556080  2065 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:29.563840  1723 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:29.564585  1724 ts_tablet_manager.cc:1434] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:59:29.561869  2069 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:29.568763  1723 ts_tablet_manager.cc:1403] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.008s
I20260709 12:59:29.572475  1834 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:29.595253  1723 raft_consensus.cc:359] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.596601  1723 raft_consensus.cc:385] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.596897  1723 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.597663  1723 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.602632  1724 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:29.604074  1725 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:29.604665  1725 ts_tablet_manager.cc:1403] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.007s
I20260709 12:59:29.607820  1723 ts_tablet_manager.cc:1434] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:59:29.607630  2059 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:59:29.612967  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.620939  1723 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:29.621955  1725 raft_consensus.cc:359] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.622749  1725 raft_consensus.cc:385] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.623034  1725 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.623745  1725 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.632649  1725 ts_tablet_manager.cc:1434] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:59:29.634006  1725 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
W20260709 12:59:29.643316  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 76453.1us
I20260709 12:59:29.639111  1723 tablet_bootstrap.cc:654] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:29.650898  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.735879  1724 tablet_bootstrap.cc:654] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.744392  1953 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.744876  1723 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:29.745415  1723 ts_tablet_manager.cc:1403] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.002s
I20260709 12:59:29.745126  1953 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.747632  1953 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:29.748705  1723 raft_consensus.cc:359] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.750674  1953 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.749397  1723 raft_consensus.cc:385] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.753098  1723 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.762087  1723 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.776921  2045 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.777494  2045 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.752781  1953 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.780030  1745 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.780494  1745 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.778748  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:29.785367  1953 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:29.785979  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:29.779687  2062 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.787452  2062 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.788259  1745 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:29.789234  1682 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
W20260709 12:59:29.790596  1574 leader_election.cc:343] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.792284  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:29.793006  1530 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:29.794335  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:29.794535  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:29.797194  1723 ts_tablet_manager.cc:1434] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
W20260709 12:59:29.798004  1648 leader_election.cc:343] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.798285  1723 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:29.794363  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:29.799305  2065 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.799703  2065 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.800021  2065 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.790169  1725 tablet_bootstrap.cc:654] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.801939  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 12:59:29.803460  1574 leader_election.cc:343] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.811751  2034 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.814891  2034 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.815646  2062 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:29.818528  2034 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.827606  1745 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.828145  1745 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.829208  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:29.830083  1745 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:29.830848  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:29.833098  1649 leader_election.cc:343] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.833515  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:29.834220  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:29.835955  1648 leader_election.cc:343] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.839257  2061 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.840283  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:29.841995  1648 leader_election.cc:343] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.842362  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:29.843670  1649 leader_election.cc:343] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.844074  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:29.844822  2061 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.845841  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:29.850498  2065 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.851003  2034 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.851794  1609 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:29.852208  1604 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:29.853721  2045 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:29.855608  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:29.855551  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 12:59:29.858642  1499 leader_election.cc:343] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.859179  1499 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 12:59:29.869199  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:29.878257  2065 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:29.880204  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:29.885854  2034 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:29.888626  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:29.893407  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 12:59:29.894913  1574 leader_election.cc:343] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:29.898777  1574 leader_election.cc:343] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.899364  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:29.909348  2064 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.961704  1724 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:29.962311  1724 ts_tablet_manager.cc:1403] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.385s	user 0.035s	sys 0.047s
I20260709 12:59:29.871100  2045 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.986579  2073 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.987128  2073 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:29.994447  2073 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.003934  2045 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.998881  1724 raft_consensus.cc:359] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.008028  2064 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.008247  1724 raft_consensus.cc:385] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.006588  1725 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.008669  1724 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.009063  1725 ts_tablet_manager.cc:1403] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.375s	user 0.050s	sys 0.029s
I20260709 12:59:30.009416  1724 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.011994  1724 ts_tablet_manager.cc:1434] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:59:30.012283  1725 raft_consensus.cc:359] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.012950  1724 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.013109  1725 raft_consensus.cc:385] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.013520  1725 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.014048  1723 tablet_bootstrap.cc:654] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.014361  1725 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.015641  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.016251  1682 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:30.016444  1725 ts_tablet_manager.cc:1434] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:30.017832  1725 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.018043  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:30.019784  2073 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.020124  2073 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.020471  2073 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.023977  1725 tablet_bootstrap.cc:654] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.025923  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.029585  1528 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:30.036401  2073 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.037575  1683 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:30.039444  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.040427  2035 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.041033  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.041760  1677 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.050155  1677 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:30.051632  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:30.055730  1724 tablet_bootstrap.cc:654] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.059783  2073 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.062196  2045 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.062711  2045 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:30.063565  2045 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.041565  2035 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:30.065317  2035 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.070642  1725 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.074358  1725 ts_tablet_manager.cc:1403] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.027s
W20260709 12:59:30.078872  1500 leader_election.cc:343] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.073185  1724 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.081513  1724 ts_tablet_manager.cc:1403] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.002s
I20260709 12:59:30.085664  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:30.078920  1725 raft_consensus.cc:359] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.105897  1725 raft_consensus.cc:385] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.106238  1725 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.108771  1724 raft_consensus.cc:359] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.110244  1709 tablet.cc:2406] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:30.111708  2026 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.112214  2026 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:30.113094  2026 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.107282  1725 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.115614  1432 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.119354  2024 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.119961  1724 raft_consensus.cc:385] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.119920  2024 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.120453  1724 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.120189  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:30.121340  1724 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.119388  1725 ts_tablet_manager.cc:1434] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:59:30.122977  2024 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.123754  1725 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.126223  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.127789  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:30.137173  1723 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.137910  1723 ts_tablet_manager.cc:1403] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.340s	user 0.007s	sys 0.022s
I20260709 12:59:30.134430  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.138622  1724 ts_tablet_manager.cc:1434] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 12:59:30.139487  2026 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.139694  1724 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.139236  1428 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.139948  2026 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.140427  2026 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.145700  1723 raft_consensus.cc:359] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.150842  1723 raft_consensus.cc:385] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.151211  1723 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.151861  1723 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.154471  1723 ts_tablet_manager.cc:1434] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:59:30.155687  1723 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.155563  2026 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.159183  1500 leader_election.cc:343] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.161441  1725 tablet_bootstrap.cc:654] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.161836  1723 tablet_bootstrap.cc:654] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.164804  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:30.167862  1574 leader_election.cc:343] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.167264  1724 tablet_bootstrap.cc:654] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.195557  1725 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.195868  2044 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.196202  1725 ts_tablet_manager.cc:1403] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.006s
I20260709 12:59:30.196512  2044 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.203282  1723 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.203938  1723 ts_tablet_manager.cc:1403] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.011s
I20260709 12:59:30.204123  2044 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.204967  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.205317  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.207091  1499 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:30.207342  1723 raft_consensus.cc:359] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.208272  1723 raft_consensus.cc:385] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.208451  2074 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.208604  1723 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.209478  1723 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.210673  1725 raft_consensus.cc:359] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.211702  1725 raft_consensus.cc:385] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.212021  1725 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.212482  2026 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.212711  1725 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.213737  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:30.215480  1725 ts_tablet_manager.cc:1434] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:59:30.216274  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.216971  1677 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.219861  1725 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.232059  1723 ts_tablet_manager.cc:1434] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.008s
I20260709 12:59:30.235621  1677 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:30.241885  1723 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.242342  2074 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.244626  2074 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.246918  2074 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.248086  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 12:59:30.215524  1574 leader_election.cc:343] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.248749  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.249235  1677 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:30.250123  1725 tablet_bootstrap.cc:654] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.250425  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.251178  2065 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.251819  2065 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:30.254150  1500 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:30.254842  1723 tablet_bootstrap.cc:654] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.255340  2065 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.255992  2044 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.264501  1725 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.265094  1725 ts_tablet_manager.cc:1403] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.001s
I20260709 12:59:30.267084  2044 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.267643  1725 raft_consensus.cc:359] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.268361  1725 raft_consensus.cc:385] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.268625  1725 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.269258  1725 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.272184  1723 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.272711  1723 ts_tablet_manager.cc:1403] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.003s
I20260709 12:59:30.275321  1723 raft_consensus.cc:359] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.276041  1723 raft_consensus.cc:385] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.276301  1723 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.278569  1725 ts_tablet_manager.cc:1434] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:30.279353  2035 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.279769  1725 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.279935  2035 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.283108  2035 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.283725  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.284430  1683 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:30.283053  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.286263  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.286597  1725 tablet_bootstrap.cc:654] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.287025  2026 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:59:30.287081  1574 leader_election.cc:343] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.288026  2026 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.288475  2026 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.296149  1724 tablet_bootstrap.cc:492] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.296114  1723 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.296885  1724 ts_tablet_manager.cc:1403] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.029s
I20260709 12:59:30.296160  2026 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.301529  2026 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.301539  1724 raft_consensus.cc:359] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.302381  1724 raft_consensus.cc:385] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.302676  1724 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.303440  1724 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.304049  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.304759  1723 ts_tablet_manager.cc:1434] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:59:30.305366  1724 ts_tablet_manager.cc:1434] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:30.305891  1723 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.306303  1724 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.306185  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:30.310441  1574 leader_election.cc:343] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.304699  1683 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.314615  2026 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.315073  2026 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.317742  2026 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.325623  1725 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.326397  1725 ts_tablet_manager.cc:1403] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:59:30.327000  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.327667  1677 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:30.329140  1725 raft_consensus.cc:359] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.329550  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.329814  1725 raft_consensus.cc:385] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.330101  1725 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.331998  1724 tablet_bootstrap.cc:654] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.332657  1723 tablet_bootstrap.cc:654] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.333632  2065 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.334002  2065 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.334311  2065 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.334746  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.335443  1725 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.336159  1574 leader_election.cc:343] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.343152  1530 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.344689  1724 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.345242  1724 ts_tablet_manager.cc:1403] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.003s
I20260709 12:59:30.345342  1725 ts_tablet_manager.cc:1434] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:59:30.339812  1428 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.346385  1725 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.346856  2061 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.347378  2061 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.347831  1724 raft_consensus.cc:359] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.348541  1724 raft_consensus.cc:385] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.348825  1724 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.349646  1724 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.351922  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.350132  2061 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 12:59:30.356240  1649 leader_election.cc:343] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.356817  1724 ts_tablet_manager.cc:1434] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:30.355861  1428 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.342213  2065 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.354715  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.357596  1683 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:30.356585  2074 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.359282  2074 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.360703  1648 leader_election.cc:343] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.361152  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.361387  2074 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.362074  1745 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.362500  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.363708  2026 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.364466  2026 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:30.364759  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.365022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.365285  2026 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.365222  1724 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.366489  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:30.367484  2074 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.371546  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:30.372531  1723 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.372999  1723 ts_tablet_manager.cc:1403] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
W20260709 12:59:30.373437  1574 leader_election.cc:343] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.374215  2065 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.373286  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.376703  1725 tablet_bootstrap.cc:654] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.376760  1723 raft_consensus.cc:359] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.377535  1723 raft_consensus.cc:385] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.377799  1723 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.378484  1723 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.380173  1683 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.384377  1723 ts_tablet_manager.cc:1434] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:30.388088  1724 tablet_bootstrap.cc:654] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.391204  1723 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.398276  1432 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.404052  1683 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:30.415299  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.416109  2026 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.416603  2026 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:30.416950  1725 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.417433  1725 ts_tablet_manager.cc:1403] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.007s
I20260709 12:59:30.417867  2026 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.420053  1725 raft_consensus.cc:359] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.420771  1725 raft_consensus.cc:385] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.421029  1725 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.421657  1725 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.426015  1723 tablet_bootstrap.cc:654] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.434629  1724 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.435093  1724 ts_tablet_manager.cc:1403] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 12:59:30.437691  1724 raft_consensus.cc:359] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.438346  1724 raft_consensus.cc:385] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.438617  1724 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.440945  1725 ts_tablet_manager.cc:1434] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:59:30.439711  1724 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.442566  1725 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.445153  1723 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.445730  1723 ts_tablet_manager.cc:1403] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:59:30.448339  1723 raft_consensus.cc:359] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.450524  1723 raft_consensus.cc:385] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.450860  1723 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.450750  1428 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.451586  1723 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.449388  1725 tablet_bootstrap.cc:654] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.453665  1723 ts_tablet_manager.cc:1434] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:30.450222  1724 ts_tablet_manager.cc:1434] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:30.455221  1723 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.455807  1724 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.462025  1723 tablet_bootstrap.cc:654] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.462832  1724 tablet_bootstrap.cc:654] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:30.473477  1500 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:30.483450  1725 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.484040  1725 ts_tablet_manager.cc:1403] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 12:59:30.487825  1725 raft_consensus.cc:359] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.489323  1725 raft_consensus.cc:385] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.489621  1725 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.490257  1725 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.492736  2064 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.493274  2064 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.495293  1723 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.495465  2064 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.495800  1723 ts_tablet_manager.cc:1403] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.009s
I20260709 12:59:30.497867  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.499686  1725 ts_tablet_manager.cc:1434] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:30.499976  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.501039  1725 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.502595  1532 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:30.502660  1648 leader_election.cc:343] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:30.505082  1649 leader_election.cc:343] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.512374  2074 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.513067  2074 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.516163  1723 raft_consensus.cc:359] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.516614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.516978  1723 raft_consensus.cc:385] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.517202  1683 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:30.522389  1725 tablet_bootstrap.cc:654] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.517249  1723 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.523687  1723 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.525725  2035 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.526348  2035 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.529835  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:30.530687  2044 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.531031  2044 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.531363  2044 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.532390  2074 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.533051  2035 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.535871  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.537374  1609 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:30.536731  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.539923  2061 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.539762  2044 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.540495  2061 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.541702  1574 leader_election.cc:343] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.539922  2035 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.542882  2035 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.543695  2044 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.543851  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:30.543237  2061 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.560778  1724 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.561944  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.552397  2035 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.525784  1723 ts_tablet_manager.cc:1434] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
W20260709 12:59:30.563707  1648 leader_election.cc:343] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.546818  1609 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.564378  1723 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.552281  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.551724  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.565573  1683 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.567616  1725 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.568135  1725 ts_tablet_manager.cc:1403] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.024s
I20260709 12:59:30.570895  1725 raft_consensus.cc:359] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.571545  1725 raft_consensus.cc:385] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.571784  1725 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.572294  1724 ts_tablet_manager.cc:1403] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.008s
I20260709 12:59:30.572504  1725 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.574309  1725 ts_tablet_manager.cc:1434] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:59:30.574331  1574 leader_election.cc:343] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.575320  1725 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.580034  1649 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 12:59:30.581110  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78040.8us
I20260709 12:59:30.582085  2061 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.582815  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.585654  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.591037  1724 raft_consensus.cc:359] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.592211  1724 raft_consensus.cc:385] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.592602  1724 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.596487  1725 tablet_bootstrap.cc:654] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.600008  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.600813  1677 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:30.602843  1609 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:30.609781  1725 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.610332  1725 ts_tablet_manager.cc:1403] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 12:59:30.610231  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:30.611315  2074 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.611836  2074 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:30.613325  2074 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:30.613917  1649 leader_election.cc:343] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.614356  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.614252  1725 raft_consensus.cc:359] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.615482  1725 raft_consensus.cc:385] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.615154  1724 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.615737  1725 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.616398  1725 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.618243  1725 ts_tablet_manager.cc:1434] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:30.619105  2064 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:30.623535  1574 leader_election.cc:343] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.609701  1677 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.624055  1574 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.607064  1683 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:30.619235  1725 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.626518  2024 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.606115  1723 tablet_bootstrap.cc:654] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.630563  1953 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.628072  1574 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:30.634594  2065 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.634968  2065 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.635296  2065 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.644980  2061 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.647621  1724 ts_tablet_manager.cc:1434] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.003s
I20260709 12:59:30.652204  2061 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.654423  2061 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.656169  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.657856  1724 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:30.658571  2045 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.659031  2045 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.669687  2045 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.656786  2035 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:59:30.673754  2035 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.674257  2035 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.675967  2061 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.676515  2061 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.729657  1725 tablet_bootstrap.cc:654] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.730857  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.733348  2035 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.734069  2061 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.736631  2064 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.737149  2064 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.739188  2064 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.741201  1723 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:30.741427  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.741653  1723 ts_tablet_manager.cc:1403] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.012s
I20260709 12:59:30.742105  1603 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:30.742887  2074 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.739239  1432 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.743383  2074 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.745577  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.746233  1683 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:30.747627  1723 raft_consensus.cc:359] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.746290  1725 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:30.749370  1725 ts_tablet_manager.cc:1403] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.006s
I20260709 12:59:30.753438  1723 raft_consensus.cc:385] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.753789  1723 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.754362  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:30.754420  1723 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.728087  2065 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.755759  1609 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:30.756659  2073 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.757098  2073 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.757731  2073 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.758039  1723 ts_tablet_manager.cc:1434] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:59:30.759012  1723 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:30.759819  1649 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.763147  2074 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.765018  2064 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.765545  2064 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.767561  2064 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.765545  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.768749  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.771757  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.751938  1725 raft_consensus.cc:359] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.786149  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.786876  1603 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
W20260709 12:59:30.787004  1649 leader_election.cc:343] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.786535  1725 raft_consensus.cc:385] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.788030  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.788059  1725 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.788758  1745 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.789099  1745 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.789407  1745 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.791422  2026 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.791887  2026 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.793929  2026 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.785454  1530 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:30.764858  2061 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.797049  1683 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:30.798166  2044 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.797045  1745 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.801394  1745 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:30.805570  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.806566  2026 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.762001  2065 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.802456  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.804352  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:30.807953  1603 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.807720  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.809288  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:30.807015  2026 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.810700  1648 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:30.810668  2026 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.819365  2073 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.820784  2026 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.821899  1603 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:30.824000  2026 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.804523  2061 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.825685  2061 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.825959  1725 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.828207  1723 tablet_bootstrap.cc:654] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.831677  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:30.761703  1724 tablet_bootstrap.cc:654] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.834161  2121 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.834720  2121 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:30.836403  2073 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:30.838745  1725 ts_tablet_manager.cc:1434] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 12:59:30.840214  1725 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:30.837666  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.843978  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:30.875969  2024 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:30.889082  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.889710  1680 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.895287  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:30.898087  2064 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:30.835567  2121 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.900882  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:30.903240  2064 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 12:59:30.903820  2064 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.880569  1532 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:30.913334  1574 leader_election.cc:343] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:30.873670  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 12:59:30.942948  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 99047.7us
W20260709 12:59:30.955889  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:30.936060  2065 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:59:30.940066  1953 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:59:30.938531  2034 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:59:30.939563  2061 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.963817  1724 tablet_bootstrap.cc:492] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:30.964457  1724 ts_tablet_manager.cc:1403] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.307s	user 0.048s	sys 0.045s
I20260709 12:59:30.966434  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:30.986644  1678 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:30.987099  1724 raft_consensus.cc:359] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.987865  1724 raft_consensus.cc:385] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.988149  1724 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
W20260709 12:59:30.989063  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47722.1us
I20260709 12:59:30.989861  1724 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:30.997884  1724 ts_tablet_manager.cc:1434] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:59:31.000909  1724 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:31.001377  1725 tablet_bootstrap.cc:654] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.015677  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:31.035310  1680 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:31.037012  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:31.112673  1648 leader_election.cc:343] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.084852  2034 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:31.116454  1648 leader_election.cc:343] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.119174  1723 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:31.119665  1723 ts_tablet_manager.cc:1403] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.361s	user 0.009s	sys 0.020s
I20260709 12:59:31.119647  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:31.118065  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 12:59:31.162359  1648 leader_election.cc:343] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.163161  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:31.143420  1724 tablet_bootstrap.cc:654] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.125270  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 12:59:31.181841  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46393.9us
W20260709 12:59:31.182720  1574 leader_election.cc:343] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.128667  2128 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.151278  2061 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.136891  2074 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:31.124826  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.195779  1528 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.137290  2024 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:59:31.120810  2034 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.197777  2074 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:31.193010  1607 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:31.173458  2064 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.211555  1723 raft_consensus.cc:359] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.212832  1723 raft_consensus.cc:385] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.189261  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.213152  1723 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.275568  1723 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.284713  2034 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:31.295050  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:31.297024  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:31.297819  1604 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 12:59:31.302410  1648 leader_election.cc:343] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:31.301769  1574 leader_election.cc:343] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.309144  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.311532  1723 ts_tablet_manager.cc:1434] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.191s	user 0.009s	sys 0.008s
I20260709 12:59:31.312871  1723 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
W20260709 12:59:31.315435  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:31.316368  1574 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:31.316852  1574 leader_election.cc:343] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.317202  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.317925  2130 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.319128  2026 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.320214  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:31.311342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.313072  1675 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.326054  2045 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.345779  2074 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.350586  1608 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.359066  1725 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:31.359644  1725 ts_tablet_manager.cc:1403] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.520s	user 0.021s	sys 0.010s
I20260709 12:59:31.406440  1574 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.423197  1725 raft_consensus.cc:359] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.424235  1725 raft_consensus.cc:385] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.424558  1725 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.428498  1725 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.431931  2135 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:31.434859  2064 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.417464  2133 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.436419  2133 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.441325  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:31.441103  2143 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:31.445832  1428 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.429023  2124 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
W20260709 12:59:31.469192  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 141293us
I20260709 12:59:31.476019  2142 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:31.484512  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88380.8us
I20260709 12:59:31.502000  2131 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.502578  2131 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:31.518837  1724 tablet_bootstrap.cc:492] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:31.519399  1724 ts_tablet_manager.cc:1403] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.519s	user 0.015s	sys 0.028s
I20260709 12:59:31.522166  1723 tablet_bootstrap.cc:654] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.523414  1725 ts_tablet_manager.cc:1434] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.163s	user 0.008s	sys 0.000s
W20260709 12:59:31.523295  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47815.6us
W20260709 12:59:31.523980  1648 leader_election.cc:343] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.524379  1648 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.533579  2117 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.534227  2117 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.534547  1725 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:31.534657  2117 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.537036  2127 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:59:31.538349  2117 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.539491  2131 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.542429  1724 raft_consensus.cc:359] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.543226  1724 raft_consensus.cc:385] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.543569  1724 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.542944  2131 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.545192  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:31.544850  1724 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.551054  1608 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:31.554459  2133 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.564559  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:31.582116  1608 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:31.585856  1649 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:31.593428  1724 ts_tablet_manager.cc:1434] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 12:59:31.594730  1724 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
W20260709 12:59:31.597851  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60123.5us
I20260709 12:59:31.597504  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:31.603731  2044 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.605998  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.606659  1534 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.607239  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:31.608450  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:31.609117  1527 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
W20260709 12:59:31.613229  1648 leader_election.cc:343] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.625809  2137 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:31.629624  2137 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.630095  2137 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.644770  1723 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:31.645272  1723 ts_tablet_manager.cc:1403] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.333s	user 0.029s	sys 0.020s
I20260709 12:59:31.616747  2064 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:31.652124  2064 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.652581  2064 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.604266  2044 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.674033  2135 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.674614  2135 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.697858  1725 tablet_bootstrap.cc:654] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.681787  2133 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:31.706199  2044 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:31.707743  2135 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:31.710445  1534 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 12:59:31.713022  1648 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 12:59:31.714481  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.717051  2117 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.717571  2117 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:31.718386  2117 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.720021  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 12:59:31.724650  2160 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:31.737586  1724 tablet_bootstrap.cc:654] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.752059  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:31.767495  2064 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.769908  2064 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.771204  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:31.771277  1723 raft_consensus.cc:359] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.772104  1609 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.772078  1723 raft_consensus.cc:385] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.772614  1723 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.773218  1723 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.784449  1609 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:31.789873  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:31.793802  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:31.794479  1681 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:31.798017  1528 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:59:31.799633  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.800215  1534 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:31.801409  1648 consensus_peers.cc:597] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:31.812484  1534 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:31.817276  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:31.818424  2044 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.824286  1574 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.824496  2121 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:31.825034  2121 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:31.826663  1723 ts_tablet_manager.cc:1434] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.181s	user 0.006s	sys 0.002s
I20260709 12:59:31.828615  2135 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:31.832397  2121 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.834240  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:31.835103  2143 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:31.835435  2143 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.836390  2143 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.840408  1723 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Bootstrap starting.
I20260709 12:59:31.846966  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:31.875543  1724 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:31.876089  1724 ts_tablet_manager.cc:1403] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.282s	user 0.016s	sys 0.011s
I20260709 12:59:31.877559  1723 tablet_bootstrap.cc:654] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:31.880916  2163 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:31.892797  2137 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:31.896399  1574 leader_election.cc:343] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.913036  2137 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:31.916080  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.916100  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:31.919473  1605 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.920189  1725 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:31.920655  1725 ts_tablet_manager.cc:1403] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.395s	user 0.022s	sys 0.018s
W20260709 12:59:31.922932  1648 leader_election.cc:343] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.917379  1724 raft_consensus.cc:359] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.925199  1724 raft_consensus.cc:385] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.925498  1724 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.926151  1724 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.915988  2143 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.928911  2143 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:31.930748  1724 ts_tablet_manager.cc:1434] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.001s
I20260709 12:59:31.931715  1605 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:31.934398  1724 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:31.937707  1725 raft_consensus.cc:359] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.936487  1649 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.938453  1725 raft_consensus.cc:385] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.938593  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:31.938781  1725 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.939630  1725 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.940248  1723 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: No bootstrap required, opened a new log
I20260709 12:59:31.940730  1723 ts_tablet_manager.cc:1403] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.014s
W20260709 12:59:31.943262  1574 leader_election.cc:343] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:31.945945  2117 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:31.946467  2117 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:31.946338  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:31.947088  1676 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:31.951298  1724 tablet_bootstrap.cc:654] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.956246  2117 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.959088  1724 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:31.959735  1724 ts_tablet_manager.cc:1403] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.002s
I20260709 12:59:31.962419  1724 raft_consensus.cc:359] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.963186  1724 raft_consensus.cc:385] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.963515  1724 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.964255  1724 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.965189  1432 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.966607  1724 ts_tablet_manager.cc:1434] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:59:31.968338  1724 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:31.968477  1676 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:31.969766  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:31.970968  2134 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:31.971455  2134 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:31.972477  2134 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.973107  1725 ts_tablet_manager.cc:1434] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:59:31.974802  1725 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:31.977795  1724 tablet_bootstrap.cc:654] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:31.982998  1723 raft_consensus.cc:359] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.987565  1723 raft_consensus.cc:385] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:31.987955  1723 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Initialized, Role: FOLLOWER
I20260709 12:59:31.991124  1723 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:31.996970  1725 tablet_bootstrap.cc:654] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.004948  1724 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.005522  1724 ts_tablet_manager.cc:1403] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.011s
I20260709 12:59:32.006127  2073 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.008097  1724 raft_consensus.cc:359] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.009007  1724 raft_consensus.cc:385] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.009337  1724 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.010057  1724 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.013072  1724 ts_tablet_manager.cc:1434] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:32.016767  1724 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.023391  1724 tablet_bootstrap.cc:654] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.024233  1723 ts_tablet_manager.cc:1434] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:59:32.028144  2073 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:32.050983  1430 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.070322  1724 tablet_bootstrap.cc:492] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.070854  1724 ts_tablet_manager.cc:1403] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.005s
I20260709 12:59:32.073544  1725 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:32.074052  1725 ts_tablet_manager.cc:1403] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.016s
W20260709 12:59:32.077894  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:32.073982  1724 raft_consensus.cc:359] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.081385  1724 raft_consensus.cc:385] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.081660  1724 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.082261  1724 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.084230  1724 ts_tablet_manager.cc:1434] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:59:32.085125  1724 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.079797  1725 raft_consensus.cc:359] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.088547  1725 raft_consensus.cc:385] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.088876  1725 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.089990  1724 tablet_bootstrap.cc:654] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.089743  1725 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.092271  1725 ts_tablet_manager.cc:1434] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:59:32.093334  1725 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:32.092782  1429 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.094818  1429 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.095515  1724 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.096132  1724 ts_tablet_manager.cc:1403] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:59:32.098678  2121 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.099139  1724 raft_consensus.cc:359] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.099213  2121 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.100931  1725 tablet_bootstrap.cc:654] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.103152  2073 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.103281  1724 raft_consensus.cc:385] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.105618  2073 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.102659  2121 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:32.103904  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.106794  1527 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:32.105664  1724 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.107883  2073 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.108543  1724 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.109536  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.110312  1675 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:32.111590  1724 ts_tablet_manager.cc:1434] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:32.108886  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.112812  1724 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.113161  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.104631  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.114326  2044 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.119297  1724 tablet_bootstrap.cc:654] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.111790  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:32.101516  1429 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.122700  2117 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.123098  2117 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.123456  2117 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:32.124718  1649 leader_election.cc:343] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.138989  2044 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.145215  1527 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.145797  2147 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.148252  2147 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.144393  2117 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.150678  2147 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.153031  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.153693  1676 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 0.
I20260709 12:59:32.154943  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.158363  1724 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.159193  1724 ts_tablet_manager.cc:1403] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.020s
I20260709 12:59:32.159155  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 12:59:32.159060  1500 leader_election.cc:343] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.159871  1534 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.160856  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:32.159621  1745 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:32.163602  1724 raft_consensus.cc:359] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.164032  2044 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.164294  1724 raft_consensus.cc:385] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.164517  2044 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.164650  1724 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.164911  2044 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.165324  1724 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.165930  2148 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.166558  1534 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:32.166399  2148 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.167394  1724 ts_tablet_manager.cc:1434] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:59:32.159142  2117 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:32.170892  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.169114  2148 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.170184  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:32.168836  1724 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.172863  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.174077  2044 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.177414  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:32.178680  1725 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:32.178515  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.179296  1724 tablet_bootstrap.cc:654] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.182257  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:32.179761  2117 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.189155  2117 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:32.190068  2117 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 12:59:32.193620  1500 leader_election.cc:343] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.200464  2147 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.202739  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:32.203316  1676 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.204524  1724 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.205008  1724 ts_tablet_manager.cc:1403] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
W20260709 12:59:32.205188  1649 leader_election.cc:343] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.206511  1605 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.208123  2153 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.215363  1676 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 12:59:32.179373  2044 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.216725  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:32.217305  2044 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.217993  2044 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:32.218842  2044 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.225752  1725 ts_tablet_manager.cc:1403] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.107s	user 0.005s	sys 0.020s
I20260709 12:59:32.230181  1724 raft_consensus.cc:359] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.230943  1724 raft_consensus.cc:385] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.231190  1724 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.232038  1724 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.234324  1724 ts_tablet_manager.cc:1434] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:59:32.235584  1724 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.242203  1430 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.251099  2148 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.251765  2148 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.252698  1725 raft_consensus.cc:359] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.253412  1725 raft_consensus.cc:385] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.253690  1725 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.254381  1725 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.255144  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.257889  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.255476  2148 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.266439  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.267577  1725 ts_tablet_manager.cc:1434] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.000s
I20260709 12:59:32.268043  2073 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.268597  1725 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Bootstrap starting.
I20260709 12:59:32.275759  1724 tablet_bootstrap.cc:654] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.279068  1527 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.286293  2153 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.298929  1429 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.305388  1724 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.305884  1724 ts_tablet_manager.cc:1403] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.004s
I20260709 12:59:32.308756  1724 raft_consensus.cc:359] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.309429  1724 raft_consensus.cc:385] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.309691  1724 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.310286  1724 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.311650  1725 tablet_bootstrap.cc:654] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.316177  1724 ts_tablet_manager.cc:1434] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:59:32.317281  1724 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.318796  2117 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.319347  2134 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.319307  2117 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.319905  2134 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.322214  2134 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.323741  2117 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:32.325038  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.329905  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.331353  1604 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 0.
I20260709 12:59:32.332624  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:32.333421  2121 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.337090  2121 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.337416  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.340946  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.341643  1534 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:32.337464  2121 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.357743  1725 tablet_bootstrap.cc:492] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: No bootstrap required, opened a new log
I20260709 12:59:32.358181  1725 ts_tablet_manager.cc:1403] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.003s
W20260709 12:59:32.364153  1648 leader_election.cc:343] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.365912  2153 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.367427  1574 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:32.368891  1724 tablet_bootstrap.cc:654] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.369408  2135 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.379756  2135 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.372242  2131 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.387621  2135 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.389706  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.390383  1675 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:32.391808  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:32.392203  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.392407  2131 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.392976  1525 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 0.
I20260709 12:59:32.393514  2131 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.393836  2131 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.394169  2131 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.398772  2121 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.402652  2121 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:32.402624  1725 raft_consensus.cc:359] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.403935  1725 raft_consensus.cc:385] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.404204  1725 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.404899  1725 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.406600  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:32.407914  1534 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.403244  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:32.415006  1604 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.416143  1725 ts_tablet_manager.cc:1434] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
W20260709 12:59:32.416638  1648 leader_election.cc:343] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.427624  2131 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.430521  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:32.431149  1527 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.431907  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:32.432538  1675 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.443426  1604 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 12:59:32.432474  2131 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.444655  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:32.446106  2121 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.446458  1675 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:32.446586  2121 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:32.447600  2121 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.450528  2135 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.451092  2135 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.453217  2135 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.457692  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:32.458880  2131 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.459467  2134 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.460292  1724 tablet_bootstrap.cc:492] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.461265  1724 ts_tablet_manager.cc:1403] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.020s
I20260709 12:59:32.461743  1530 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.461997  2131 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:32.462805  2131 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.463784  1724 raft_consensus.cc:359] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.464455  1724 raft_consensus.cc:385] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.464721  1724 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.465178  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.465291  1724 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.469010  1724 ts_tablet_manager.cc:1434] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:32.469347  1527 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:32.469552  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.470037  1724 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Bootstrap starting.
I20260709 12:59:32.476492  1676 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 1: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 12:59:32.477545  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:32.478999  2135 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.480086  1432 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 1, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.491667  2064 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.493773  1724 tablet_bootstrap.cc:654] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:32.498420  1648 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.507506  2135 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.512933  1953 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.513393  1724 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: No bootstrap required, opened a new log
I20260709 12:59:32.520643  1724 ts_tablet_manager.cc:1403] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 12:59:32.535287  1724 raft_consensus.cc:359] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.535954  1724 raft_consensus.cc:385] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.536222  1724 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.536948  1724 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.542461  1724 ts_tablet_manager.cc:1434] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:59:32.537593  1432 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 0 to 1, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.552287  2147 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.552840  2147 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.554579  2147 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.556785  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.557610  1605 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:32.558063  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.561429  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.562587  2147 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.574805  2147 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.612154  2121 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.623505  2153 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.705013  2148 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.706933  2148 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.709940  2148 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.711407  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.710937  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.712580  1604 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 12:59:32.713614  1675 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 1: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 12:59:32.715152  1499 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.716012  2148 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.724472  2148 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.757972  2073 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.770386  2148 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.786680  2148 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.787194  2148 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.789252  2148 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.790247  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 12:59:32.790287  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.796875  1500 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:32.797600  2148 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.899423  1953 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.899902  1953 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.901937  1953 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.902525  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 12:59:32.902724  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 12:59:32.903194  1530 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:32.903350  1676 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 12:59:32.904603  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:32.905498  2135 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:32.905861  2135 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.906185  2135 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.911931  2135 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.913656  2135 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:32.915009  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:32.915603  1530 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.915575  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:32.917153  1676 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.922394  1530 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:32.924010  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:32.924518  1676 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:32.924750  2135 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:32.926571  2135 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:32.927642  2135 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:32.939312  1429 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 0 to 2, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.969686  2135 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:32.982033  2131 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.033315  2153 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.035244  2153 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.057533  1530 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.382226  1676 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:33.383564  1953 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.393174  1530 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:33.394570  1953 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.656055   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:33.685539  2215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:33.686112  2216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:33.688170  2218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:33.691133   431 server_base.cc:1061] running on GCE node
I20260709 12:59:33.693238   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:33.693590   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:33.693842   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601973693821 us; error 0 us; skew 500 ppm
I20260709 12:59:33.694664   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:33.701767   431 webserver.cc:533] Webserver started at http://127.0.107.196:42357/ using document root <none> and password file <none>
I20260709 12:59:33.702579   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:33.702912   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:33.703362   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:33.705091   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root/instance:
uuid: "9b6586a864a94c019cae2d8e2987a7af"
format_stamp: "Formatted at 2026-07-09 12:59:33 on dist-test-slave-021n"
I20260709 12:59:33.713498   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:59:33.717782  2223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:33.718605   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 12:59:33.718865   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root
uuid: "9b6586a864a94c019cae2d8e2987a7af"
format_stamp: "Formatted at 2026-07-09 12:59:33 on dist-test-slave-021n"
I20260709 12:59:33.719122   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:33.751365   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:33.753204   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:33.755411   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:33.765502   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:33.765808   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:33.766119   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:33.766299   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:33.841315   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:42185
I20260709 12:59:33.841414  2285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:42185 every 8 connection(s)
I20260709 12:59:33.846935   431 auto_leader_rebalancer-test.cc:384] add a tserver: 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:33.870617  2286 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41741
I20260709 12:59:33.871287  2286 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:33.873345  2286 heartbeater.cc:507] Master 127.0.107.254:41741 requested a full tablet report, sending...
I20260709 12:59:33.875671  1429 ts_manager.cc:194] Registered new tserver with Master: 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 12:59:33.877544  1429 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55678
I20260709 12:59:34.217808  1676 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:34.224525  1609 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:34.228986  2121 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:34.237864  1526 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:34.244614  2121 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:34.262989  1647 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ac98493907d499f8fa4ad8002393318. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.264747  2121 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.268937  1609 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.272117  1526 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.287866  1429 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.314184  1605 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:34.321871  1678 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.321870  1526 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.325328  1953 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.326279  2135 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:34.334026  2135 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.338996  1526 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 12:59:34.342252  1573 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53808273f23f45848ad55ddef1799643. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.353220  1675 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:34.354507  1432 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.349448  1678 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.366300  1605 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:34.368253  1647 consensus_peers.cc:597] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dc13e5cfc8a48a5b9eebe70f2e4e68b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.372550  1526 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:34.373843  2064 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.375998  2121 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.389029  2064 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.395381  1609 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.415663  1429 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.422410  1526 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.438661  1534 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:34.461055  1675 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:34.461174  1609 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:34.463285  2148 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.466022  2073 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:59:34.474161  1498 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a20d1cf89bf84cc0b80b0dceda3cad18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.494192  2073 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.497344  1609 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.499610  1675 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:34.513338  1432 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.881146  2286 heartbeater.cc:499] Master 127.0.107.254:41741 was elected leader, sending a full tablet report...
I20260709 12:59:34.937436  2314 ts_tablet_manager.cc:933] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:34.958971  2314 tablet_copy_client.cc:323] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:35.038255  2321 ts_tablet_manager.cc:933] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:35.057108  2321 tablet_copy_client.cc:323] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:35.104154  2322 ts_tablet_manager.cc:933] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:35.118134  2322 tablet_copy_client.cc:323] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:35.270961  2331 ts_tablet_manager.cc:933] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:35.328269  2331 tablet_copy_client.cc:323] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:35.334342  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet a20d1cf89bf84cc0b80b0dceda3cad18 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:35.335176  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet a20d1cf89bf84cc0b80b0dceda3cad18 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-a20d1cf89bf84cc0b80b0dceda3cad18
I20260709 12:59:35.346189  1544 tablet_copy_source_session.cc:215] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:35.351293  2322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d1cf89bf84cc0b80b0dceda3cad18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:35.399824  1693 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 3ac98493907d499f8fa4ad8002393318 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:35.400533  1693 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 3ac98493907d499f8fa4ad8002393318 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-3ac98493907d499f8fa4ad8002393318
I20260709 12:59:35.408847  1693 tablet_copy_source_session.cc:215] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:35.428122  2322 tablet_copy_client.cc:806] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:35.428900  2322 tablet_copy_client.cc:670] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:35.431078  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:35.431676  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-8dc13e5cfc8a48a5b9eebe70f2e4e68b
I20260709 12:59:35.434116  2322 tablet_copy_client.cc:538] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:35.434937  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 53808273f23f45848ad55ddef1799643 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:35.436008  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 53808273f23f45848ad55ddef1799643 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-53808273f23f45848ad55ddef1799643
I20260709 12:59:35.447062  2314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac98493907d499f8fa4ad8002393318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:35.450488  1692 tablet_copy_source_session.cc:215] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:35.455063  2321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:35.463799  1619 tablet_copy_source_session.cc:215] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:35.468422  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53808273f23f45848ad55ddef1799643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:35.487013  2322 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:35.488652  2331 tablet_copy_client.cc:806] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:35.490052  2321 tablet_copy_client.cc:806] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:35.490653  2321 tablet_copy_client.cc:670] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:35.491626  2331 tablet_copy_client.cc:670] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:35.495888  2331 tablet_copy_client.cc:538] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:35.498315  2321 tablet_copy_client.cc:538] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:35.515236  2331 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:35.516391  2321 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:35.534292  2314 tablet_copy_client.cc:806] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:35.534986  2314 tablet_copy_client.cc:670] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:35.539085  2314 tablet_copy_client.cc:538] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:35.576901  2314 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:35.603399  2322 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.611182  2322 tablet_bootstrap.cc:492] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:35.612087  2322 ts_tablet_manager.cc:1403] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.125s	user 0.030s	sys 0.007s
I20260709 12:59:35.615149  2322 raft_consensus.cc:359] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.616019  2322 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:35.618216  2321 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.619194  2331 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.619343  2321 tablet_bootstrap.cc:492] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:35.620029  2331 tablet_bootstrap.cc:492] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:35.620035  2321 ts_tablet_manager.cc:1403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.005s
I20260709 12:59:35.620901  2331 ts_tablet_manager.cc:1403] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.009s
I20260709 12:59:35.625772  2321 raft_consensus.cc:359] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.626796  2321 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:35.627556  2321 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.616727  2322 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.626611  2331 raft_consensus.cc:359] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.634513  2331 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:35.635217  2331 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.637229  2314 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.638233  2314 tablet_bootstrap.cc:492] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:35.638947  2314 ts_tablet_manager.cc:1403] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.017s
I20260709 12:59:35.646559  2322 ts_tablet_manager.cc:1434] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 12:59:35.644850  2331 ts_tablet_manager.cc:1434] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.006s
I20260709 12:59:35.649107  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a20d1cf89bf84cc0b80b0dceda3cad18 received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:35.649477  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-53808273f23f45848ad55ddef1799643 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:35.649704  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a20d1cf89bf84cc0b80b0dceda3cad18 on tablet a20d1cf89bf84cc0b80b0dceda3cad18 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:35.650015  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-53808273f23f45848ad55ddef1799643 on tablet 53808273f23f45848ad55ddef1799643 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:35.649351  2314 raft_consensus.cc:359] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.650687  2314 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:35.651644  2321 ts_tablet_manager.cc:1434] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.007s
I20260709 12:59:35.651443  2314 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:35.653995  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8dc13e5cfc8a48a5b9eebe70f2e4e68b received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:35.654230  2314 ts_tablet_manager.cc:1434] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:35.654469  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8dc13e5cfc8a48a5b9eebe70f2e4e68b on tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:35.656231  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-3ac98493907d499f8fa4ad8002393318 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:35.656615  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-3ac98493907d499f8fa4ad8002393318 on tablet 3ac98493907d499f8fa4ad8002393318 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:35.663307  2259 raft_consensus.cc:1217] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:35.922483  2259 raft_consensus.cc:1217] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:35.975441  2259 raft_consensus.cc:1217] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:36.059777  2327 raft_consensus.cc:1064] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:36.062098  2327 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.069329  2259 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:36.069483  1678 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:36.070740  2316 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.071308  1530 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:36.071606  2327 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.072551  2135 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.091521  2316 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.097222  1530 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.104287  1678 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.110431  2259 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.115448  1432 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.127957  2260 raft_consensus.cc:1217] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:36.131965  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9060 after lost signal to thread 434
W20260709 12:59:36.132957  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9740 after lost signal to thread 1466
W20260709 12:59:36.135319  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2a40 after lost signal to thread 1707
W20260709 12:59:36.136464  2282 debug-util.cc:398] Leaking SignalData structure 0x7b080024ba60 after lost signal to thread 2285
I20260709 12:59:36.187351  1606 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.209631  2259 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:36.211009  2131 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:36.212401  1532 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:36.216885  2316 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:36.218438  2329 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.220675  2259 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.225739  1530 raft_consensus.cc:2955] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.239607  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53808273f23f45848ad55ddef1799643 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:36.250030  1428 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.267086  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 53808273f23f45848ad55ddef1799643 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:36.327652  2335 raft_consensus.cc:1064] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:36.330861  2335 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.360910  2259 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.364900  1605 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.366020  2306 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.371181  2353 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.371227  1533 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.373836  2306 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.380224  2352 tablet_replica.cc:333] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:36.381347  2352 raft_consensus.cc:2243] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:36.382129  2352 raft_consensus.cc:2272] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:36.392692  2352 ts_tablet_manager.cc:1916] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:36.407807  2260 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.410686  2352 ts_tablet_manager.cc:1929] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:36.411348  2352 log.cc:1199] T 53808273f23f45848ad55ddef1799643 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/53808273f23f45848ad55ddef1799643
I20260709 12:59:36.413292  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 53808273f23f45848ad55ddef1799643 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:36.402187  2306 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.429510  1605 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.432461  1533 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.440083  1429 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.464174  1678 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.475114  1532 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.478958  2306 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:36.485206  2260 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.487627  2306 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:36.487528  2335 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.493415  2260 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.494874  1532 raft_consensus.cc:2955] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.508766  1430 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.522670  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ac98493907d499f8fa4ad8002393318 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:36.523780  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ac98493907d499f8fa4ad8002393318 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:36.536679  2359 tablet_replica.cc:333] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:36.537734  2359 raft_consensus.cc:2243] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:36.538463  2359 raft_consensus.cc:2272] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:36.545126  2359 ts_tablet_manager.cc:1916] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:36.563663  2359 ts_tablet_manager.cc:1929] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:36.564066  2359 log.cc:1199] T 3ac98493907d499f8fa4ad8002393318 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/3ac98493907d499f8fa4ad8002393318
I20260709 12:59:36.565630  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 3ac98493907d499f8fa4ad8002393318 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:36.578833  2335 raft_consensus.cc:1064] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:36.589463  2335 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.598898  1605 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.599776  1532 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.600711  2335 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.601176  2260 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.604277  2333 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.621837  2306 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.624038  2148 raft_consensus.cc:1064] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:36.628764  2148 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.649533  2259 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.652107  1605 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.653045  2073 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.659868  2311 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.662197  1678 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:36.666677  2073 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.667918  2354 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.690599  2260 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.707331  1605 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.730908  2073 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.732782  1677 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.719946  1430 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.765630  1533 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.779915  1678 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.784686  1607 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.796077  2260 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.824424  1430 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.838228  2260 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.845297  1607 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.845120  2306 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:59:36.854004  2354 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:36.862301  2259 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.864794  2335 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.869483  1605 raft_consensus.cc:2955] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:36.890117  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60613us
I20260709 12:59:36.893576  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:36.915452  1430 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.921407  1533 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:36.931288  2259 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.934510  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:36.936985  1677 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:36.935909  2368 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:36.948118  2371 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:36.954759  2372 tablet_replica.cc:333] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:36.958235  2372 raft_consensus.cc:2243] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:36.964326  2372 raft_consensus.cc:2272] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:36.965744  2370 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.970480  1677 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.973055  2259 raft_consensus.cc:2955] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:36.978816  2372 ts_tablet_manager.cc:1916] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:37.002118  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a20d1cf89bf84cc0b80b0dceda3cad18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:37.013408  1428 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:37.032563  2372 ts_tablet_manager.cc:1929] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:37.033138  2372 log.cc:1199] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/8dc13e5cfc8a48a5b9eebe70f2e4e68b
I20260709 12:59:37.035197  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet a20d1cf89bf84cc0b80b0dceda3cad18 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:37.035241  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 8dc13e5cfc8a48a5b9eebe70f2e4e68b (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:37.036188  2359 tablet_replica.cc:333] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:37.037217  2359 raft_consensus.cc:2243] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:37.037951  2359 raft_consensus.cc:2272] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:37.041065  2359 ts_tablet_manager.cc:1916] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:37.054373  2359 ts_tablet_manager.cc:1929] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:37.054795  2359 log.cc:1199] T a20d1cf89bf84cc0b80b0dceda3cad18 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/a20d1cf89bf84cc0b80b0dceda3cad18
I20260709 12:59:37.056207  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet a20d1cf89bf84cc0b80b0dceda3cad18 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
W20260709 12:59:38.117731  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57408.5us
I20260709 12:59:38.183531  1680 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:38.213127  1530 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:38.213608  1647 consensus_peers.cc:597] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 724d710084f24dcaa0170aeb7fb5ffc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.214931  1609 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:38.215271  2354 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:38.216454  2386 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:38.225875  2386 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.228135  1530 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.229080  1609 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.243692  1604 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:38.253890  1430 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.266291  1680 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:38.268978  2328 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:38.273167  1530 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:38.274848  1573 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d76204c6ec324b26bec0c1908a45574a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.276574  2328 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:38.286937  2328 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.294936  1680 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.298516  1530 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.329306  1430 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.333264  1530 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 12:59:38.342998  1498 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4390bd9839c84c1e88aa862d642a1b1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.345106  1680 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:38.346755  2375 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:38.350530  1604 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:38.352026  2375 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:38.356433  2148 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.362082  1680 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.378489  1681 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:38.381544  1430 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.391592  1609 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.435519  1604 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:38.436846  1530 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:38.438059  1647 consensus_peers.cc:597] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cddab79a6054062949d1d1c2453cc06. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.438424  2354 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:38.443252  2369 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:38.484339  2354 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.486524  1529 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.509055  1429 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.518076  1606 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:38.698683  2403 ts_tablet_manager.cc:933] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:38.703132  2403 tablet_copy_client.cc:323] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:38.706457  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 724d710084f24dcaa0170aeb7fb5ffc9 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:38.707250  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 724d710084f24dcaa0170aeb7fb5ffc9 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-724d710084f24dcaa0170aeb7fb5ffc9
I20260709 12:59:38.716388  1692 tablet_copy_source_session.cc:215] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:38.720608  2403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724d710084f24dcaa0170aeb7fb5ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:38.735087  2403 tablet_copy_client.cc:806] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:38.735908  2403 tablet_copy_client.cc:670] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:38.739558  2403 tablet_copy_client.cc:538] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:38.750000  2403 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:38.792753  2403 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:38.793597  2403 tablet_bootstrap.cc:492] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:38.794251  2403 ts_tablet_manager.cc:1403] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.004s
I20260709 12:59:38.797060  2403 raft_consensus.cc:359] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:38.797745  2403 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:38.798545  2403 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:38.807814  2403 ts_tablet_manager.cc:1434] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:59:38.812616  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-724d710084f24dcaa0170aeb7fb5ffc9 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:38.813161  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-724d710084f24dcaa0170aeb7fb5ffc9 on tablet 724d710084f24dcaa0170aeb7fb5ffc9 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:38.832619  2403 ts_tablet_manager.cc:933] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:38.834309  2403 tablet_copy_client.cc:323] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:38.836040  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 2cddab79a6054062949d1d1c2453cc06 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:38.836647  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 2cddab79a6054062949d1d1c2453cc06 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-2cddab79a6054062949d1d1c2453cc06
I20260709 12:59:38.882198  2408 ts_tablet_manager.cc:933] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:38.890499  1692 tablet_copy_source_session.cc:215] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:38.893882  2403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cddab79a6054062949d1d1c2453cc06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:38.905897  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08000b76e0 after lost signal to thread 434
W20260709 12:59:38.906991  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8f00 after lost signal to thread 1466
I20260709 12:59:38.907197  2408 tablet_copy_client.cc:323] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
W20260709 12:59:38.908174  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800095440 after lost signal to thread 1558
W20260709 12:59:38.909281  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800283340 after lost signal to thread 1633
I20260709 12:59:38.909840  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet d76204c6ec324b26bec0c1908a45574a from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:38.910396  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet d76204c6ec324b26bec0c1908a45574a from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-d76204c6ec324b26bec0c1908a45574a
W20260709 12:59:38.913506  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001b81c0 after lost signal to thread 1707
W20260709 12:59:38.914646  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080027af40 after lost signal to thread 2285
W20260709 12:59:38.915097  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3400 after lost signal to thread 2368
I20260709 12:59:38.973922  1619 tablet_copy_source_session.cc:215] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:38.977861  2408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76204c6ec324b26bec0c1908a45574a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:38.985059  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49753.1us
I20260709 12:59:39.003590  2410 ts_tablet_manager.cc:933] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:39.010638  2403 tablet_copy_client.cc:806] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:39.011418  2403 tablet_copy_client.cc:670] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:39.013496  2408 tablet_copy_client.cc:806] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:39.016155  2408 tablet_copy_client.cc:670] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:39.017366  2410 tablet_copy_client.cc:323] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:39.018170  2403 tablet_copy_client.cc:538] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:39.019291  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 4390bd9839c84c1e88aa862d642a1b1e from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:39.019861  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 4390bd9839c84c1e88aa862d642a1b1e from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-4390bd9839c84c1e88aa862d642a1b1e
I20260709 12:59:39.027170  1544 tablet_copy_source_session.cc:215] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:39.027769  2403 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:39.029969  2408 tablet_copy_client.cc:538] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:39.030320  2410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4390bd9839c84c1e88aa862d642a1b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.045228  2408 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:39.101182  2410 tablet_copy_client.cc:806] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:39.101758  2410 tablet_copy_client.cc:670] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:39.108587  2410 tablet_copy_client.cc:538] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:39.110643  2403 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:39.112238  2403 tablet_bootstrap.cc:492] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:39.114213  2403 ts_tablet_manager.cc:1403] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.007s
I20260709 12:59:39.118309  2403 raft_consensus.cc:359] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.122936  2403 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:39.124228  2403 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.139813  2410 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:39.158018  2403 ts_tablet_manager.cc:1434] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:59:39.178177  2408 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:39.179275  2408 tablet_bootstrap.cc:492] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:39.179494  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2cddab79a6054062949d1d1c2453cc06 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:39.179978  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2cddab79a6054062949d1d1c2453cc06 on tablet 2cddab79a6054062949d1d1c2453cc06 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:39.180171  2408 ts_tablet_manager.cc:1403] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.135s	user 0.037s	sys 0.006s
I20260709 12:59:39.183625  2408 raft_consensus.cc:359] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.186156  2408 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:39.189967  2408 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.199759  2408 ts_tablet_manager.cc:1434] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:59:39.209465  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-d76204c6ec324b26bec0c1908a45574a received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:39.209950  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-d76204c6ec324b26bec0c1908a45574a on tablet d76204c6ec324b26bec0c1908a45574a with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:39.238807  2259 raft_consensus.cc:1217] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:39.262509  2259 raft_consensus.cc:1217] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:39.291407  2410 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:39.293454  2410 tablet_bootstrap.cc:492] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:39.294225  2410 ts_tablet_manager.cc:1403] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.155s	user 0.031s	sys 0.021s
I20260709 12:59:39.298419  2410 raft_consensus.cc:359] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.299263  2410 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:39.299940  2410 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:39.303139  2410 ts_tablet_manager.cc:1434] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:59:39.304952  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-4390bd9839c84c1e88aa862d642a1b1e received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:39.305426  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-4390bd9839c84c1e88aa862d642a1b1e on tablet 4390bd9839c84c1e88aa862d642a1b1e with peer 9b6586a864a94c019cae2d8e2987a7af
W20260709 12:59:39.398628  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60797.7us
I20260709 12:59:39.443408  2259 raft_consensus.cc:1217] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:39.454433  2259 raft_consensus.cc:1217] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:39.857357  2354 raft_consensus.cc:1064] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:39.881999  2354 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:39.889081  2135 raft_consensus.cc:1064] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:39.891151  2135 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:39.909096  2259 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:39.912034  2135 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:39.935573  1677 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:39.941634  2135 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:39.946484  2415 raft_consensus.cc:1064] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:39.948972  2415 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:39.970225  2384 raft_consensus.cc:1064] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:39.990020  1530 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.017196  2259 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.018955  2375 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:40.050032  1680 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.055179  2384 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:40.062117  2375 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:40.079174  2383 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:40.122167  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 43682.7us
I20260709 12:59:40.137770  2259 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.151331  2386 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:40.172959  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48292.7us
I20260709 12:59:40.215153  1606 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.225466  2148 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.273057  1530 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.279243  1681 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.265448  1677 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.307299  2316 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:40.318181  1606 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:40.357987  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80847.1us
I20260709 12:59:40.375136  2261 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:40.415443  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 134798us
I20260709 12:59:40.417830  2438 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:40.423699  1430 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:40.430975  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 94791.3us
I20260709 12:59:40.395401  1432 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.456773  2386 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:40.471621  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 179017us
I20260709 12:59:40.501611  1604 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.534686  2259 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.536729  2354 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:40.558003  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145723us
I20260709 12:59:40.583650  1525 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:40.575886  2418 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:40.587350  2261 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.590328  2443 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:40.597646  1533 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.696108  2440 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:40.760689  1606 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:40.769491  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 206071us
I20260709 12:59:40.824508  2455 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.826000  1526 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.876478  2440 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.900629  1534 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:40.905622  2259 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.002847  1432 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.965234  2259 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.006503  1604 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.009012  1606 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.005105  1432 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.040131  1534 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:41.057331  1604 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:41.063110  1681 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:41.075876  2260 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.079386  1604 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.072764  2261 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.080957  2435 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:41.082672  2443 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:41.086707  1606 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.086808  2261 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.089681  2460 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:41.092425  2376 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:41.098793  2427 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.104823  1534 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.112505  2439 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:41.106138  2261 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.113559  2376 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.118175  1681 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:41.122728  2260 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.121057  1531 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.104882  2435 raft_consensus.cc:2955] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.132401  2430 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:41.140085  1604 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.142614  1606 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.153353  2258 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:41.155449  2443 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.157037  1432 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.162890  2259 raft_consensus.cc:2955] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.190402  1609 raft_consensus.cc:2955] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.200875  2354 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.207566  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4390bd9839c84c1e88aa862d642a1b1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.230074  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 4390bd9839c84c1e88aa862d642a1b1e with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:41.236083  1428 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:41.244663  2445 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.066s	user 0.002s	sys 0.008s
I20260709 12:59:41.244958  1432 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:41.249447  2422 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.060s	user 0.005s	sys 0.005s
I20260709 12:59:41.253700  2430 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.261253  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d76204c6ec324b26bec0c1908a45574a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.262894  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 724d710084f24dcaa0170aeb7fb5ffc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.269281  2464 tablet_replica.cc:333] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:41.270776  2464 raft_consensus.cc:2243] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.271538  2464 raft_consensus.cc:2272] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.278252  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet d76204c6ec324b26bec0c1908a45574a with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:41.287916  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2cddab79a6054062949d1d1c2453cc06 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.292971  2259 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.296984  2464 ts_tablet_manager.cc:1916] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:41.319692  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 724d710084f24dcaa0170aeb7fb5ffc9 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
W20260709 12:59:41.321121  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 72008.1us
W20260709 12:59:41.328550  2417 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.138s	user 0.000s	sys 0.010s
I20260709 12:59:41.335127  2464 ts_tablet_manager.cc:1929] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:41.335716  2464 log.cc:1199] T 4390bd9839c84c1e88aa862d642a1b1e P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/4390bd9839c84c1e88aa862d642a1b1e
I20260709 12:59:41.337630  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 4390bd9839c84c1e88aa862d642a1b1e (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:41.338130  2464 tablet_replica.cc:333] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:41.335734  1428 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.397614  1605 raft_consensus.cc:2955] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:41.401458  1515 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cddab79a6054062949d1d1c2453cc06 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:41.393616  2464 raft_consensus.cc:2243] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.402587  2464 raft_consensus.cc:2272] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.417162  2464 ts_tablet_manager.cc:1916] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:41.433683  2465 tablet_replica.cc:333] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:41.435154  2465 raft_consensus.cc:2243] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.447877  2465 raft_consensus.cc:2272] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.455379  2464 ts_tablet_manager.cc:1929] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:41.455860  2464 log.cc:1199] T d76204c6ec324b26bec0c1908a45574a P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/d76204c6ec324b26bec0c1908a45574a
I20260709 12:59:41.457486  2465 ts_tablet_manager.cc:1916] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:41.461597  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet d76204c6ec324b26bec0c1908a45574a (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:41.475059  2465 ts_tablet_manager.cc:1929] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:41.475550  2465 log.cc:1199] T 724d710084f24dcaa0170aeb7fb5ffc9 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/724d710084f24dcaa0170aeb7fb5ffc9
I20260709 12:59:41.477438  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 724d710084f24dcaa0170aeb7fb5ffc9 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:41.477635  2465 tablet_replica.cc:333] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:41.478608  2465 raft_consensus.cc:2243] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.479281  2465 raft_consensus.cc:2272] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.487417  2465 ts_tablet_manager.cc:1916] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:41.505002  2465 ts_tablet_manager.cc:1929] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:41.505457  2465 log.cc:1199] T 2cddab79a6054062949d1d1c2453cc06 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/2cddab79a6054062949d1d1c2453cc06
I20260709 12:59:41.508200  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 2cddab79a6054062949d1d1c2453cc06 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:42.574828  1677 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:42.584856  1601 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:42.585333  1647 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d76a019fbba44c8bb56f66d12c271c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.586460  2430 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.588276  1525 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.589854  2430 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.602118  2430 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.612272  1526 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.633689  1532 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:42.630326  1601 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.652037  1428 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.678773  1677 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.681681  1601 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:42.684600  1498 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f28aac236b62437d9a0603913d696ce7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.685987  2461 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:42.706601  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46057.7us
W20260709 12:59:42.711867  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50780.9us
I20260709 12:59:42.692342  2468 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:59:42.770018  2478 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.796105  1678 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.821075  1532 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:42.844151  1601 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 12:59:42.867465  1498 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b26794ff1394cec94107fd122031015. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.871176  1677 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.872880  2478 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:59:42.884887  2477 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.887563  1607 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.890674  1678 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.904209  2477 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.942129  1678 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:42.950176  1605 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.961226  1428 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:42.965534  1428 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 12:59:42.976720  1647 consensus_peers.cc:597] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 986af52b7e6d4c60a353dbc998405797. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.977975  1532 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.979311  1601 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:42.980054  2476 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:42.984045  2476 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:43.006699  2475 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:43.013948  1532 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:43.079828  1432 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 12:59:43.086279  2490 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:43.094300  1601 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:43.105140  2491 ts_tablet_manager.cc:933] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:43.126183  2492 ts_tablet_manager.cc:933] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:43.141776  2491 tablet_copy_client.cc:323] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:43.143944  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 2d76a019fbba44c8bb56f66d12c271c5 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:43.144532  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 2d76a019fbba44c8bb56f66d12c271c5 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-2d76a019fbba44c8bb56f66d12c271c5
I20260709 12:59:43.159469  1692 tablet_copy_source_session.cc:215] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.162249  2492 tablet_copy_client.cc:323] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:43.162806  2491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76a019fbba44c8bb56f66d12c271c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.165266  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet f28aac236b62437d9a0603913d696ce7 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:43.165856  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet f28aac236b62437d9a0603913d696ce7 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-f28aac236b62437d9a0603913d696ce7
I20260709 12:59:43.173606  1544 tablet_copy_source_session.cc:215] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.178375  2492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28aac236b62437d9a0603913d696ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.184286  2491 tablet_copy_client.cc:806] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.185007  2491 tablet_copy_client.cc:670] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.189519  2491 tablet_copy_client.cc:538] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.206952  2492 tablet_copy_client.cc:806] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.207655  2492 tablet_copy_client.cc:670] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.214202  2491 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:43.224478  2492 tablet_copy_client.cc:538] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.244748  2492 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:43.254781  2491 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.255677  2491 tablet_bootstrap.cc:492] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:43.256357  2491 ts_tablet_manager.cc:1403] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.006s
I20260709 12:59:43.259760  2491 raft_consensus.cc:359] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.265524  2491 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:43.266239  2491 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.278947  2491 ts_tablet_manager.cc:1434] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:59:43.293069  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2d76a019fbba44c8bb56f66d12c271c5 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:43.293533  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2d76a019fbba44c8bb56f66d12c271c5 on tablet 2d76a019fbba44c8bb56f66d12c271c5 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:43.300359  2492 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.301352  2492 tablet_bootstrap.cc:492] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:43.302099  2492 ts_tablet_manager.cc:1403] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.004s
I20260709 12:59:43.306120  2492 raft_consensus.cc:359] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.306994  2492 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:43.307617  2492 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.309913  2492 ts_tablet_manager.cc:1434] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:43.313197  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-f28aac236b62437d9a0603913d696ce7 received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:43.313640  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-f28aac236b62437d9a0603913d696ce7 on tablet f28aac236b62437d9a0603913d696ce7 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:43.423218  2492 ts_tablet_manager.cc:933] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:43.441356  2492 tablet_copy_client.cc:323] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:43.443269  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 5b26794ff1394cec94107fd122031015 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:43.443881  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 5b26794ff1394cec94107fd122031015 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-5b26794ff1394cec94107fd122031015
I20260709 12:59:43.451648  1544 tablet_copy_source_session.cc:215] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.454962  2492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b26794ff1394cec94107fd122031015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.471601  2492 tablet_copy_client.cc:806] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.472209  2492 tablet_copy_client.cc:670] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.475953  2492 tablet_copy_client.cc:538] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.484624  2492 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:43.524004  2492 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.524979  2492 tablet_bootstrap.cc:492] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:43.525687  2492 ts_tablet_manager.cc:1403] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.000s
I20260709 12:59:43.530552  2492 raft_consensus.cc:359] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.532400  2492 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:43.533102  2492 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.541559  2259 raft_consensus.cc:1217] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:43.546424  2491 ts_tablet_manager.cc:933] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:43.557881  2492 ts_tablet_manager.cc:1434] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:59:43.562047  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5b26794ff1394cec94107fd122031015 received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:43.562521  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5b26794ff1394cec94107fd122031015 on tablet 5b26794ff1394cec94107fd122031015 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:43.590032  2491 tablet_copy_client.cc:323] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:43.600023  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 986af52b7e6d4c60a353dbc998405797 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:43.600677  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 986af52b7e6d4c60a353dbc998405797 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-986af52b7e6d4c60a353dbc998405797
I20260709 12:59:43.618111  2259 raft_consensus.cc:1217] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:43.630492  1692 tablet_copy_source_session.cc:215] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:43.638751  2491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986af52b7e6d4c60a353dbc998405797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.668946  2491 tablet_copy_client.cc:806] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:43.669529  2491 tablet_copy_client.cc:670] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:43.678326  2491 tablet_copy_client.cc:538] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:43.691947  2491 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:43.765892  2491 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:43.771010  2491 tablet_bootstrap.cc:492] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:43.772469  2491 ts_tablet_manager.cc:1403] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.014s
I20260709 12:59:43.775019  2491 raft_consensus.cc:359] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.779809  2491 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:43.780495  2491 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:43.783054  2491 ts_tablet_manager.cc:1434] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:59:43.784857  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-986af52b7e6d4c60a353dbc998405797 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:43.785292  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-986af52b7e6d4c60a353dbc998405797 on tablet 986af52b7e6d4c60a353dbc998405797 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:44.032891  2259 raft_consensus.cc:1217] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:44.036222  2261 raft_consensus.cc:1217] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:44.070953  2476 raft_consensus.cc:1064] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:44.073750  2476 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.086215  2261 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.087208  1601 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.087975  2503 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.089075  1532 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.088905  2443 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.090337  2475 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.122695  2475 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.152670  2259 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.189817  1525 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.196130  1429 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.236739  2477 raft_consensus.cc:1064] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:44.239162  2477 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.252243  1678 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.260847  2259 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.262537  2443 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.266809  1531 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.271832  2503 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.280696  2259 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.281258  1677 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.281993  2461 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.284813  2475 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.288659  2376 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.289636  2260 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.297847  1607 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.298352  1531 raft_consensus.cc:2955] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.300490  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d76a019fbba44c8bb56f66d12c271c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.313854  2477 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.314435  1428 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.343066  2376 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.345136  1605 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.369699  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76a019fbba44c8bb56f66d12c271c5 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:44.376389  1429 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.379801  2517 tablet_replica.cc:333] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:44.383093  2517 raft_consensus.cc:2243] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.384677  2517 pending_rounds.cc:70] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Trying to abort 1 pending ops.
I20260709 12:59:44.388484  2517 pending_rounds.cc:77] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633726759272448 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } } }
I20260709 12:59:44.392364  2517 raft_consensus.cc:2917] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:44.394064  2517 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:44.394542  2517 raft_consensus.cc:2272] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.400797  1682 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.406807  2260 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.399894  2517 ts_tablet_manager.cc:1916] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.434113  1531 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.443353  2260 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.445154  2513 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.448457  2517 ts_tablet_manager.cc:1929] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.448971  2517 log.cc:1199] T 2d76a019fbba44c8bb56f66d12c271c5 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/2d76a019fbba44c8bb56f66d12c271c5
I20260709 12:59:44.450747  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 2d76a019fbba44c8bb56f66d12c271c5 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:44.453138  1682 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.458434  2376 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.460130  2516 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.462277  2260 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.471665  1678 raft_consensus.cc:2955] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.478715  1432 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.489364  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f28aac236b62437d9a0603913d696ce7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.495826  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet f28aac236b62437d9a0603913d696ce7 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:44.496812  2517 tablet_replica.cc:333] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:44.497794  2517 raft_consensus.cc:2243] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.498538  2517 raft_consensus.cc:2272] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.509038  2517 ts_tablet_manager.cc:1916] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.538376  2476 raft_consensus.cc:1064] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:44.541219  2476 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.548759  2517 ts_tablet_manager.cc:1929] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.549224  2517 log.cc:1199] T f28aac236b62437d9a0603913d696ce7 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/f28aac236b62437d9a0603913d696ce7
I20260709 12:59:44.550740  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet f28aac236b62437d9a0603913d696ce7 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:44.560037  2260 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.562959  1525 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.562981  2443 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.564893  2443 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.566380  1605 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.569895  2513 raft_consensus.cc:1064] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:44.577945  2513 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.578810  2476 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.618907  2476 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.627616  1607 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.637073  1531 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.653306  2259 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.647447  1429 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.654995  2461 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.698585  1682 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.700198  2513 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:44.704344  2260 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.721519  1607 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:44.721995  2513 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.726481  1682 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:44.726984  1678 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.739483  2261 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.745306  1607 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.751480  2259 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:44.753867  2476 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:44.761607  2475 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.763294  1607 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.775583  2461 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:44.780782  2503 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:44.785259  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 986af52b7e6d4c60a353dbc998405797 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.788023  2261 raft_consensus.cc:2955] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.793022  1428 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.797031  1430 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.836202  1607 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:44.850193  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 986af52b7e6d4c60a353dbc998405797 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:44.860777  2527 tablet_replica.cc:333] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:44.862013  2527 raft_consensus.cc:2243] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.868188  2527 raft_consensus.cc:2272] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.878727  2527 ts_tablet_manager.cc:1916] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.900825  2527 ts_tablet_manager.cc:1929] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:44.901434  2527 log.cc:1199] T 986af52b7e6d4c60a353dbc998405797 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/986af52b7e6d4c60a353dbc998405797
I20260709 12:59:44.903156  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 986af52b7e6d4c60a353dbc998405797 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:45.198113  1526 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:45.204635  2261 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:45.206187  2513 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.207254  1601 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:45.212783  2477 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.217526  2376 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:45.224618  1601 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:45.225755  2259 raft_consensus.cc:2955] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:45.241550  1428 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:45.259389  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b26794ff1394cec94107fd122031015 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:45.285039  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b26794ff1394cec94107fd122031015 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:45.286779  2529 tablet_replica.cc:333] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:45.294188  2529 raft_consensus.cc:2243] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:45.303821  2529 raft_consensus.cc:2272] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:45.308472  2529 ts_tablet_manager.cc:1916] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:45.331115  2529 ts_tablet_manager.cc:1929] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:45.331568  2529 log.cc:1199] T 5b26794ff1394cec94107fd122031015 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/5b26794ff1394cec94107fd122031015
I20260709 12:59:45.333283  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 5b26794ff1394cec94107fd122031015 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:46.359016  1682 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.365379  1607 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.365655  1531 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:46.365757  1647 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5c7c569add7422d840ba6ea7ea7ac47. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.366931  2475 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.367797  2530 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.375732  2475 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.377841  1607 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.378728  1531 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.398123  1431 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.399446  1682 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.410854  1607 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:46.411645  1647 consensus_peers.cc:597] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bacb2b5d0c24f8685d90eeadc14dce3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.412005  1531 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.412462  2523 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.413806  2530 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.432438  2530 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.437171  1607 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.446236  1531 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.470842  1607 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.473038  1432 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.486853  1678 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:46.487341  1573 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e185a2b036a741ffba1ca49f0dd4cce8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.490213  2439 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.499017  1531 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.501565  2528 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.510164  2439 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.511261  1682 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.516229  1531 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.528508  1432 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.529469  1682 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.544476  1607 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:46.545264  1647 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f99da1afef0249c084ef81484859e823. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.548120  2530 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:46.554111  1531 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:46.555444  2530 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:46.558871  2540 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.560585  1607 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.570525  1525 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:46.582115  1428 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.868736  2551 ts_tablet_manager.cc:933] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:46.870519  2551 tablet_copy_client.cc:323] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:46.872030  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:46.872562  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 5bacb2b5d0c24f8685d90eeadc14dce3 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-5bacb2b5d0c24f8685d90eeadc14dce3
I20260709 12:59:46.878553  1692 tablet_copy_source_session.cc:215] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.881695  2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bacb2b5d0c24f8685d90eeadc14dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.900732  2551 tablet_copy_client.cc:806] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.901407  2551 tablet_copy_client.cc:670] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.906610  2551 tablet_copy_client.cc:538] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:46.916378  2551 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:46.941188  2551 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:46.942163  2551 tablet_bootstrap.cc:492] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:46.942909  2554 ts_tablet_manager.cc:933] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:46.945122  2551 ts_tablet_manager.cc:1403] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.014s
I20260709 12:59:46.952790  2551 raft_consensus.cc:359] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.955036  2551 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:46.958735  2551 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:46.958026  2554 tablet_copy_client.cc:323] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:46.961098  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet e5c7c569add7422d840ba6ea7ea7ac47 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:46.961534  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet e5c7c569add7422d840ba6ea7ea7ac47 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-e5c7c569add7422d840ba6ea7ea7ac47
I20260709 12:59:46.965794  2557 ts_tablet_manager.cc:933] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:46.971704  1692 tablet_copy_source_session.cc:215] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.975369  2554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c7c569add7422d840ba6ea7ea7ac47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.977536  2557 tablet_copy_client.cc:323] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:46.979292  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet e185a2b036a741ffba1ca49f0dd4cce8 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:46.979803  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet e185a2b036a741ffba1ca49f0dd4cce8 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-e185a2b036a741ffba1ca49f0dd4cce8
I20260709 12:59:46.990556  1619 tablet_copy_source_session.cc:215] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.993587  2551 ts_tablet_manager.cc:1434] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.048s	user 0.014s	sys 0.007s
I20260709 12:59:46.994098  2557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e185a2b036a741ffba1ca49f0dd4cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.004552  2554 tablet_copy_client.cc:806] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.005163  2554 tablet_copy_client.cc:670] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.010185  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5bacb2b5d0c24f8685d90eeadc14dce3 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:47.012585  2557 tablet_copy_client.cc:806] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.019157  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5bacb2b5d0c24f8685d90eeadc14dce3 on tablet 5bacb2b5d0c24f8685d90eeadc14dce3 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:47.019850  2557 tablet_copy_client.cc:670] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.022756  2554 tablet_copy_client.cc:538] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.025254  2557 tablet_copy_client.cc:538] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.035917  2557 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:47.044184  2554 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:47.065955  2557 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.066471  2554 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.066898  2557 tablet_bootstrap.cc:492] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:47.067288  2554 tablet_bootstrap.cc:492] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:47.067623  2557 ts_tablet_manager.cc:1403] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.032s	user 0.030s	sys 0.000s
I20260709 12:59:47.070670  2554 ts_tablet_manager.cc:1403] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.009s
I20260709 12:59:47.070721  2557 raft_consensus.cc:359] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.071746  2557 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:47.072458  2557 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.073794  2554 raft_consensus.cc:359] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.074700  2554 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:47.075507  2557 ts_tablet_manager.cc:1434] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:47.076133  2554 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.078019  2554 ts_tablet_manager.cc:1434] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:47.081574  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e185a2b036a741ffba1ca49f0dd4cce8 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:47.081990  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e185a2b036a741ffba1ca49f0dd4cce8 on tablet e185a2b036a741ffba1ca49f0dd4cce8 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:47.084770  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e5c7c569add7422d840ba6ea7ea7ac47 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:47.085162  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e5c7c569add7422d840ba6ea7ea7ac47 on tablet e5c7c569add7422d840ba6ea7ea7ac47 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:47.086285  2551 ts_tablet_manager.cc:933] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:47.092563  2551 tablet_copy_client.cc:323] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:47.094354  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet f99da1afef0249c084ef81484859e823 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:47.094884  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet f99da1afef0249c084ef81484859e823 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-f99da1afef0249c084ef81484859e823
I20260709 12:59:47.102306  1692 tablet_copy_source_session.cc:215] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:47.105531  2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99da1afef0249c084ef81484859e823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.130985  2551 tablet_copy_client.cc:806] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.131628  2551 tablet_copy_client.cc:670] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.135851  2551 tablet_copy_client.cc:538] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.144176  2551 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:47.166285  2551 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.167027  2551 tablet_bootstrap.cc:492] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:47.167565  2551 ts_tablet_manager.cc:1403] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 12:59:47.169755  2551 raft_consensus.cc:359] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.170346  2551 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:47.170814  2551 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:47.172597  2551 ts_tablet_manager.cc:1434] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 12:59:47.174106  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-f99da1afef0249c084ef81484859e823 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:47.174530  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-f99da1afef0249c084ef81484859e823 on tablet f99da1afef0249c084ef81484859e823 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:47.327867  2259 raft_consensus.cc:1217] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.514047  2259 raft_consensus.cc:1217] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.523355  2259 raft_consensus.cc:1217] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.650274  2259 raft_consensus.cc:1217] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:47.754982  2566 raft_consensus.cc:1064] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:47.759605  2566 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:47.779709  2259 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.779811  1607 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.782084  1531 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:47.783347  2540 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:47.784345  2566 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.785354  2569 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:47.811638  2530 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.817121  1532 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.818668  2259 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.830250  1605 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.837852  1428 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.878051  1681 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:47.883541  2259 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:47.884341  1605 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:47.885267  2540 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:47.887277  2566 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.895284  2530 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.900977  2259 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.900612  1605 raft_consensus.cc:2955] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.906563  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:47.916301  1431 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:47.927877  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bacb2b5d0c24f8685d90eeadc14dce3 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:47.940828  2578 tablet_replica.cc:333] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:47.942196  2578 raft_consensus.cc:2243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:47.942997  2578 raft_consensus.cc:2272] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:47.947129  2578 ts_tablet_manager.cc:1916] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:47.961802  2578 ts_tablet_manager.cc:1929] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:47.962338  2578 log.cc:1199] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/5bacb2b5d0c24f8685d90eeadc14dce3
I20260709 12:59:47.964265  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 5bacb2b5d0c24f8685d90eeadc14dce3 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:47.999079  2566 raft_consensus.cc:1064] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:48.004070  2566 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.014173  1607 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.014510  2259 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.015215  1531 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.015925  2530 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.016980  2566 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.017763  2543 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.030653  2543 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.033869  2259 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.037415  1607 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.049420  1531 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.055843  1430 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.084579  2563 raft_consensus.cc:1064] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:48.088213  2563 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.090255  1681 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.103142  1531 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.104979  1681 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.105124  2261 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.106805  2543 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.107152  2439 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.117609  2563 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.117975  1532 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.120579  2584 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.122699  2543 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.128823  2584 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.131975  1677 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.134584  1525 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.150610  1430 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.151266  2261 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.168658  1432 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.108183  2259 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.142015  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5c7c569add7422d840ba6ea7ea7ac47 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.176476  2540 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.198103  2260 raft_consensus.cc:2955] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.227355  2543 raft_consensus.cc:1064] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:48.241117  1532 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.265202  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet e5c7c569add7422d840ba6ea7ea7ac47 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:48.267776  1607 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.274343  2260 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.277437  2590 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.285681  1531 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.280051  2543 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.298496  2593 tablet_replica.cc:333] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:48.297693  2590 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.302096  2593 raft_consensus.cc:2243] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.302946  2593 raft_consensus.cc:2272] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.304979  1531 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.304244  2261 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.307621  1607 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.304296  2260 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:48.310109  2543 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.311278  2568 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.312896  2540 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.319990  2588 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:48.330720  2593 ts_tablet_manager.cc:1916] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.337638  1525 raft_consensus.cc:2955] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.331970  1432 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.333700  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e185a2b036a741ffba1ca49f0dd4cce8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.361250  2568 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.366675  2260 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.373708  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet e185a2b036a741ffba1ca49f0dd4cce8 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:48.394135  1431 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.401875  1531 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.394925  2598 tablet_replica.cc:333] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:48.411127  2598 raft_consensus.cc:2243] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.411438  1681 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:48.403597  1607 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.416286  2593 ts_tablet_manager.cc:1929] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.417729  2593 log.cc:1199] T e5c7c569add7422d840ba6ea7ea7ac47 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/e5c7c569add7422d840ba6ea7ea7ac47
I20260709 12:59:48.419260  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet e5c7c569add7422d840ba6ea7ea7ac47 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:48.419746  2598 raft_consensus.cc:2272] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.426239  2260 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.427469  2530 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.429934  2598 ts_tablet_manager.cc:1916] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.434906  2530 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.441664  2260 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.449864  2598 ts_tablet_manager.cc:1929] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.450415  2598 log.cc:1199] T e185a2b036a741ffba1ca49f0dd4cce8 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/e185a2b036a741ffba1ca49f0dd4cce8
I20260709 12:59:48.452164  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet e185a2b036a741ffba1ca49f0dd4cce8 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:48.454056  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f99da1afef0249c084ef81484859e823 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:48.460816  1525 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:48.463762  1432 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.465426  2540 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.475378  1526 raft_consensus.cc:2955] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:48.488051  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet f99da1afef0249c084ef81484859e823 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:48.489024  2593 tablet_replica.cc:333] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:48.490162  2593 raft_consensus.cc:2243] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:48.490890  2593 raft_consensus.cc:2272] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:48.494369  2593 ts_tablet_manager.cc:1916] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:48.508780  2593 ts_tablet_manager.cc:1929] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:48.509146  2593 log.cc:1199] T f99da1afef0249c084ef81484859e823 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/f99da1afef0249c084ef81484859e823
I20260709 12:59:48.510601  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet f99da1afef0249c084ef81484859e823 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:49.563417  1607 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:49.569973  1677 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.570436  1526 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:49.571295  1573 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abe16ef1967f47ba893ba6ba999c125c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.572455  2588 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.574664  2563 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.581794  2588 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.583499  1526 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.592888  1677 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.600940  1607 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:49.608007  1428 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:49.636991  1573 consensus_peers.cc:597] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1cc245b7bc74c4689e1a1db6fa21301. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.646709  1526 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.652673  2563 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.664539  1677 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.665975  2563 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.671377  1526 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.677124  2592 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:49.720091  1681 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.722631  1677 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:49.735967  1601 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:49.736644  1647 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6791fab1eefc49d1a3e2783c89cac6a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.743150  2530 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.746619  1531 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.745596  1431 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.749956  2530 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.759954  2530 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.763594  1531 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.765461  1601 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.779325  1526 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:49.779008  1432 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:49.806594  1498 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd52876d8a2049db9c781a36366069cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.812969  1677 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.813030  1601 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:49.814692  2599 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.815658  2513 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.825668  2599 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.829625  1677 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.832815  1601 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.853757  1432 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:49.950850  2620 ts_tablet_manager.cc:933] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:49.952941  2620 tablet_copy_client.cc:323] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:49.954838  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet abe16ef1967f47ba893ba6ba999c125c from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:49.955382  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet abe16ef1967f47ba893ba6ba999c125c from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-abe16ef1967f47ba893ba6ba999c125c
I20260709 12:59:49.962180  1619 tablet_copy_source_session.cc:215] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:49.972255  2620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe16ef1967f47ba893ba6ba999c125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:49.992163  2620 tablet_copy_client.cc:806] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:49.994024  2620 tablet_copy_client.cc:670] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.005529  2620 tablet_copy_client.cc:538] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.014390  2620 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:50.031903  2620 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.033008  2620 tablet_bootstrap.cc:492] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:50.033876  2620 ts_tablet_manager.cc:1403] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:59:50.036851  2620 raft_consensus.cc:359] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.037783  2620 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:50.038404  2620 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.041663  2620 ts_tablet_manager.cc:1434] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:50.044718  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-abe16ef1967f47ba893ba6ba999c125c received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:50.045351  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-abe16ef1967f47ba893ba6ba999c125c on tablet abe16ef1967f47ba893ba6ba999c125c with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:50.185648  2620 ts_tablet_manager.cc:933] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:50.192655  2620 tablet_copy_client.cc:323] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:50.194550  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet fd52876d8a2049db9c781a36366069cc from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:50.195001  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet fd52876d8a2049db9c781a36366069cc from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-fd52876d8a2049db9c781a36366069cc
I20260709 12:59:50.202669  1544 tablet_copy_source_session.cc:215] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.206719  2620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd52876d8a2049db9c781a36366069cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.206738  2625 ts_tablet_manager.cc:933] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:50.208760  2625 tablet_copy_client.cc:323] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:50.210736  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 6791fab1eefc49d1a3e2783c89cac6a8 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:50.211318  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 6791fab1eefc49d1a3e2783c89cac6a8 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-6791fab1eefc49d1a3e2783c89cac6a8
I20260709 12:59:50.218719  1692 tablet_copy_source_session.cc:215] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.221463  2625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6791fab1eefc49d1a3e2783c89cac6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.226611  2620 tablet_copy_client.cc:806] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.227376  2620 tablet_copy_client.cc:670] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.231913  2620 tablet_copy_client.cc:538] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.241294  2627 ts_tablet_manager.cc:933] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:50.243281  2620 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:50.245122  2625 tablet_copy_client.cc:806] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.245710  2625 tablet_copy_client.cc:670] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.255882  2627 tablet_copy_client.cc:323] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:50.257669  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet a1cc245b7bc74c4689e1a1db6fa21301 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:50.258322  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet a1cc245b7bc74c4689e1a1db6fa21301 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-a1cc245b7bc74c4689e1a1db6fa21301
I20260709 12:59:50.265604  1619 tablet_copy_source_session.cc:215] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:50.269891  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cc245b7bc74c4689e1a1db6fa21301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:50.278417  2625 tablet_copy_client.cc:538] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.289129  2620 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.290300  2620 tablet_bootstrap.cc:492] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:50.291169  2620 ts_tablet_manager.cc:1403] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.048s	user 0.032s	sys 0.009s
I20260709 12:59:50.293509  2627 tablet_copy_client.cc:806] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:50.294121  2627 tablet_copy_client.cc:670] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:50.294487  2620 raft_consensus.cc:359] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.295418  2620 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:50.296115  2620 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.298691  2620 ts_tablet_manager.cc:1434] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:50.300367  2625 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:50.300627  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-fd52876d8a2049db9c781a36366069cc received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:50.301062  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-fd52876d8a2049db9c781a36366069cc on tablet fd52876d8a2049db9c781a36366069cc with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:50.307341  2627 tablet_copy_client.cc:538] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:50.323643  2627 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:50.326685  2625 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.327912  2625 tablet_bootstrap.cc:492] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:50.328629  2625 ts_tablet_manager.cc:1403] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 12:59:50.331728  2625 raft_consensus.cc:359] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.332687  2625 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:50.333379  2625 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.336045  2625 ts_tablet_manager.cc:1434] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:50.338526  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-6791fab1eefc49d1a3e2783c89cac6a8 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:50.338995  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-6791fab1eefc49d1a3e2783c89cac6a8 on tablet 6791fab1eefc49d1a3e2783c89cac6a8 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:50.356902  2627 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:50.357887  2627 tablet_bootstrap.cc:492] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:50.358613  2627 ts_tablet_manager.cc:1403] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.010s
I20260709 12:59:50.361361  2627 raft_consensus.cc:359] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.362510  2627 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:50.363240  2627 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:50.366612  2627 ts_tablet_manager.cc:1434] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:50.368927  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a1cc245b7bc74c4689e1a1db6fa21301 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:50.369678  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a1cc245b7bc74c4689e1a1db6fa21301 on tablet a1cc245b7bc74c4689e1a1db6fa21301 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:50.545786  2260 raft_consensus.cc:1217] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.716290  2260 raft_consensus.cc:1217] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.738646  2260 raft_consensus.cc:1217] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:50.779887  2260 raft_consensus.cc:1217] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:51.022986  2588 raft_consensus.cc:1064] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:51.025383  2588 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.032812  1681 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.034092  2588 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.034602  2260 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.036367  2606 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.047616  1531 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.050145  2588 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.058736  2588 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.066543  1526 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.072984  1681 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.077615  2261 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.086490  1431 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.116444  1605 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.120512  2261 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.121747  2588 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.124200  1526 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.126114  2588 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.132966  2610 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.135762  1526 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.141564  2261 raft_consensus.cc:2955] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.146484  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abe16ef1967f47ba893ba6ba999c125c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.169343  1428 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.180106  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet abe16ef1967f47ba893ba6ba999c125c with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:51.182094  2644 tablet_replica.cc:333] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:51.183158  2644 raft_consensus.cc:2243] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.183820  2644 raft_consensus.cc:2272] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.191605  2644 ts_tablet_manager.cc:1916] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.205864  2644 ts_tablet_manager.cc:1929] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.206318  2644 log.cc:1199] T abe16ef1967f47ba893ba6ba999c125c P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/abe16ef1967f47ba893ba6ba999c125c
I20260709 12:59:51.207696  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet abe16ef1967f47ba893ba6ba999c125c (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:51.259195  2588 raft_consensus.cc:1064] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:51.261778  2588 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.271688  2261 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.271987  2513 raft_consensus.cc:1064] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:51.274482  1531 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.276696  2610 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.278389  1681 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.280151  2643 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.282197  2643 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.275758  2513 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.301242  2260 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.303092  2634 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.306392  1605 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.311724  2634 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.312856  2588 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.319231  1682 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.323424  2633 raft_consensus.cc:1064] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:51.326217  2633 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.332304  2259 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.338827  2601 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:51.345526  1681 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.372592  1605 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.372502  1531 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.378638  2655 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.382824  1432 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.399667  1605 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.412914  2260 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.428148  2655 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:51.440901  2260 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.442698  2606 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:51.445852  2513 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.452739  2260 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 12:59:51.455173  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 68804.2us
I20260709 12:59:51.448572  1605 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.467963  1683 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.478287  2606 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.474295  2588 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.485131  1430 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.487251  1526 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:51.488649  2646 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.492285  2260 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.494104  1683 raft_consensus.cc:2955] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.500200  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a1cc245b7bc74c4689e1a1db6fa21301 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.512573  1432 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.512549  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet a1cc245b7bc74c4689e1a1db6fa21301 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:51.541476  2661 tablet_replica.cc:333] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:51.542642  2661 raft_consensus.cc:2243] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.548533  2661 raft_consensus.cc:2272] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.549072  2633 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.560586  2661 ts_tablet_manager.cc:1916] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.563495  1601 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.575219  1681 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.579126  1430 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.594267  2661 ts_tablet_manager.cc:1929] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.602902  2661 log.cc:1199] T a1cc245b7bc74c4689e1a1db6fa21301 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/a1cc245b7bc74c4689e1a1db6fa21301
I20260709 12:59:51.594147  2260 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.595038  1526 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.619050  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet a1cc245b7bc74c4689e1a1db6fa21301 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:51.622602  1526 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.639168  1683 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:51.647774  2260 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.650128  2634 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.659518  2634 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.661437  2259 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.664935  2260 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.666273  2530 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.668231  1531 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.679860  2646 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.679998  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd52876d8a2049db9c781a36366069cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.685345  1432 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.686308  1601 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:51.689646  2601 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:51.692190  2261 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.693673  2633 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.709640  1601 raft_consensus.cc:2955] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.709700  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet fd52876d8a2049db9c781a36366069cc with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:51.719277  1534 raft_consensus.cc:2955] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.731850  1430 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:51.742792  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6791fab1eefc49d1a3e2783c89cac6a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.743657  2663 tablet_replica.cc:333] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:51.744803  2663 raft_consensus.cc:2243] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.745640  2663 raft_consensus.cc:2272] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.759747  2663 ts_tablet_manager.cc:1916] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.760483  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 6791fab1eefc49d1a3e2783c89cac6a8 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:51.769503  2664 tablet_replica.cc:333] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:51.770534  2664 raft_consensus.cc:2243] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.771111  2664 raft_consensus.cc:2272] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.774869  2664 ts_tablet_manager.cc:1916] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.776510  2663 ts_tablet_manager.cc:1929] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.776983  2663 log.cc:1199] T fd52876d8a2049db9c781a36366069cc P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/fd52876d8a2049db9c781a36366069cc
I20260709 12:59:51.778165  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet fd52876d8a2049db9c781a36366069cc (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:51.786415  2664 ts_tablet_manager.cc:1929] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:51.786906  2664 log.cc:1199] T 6791fab1eefc49d1a3e2783c89cac6a8 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/6791fab1eefc49d1a3e2783c89cac6a8
I20260709 12:59:51.788583  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 6791fab1eefc49d1a3e2783c89cac6a8 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:52.834697  1601 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:52.840550  1683 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:52.840916  1573 consensus_peers.cc:597] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2dc6f62776f4719aaae2fc36e4d078e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.841861  1525 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.841887  2610 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:52.843786  2667 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:59:52.850734  2667 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:52.852762  1676 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:52.865962  1525 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:52.867462  1676 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:52.871829  1428 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:52.882933  1601 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:52.883438  1647 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13e1eb7aa954478d88a68ebc9f886898. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.885897  1534 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:52.893313  2530 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:52.918337  2646 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:52.942827  1526 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:52.931162  2665 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.021175  1601 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.021349  1607 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.035326  1430 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 12:59:53.039417  1573 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55c2050eecb74fbbae8aea2d609c6833. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:53.042796  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:53.054800  2606 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:53.056996  1683 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:53.058807  2606 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:53.082653  2677 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.089737  1526 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.090529  1676 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.098912  1601 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.101651  1428 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.115273  1681 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:53.115746  1534 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:53.116647  1573 consensus_peers.cc:597] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 055cfab17a334683a9350a659118ac99. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:53.117708  2667 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:53.122699  2667 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:53.134191  2667 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.135936  1534 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.138945  1676 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:53.165974  1430 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.414824  2688 ts_tablet_manager.cc:933] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:53.418560  2688 tablet_copy_client.cc:323] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:53.420548  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet c2dc6f62776f4719aaae2fc36e4d078e from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:53.421069  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet c2dc6f62776f4719aaae2fc36e4d078e from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-c2dc6f62776f4719aaae2fc36e4d078e
I20260709 12:59:53.429678  1619 tablet_copy_source_session.cc:215] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.432828  2690 ts_tablet_manager.cc:933] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:53.440337  2688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dc6f62776f4719aaae2fc36e4d078e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.447625  2690 tablet_copy_client.cc:323] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:53.449858  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 55c2050eecb74fbbae8aea2d609c6833 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:53.450434  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 55c2050eecb74fbbae8aea2d609c6833 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-55c2050eecb74fbbae8aea2d609c6833
I20260709 12:59:53.465366  2688 tablet_copy_client.cc:806] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.466091  2688 tablet_copy_client.cc:670] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.468743  2692 ts_tablet_manager.cc:933] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:53.469754  1619 tablet_copy_source_session.cc:215] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.471879  2688 tablet_copy_client.cc:538] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.483619  2688 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:53.486332  2690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c2050eecb74fbbae8aea2d609c6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.499840  2692 tablet_copy_client.cc:323] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:53.502352  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 13e1eb7aa954478d88a68ebc9f886898 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:53.503006  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 13e1eb7aa954478d88a68ebc9f886898 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-13e1eb7aa954478d88a68ebc9f886898
I20260709 12:59:53.511273  1692 tablet_copy_source_session.cc:215] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.514859  2690 tablet_copy_client.cc:806] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.515476  2690 tablet_copy_client.cc:670] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.517951  2692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e1eb7aa954478d88a68ebc9f886898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.547580  2688 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.548934  2688 tablet_bootstrap.cc:492] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:53.549834  2688 ts_tablet_manager.cc:1403] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.016s
I20260709 12:59:53.553140  2688 raft_consensus.cc:359] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.554104  2688 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:53.554828  2688 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.560410  2692 tablet_copy_client.cc:806] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.561062  2692 tablet_copy_client.cc:670] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.563782  2690 tablet_copy_client.cc:538] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.570490  2688 ts_tablet_manager.cc:1434] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 12:59:53.585775  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-c2dc6f62776f4719aaae2fc36e4d078e received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:53.586606  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-c2dc6f62776f4719aaae2fc36e4d078e on tablet c2dc6f62776f4719aaae2fc36e4d078e with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:53.594677  2692 tablet_copy_client.cc:538] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.605068  2690 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:53.612643  2692 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:53.648353  2690 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.649401  2690 tablet_bootstrap.cc:492] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:53.650104  2690 ts_tablet_manager.cc:1403] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.010s
I20260709 12:59:53.653318  2690 raft_consensus.cc:359] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.654206  2690 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:53.654877  2690 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.660190  2692 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.661165  2692 tablet_bootstrap.cc:492] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:53.661859  2692 ts_tablet_manager.cc:1403] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.009s
I20260709 12:59:53.665863  2690 ts_tablet_manager.cc:1434] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:59:53.665020  2692 raft_consensus.cc:359] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.668015  2692 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:53.669179  2692 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.669745  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-55c2050eecb74fbbae8aea2d609c6833 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:53.670250  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-55c2050eecb74fbbae8aea2d609c6833 on tablet 55c2050eecb74fbbae8aea2d609c6833 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:53.672165  2692 ts_tablet_manager.cc:1434] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:59:53.675777  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-13e1eb7aa954478d88a68ebc9f886898 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:53.676203  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-13e1eb7aa954478d88a68ebc9f886898 on tablet 13e1eb7aa954478d88a68ebc9f886898 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:53.712131  2692 ts_tablet_manager.cc:933] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:53.713884  2692 tablet_copy_client.cc:323] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:53.715695  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 055cfab17a334683a9350a659118ac99 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:53.716157  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 055cfab17a334683a9350a659118ac99 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-055cfab17a334683a9350a659118ac99
I20260709 12:59:53.724644  1619 tablet_copy_source_session.cc:215] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:53.727909  2692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055cfab17a334683a9350a659118ac99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.744454  2692 tablet_copy_client.cc:806] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:53.745026  2692 tablet_copy_client.cc:670] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:53.752286  2692 tablet_copy_client.cc:538] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:53.763271  2692 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:53.788767  2692 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:53.789670  2692 tablet_bootstrap.cc:492] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:53.790364  2692 ts_tablet_manager.cc:1403] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.027s	user 0.027s	sys 0.000s
I20260709 12:59:53.793151  2692 raft_consensus.cc:359] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.793769  2692 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:53.794308  2692 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:53.796567  2692 ts_tablet_manager.cc:1434] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:59:53.798626  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-055cfab17a334683a9350a659118ac99 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:53.799042  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-055cfab17a334683a9350a659118ac99 on tablet 055cfab17a334683a9350a659118ac99 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:53.881315  2261 raft_consensus.cc:1217] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:54.021687  2259 raft_consensus.cc:1217] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:54.097931  2261 raft_consensus.cc:1217] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:54.278183  2261 raft_consensus.cc:1217] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:54.309427  2606 raft_consensus.cc:1064] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:54.311843  2606 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.318631  1683 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.318930  2261 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.320086  2606 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.320602  1534 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.320994  2667 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.321928  2699 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.332338  2606 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.342732  1683 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.347747  2261 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.359122  1428 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.360693  1534 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.406339  1601 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.412055  2261 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.413635  2667 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.414532  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.420472  2667 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.422441  2606 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.429386  2261 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.431968  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55c2050eecb74fbbae8aea2d609c6833 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.441533  1534 raft_consensus.cc:2955] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.447273  1432 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.465838  2700 raft_consensus.cc:1064] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:54.467231  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 55c2050eecb74fbbae8aea2d609c6833 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:54.469537   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:54.469043  2700 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.480074  2713 tablet_replica.cc:333] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:54.481305  2713 raft_consensus.cc:2243] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.482080  2713 raft_consensus.cc:2272] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.490888  2713 ts_tablet_manager.cc:1916] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.494318  1601 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.497326  2259 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.498903  2703 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.500833  2703 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.510926  1534 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.512925  2700 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.525669  2700 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.529800  1525 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.531520  2259 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.560207  2713 ts_tablet_manager.cc:1929] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.560701  2713 log.cc:1199] T 55c2050eecb74fbbae8aea2d609c6833 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/55c2050eecb74fbbae8aea2d609c6833
I20260709 12:59:54.561059  1432 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.562646  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 55c2050eecb74fbbae8aea2d609c6833 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:54.565297  1601 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.587560  1683 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.598716  2259 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.600479  2674 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.602145  1525 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.603406  2665 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.608243  2700 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.614470  2260 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.626863  1534 raft_consensus.cc:2955] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.629133  2667 raft_consensus.cc:1064] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:54.643029  2667 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.660866  1431 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.663709  2260 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.666283  2667 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.668298  1681 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.671022  2667 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.678956  1526 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.681140  2699 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.703868  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13e1eb7aa954478d88a68ebc9f886898 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.710709  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:54.711381  1601 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:54.716660  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e1eb7aa954478d88a68ebc9f886898 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 12:59:54.717285  2667 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.718629  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53808273f23f45848ad55ddef1799643"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:54.719200  1607 raft_consensus.cc:606] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:54.720954  2724 tablet_replica.cc:333] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 12:59:54.722127  2724 raft_consensus.cc:2243] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.723016  2724 raft_consensus.cc:2272] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.726797  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:54.727432  1601 raft_consensus.cc:606] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:54.733269  1526 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.739938  2724 ts_tablet_manager.cc:1916] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.746805  2260 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.760845  2708 raft_consensus.cc:993] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:54.761440  2708 raft_consensus.cc:1081] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:54.764160  1525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 12:59:54.764798  1525 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.764899  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:54.764551  1678 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.765620  1683 raft_consensus.cc:606] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:54.765175  1525 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.770484  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:54.771081  1607 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:54.772979  1430 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.776978  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:54.777627  1607 raft_consensus.cc:606] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:54.789853  2699 raft_consensus.cc:993] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:54.790333  2699 raft_consensus.cc:1081] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:54.791113  2724 ts_tablet_manager.cc:1929] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.791539  2724 log.cc:1199] T 13e1eb7aa954478d88a68ebc9f886898 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/13e1eb7aa954478d88a68ebc9f886898
I20260709 12:59:54.792791  1525 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:54.795385  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53808273f23f45848ad55ddef1799643"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:59:54.796029  2260 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.796403  2260 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.798400  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:54.799110  1683 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.808094  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 13e1eb7aa954478d88a68ebc9f886898 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:54.810113  1683 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:54.811139  1525 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:54.812367  1607 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.813313  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:54.814152  2513 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:54.814579  2513 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:54.815357  2513 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:54.818028  2260 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.822197  2260 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:54.823259  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:54.823467  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:54.824330  1601 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:54.824777  1601 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:54.825583  1601 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.826784  1601 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.824157  1525 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.833213  1683 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.835162  2260 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.835268  2606 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.837786  2667 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.846083  1525 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 12:59:54.846276  2667 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.848193  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:54.849376  2695 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:54.855077  1683 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.867764  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:54.871598  1605 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:54.871898  1605 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:54.872849  1605 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:54.863802  1601 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 12:59:54.876575  2260 raft_consensus.cc:2955] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.883584  1605 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.885883  2606 raft_consensus.cc:1064] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:54.888932  2606 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.889986  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2dc6f62776f4719aaae2fc36e4d078e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.891227  1432 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:54.913022  2695 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:54.958333  1605 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:54.971801  1430 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.973306  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet c2dc6f62776f4719aaae2fc36e4d078e with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:54.981333  2259 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.982676  2695 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:54.983206  2606 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.985993  1526 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:54.990792  2733 tablet_replica.cc:333] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:54.994130  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:59:55.000451  1525 raft_consensus.cc:606] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:55.003566  2733 raft_consensus.cc:2243] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:55.004437  2733 raft_consensus.cc:2272] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:55.006124  1676 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:55.015913   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:59:55.017635   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:55.019778  2667 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:55.022210  2700 raft_consensus.cc:993] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:55.022742  2665 raft_consensus.cc:1081] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:55.031762  2667 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.032349  1601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 12:59:55.032889  1601 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.033214  1601 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.034061  2729 raft_consensus.cc:993] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.034549  2729 raft_consensus.cc:1081] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.039098  2259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:59:55.039693  2259 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.040892  1601 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.039952  2729 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.040033  2259 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.019999  2733 ts_tablet_manager.cc:1916] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:55.045475  1526 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.047150  1601 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:55.055195  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:55.055765  1683 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.056048  1683 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:55.056800  1683 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.057976  1683 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.059670  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:55.060294  1525 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.066089  1683 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:55.067799  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:55.068867  2606 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.069327  2606 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:55.070333  2606 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.072861  2634 raft_consensus.cc:993] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.071869  1678 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.073369  2634 raft_consensus.cc:1081] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.076745  2259 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.092763  2259 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:55.077730  2261 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.092950  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:55.093750  1676 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.079098  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48942
I20260709 12:59:55.096629  2260 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.097023  2260 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.097973  2733 ts_tablet_manager.cc:1929] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:55.098428  2733 log.cc:1199] T c2dc6f62776f4719aaae2fc36e4d078e P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/c2dc6f62776f4719aaae2fc36e4d078e
I20260709 12:59:55.100553  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet c2dc6f62776f4719aaae2fc36e4d078e (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:55.068149  1525 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:55.093304  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:55.103330  1605 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.103735  1605 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:55.104815  1605 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.106130  1605 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.108390  1432 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.107928  1676 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.109359  1428 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.110839  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:55.111855  2695 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.112344  2695 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:55.113170  2695 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.124755  1430 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.141450  2260 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.144709  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:55.145308  1525 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.145633  1525 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:55.146378  1525 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.147475  1525 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.161875  1525 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.164064  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:55.164778  1676 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.165135  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:55.166184  2728 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.166436  1601 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.163827  2260 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:55.171984  1676 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.175292  1605 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.179874  2728 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:55.185282  2261 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:55.184520  1430 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.181137  2728 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.187294  2729 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.193272  1676 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:55.200086  2729 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:55.206369  2729 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.211884  2259 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.214617  2708 raft_consensus.cc:993] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.215673  2708 raft_consensus.cc:1081] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:55.216723  1678 raft_consensus.cc:2955] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:55.219357  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:59:55.219929  2260 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.220265  2260 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.226485  1683 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.229557  2513 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.230875  2260 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.239230  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 055cfab17a334683a9350a659118ac99 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:55.239959  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:55.240531  1526 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.250140  1430 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.259889  2708 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:55.262523  2708 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:55.262408  2260 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:55.265645  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:55.266304  1526 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.266937  1605 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.267055  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 055cfab17a334683a9350a659118ac99 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:55.267728  1605 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:55.267590  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:55.268296  2733 tablet_replica.cc:333] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:55.268868  1605 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.269860  1605 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.271288  2728 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.271808  2728 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:55.272666  2728 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:55.275972  1605 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:55.290370  1525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 12:59:55.304874  1430 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.306492  1525 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.306912  1525 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.290673  2733 raft_consensus.cc:2243] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:55.307747  2733 raft_consensus.cc:2272] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:55.314625  2733 ts_tablet_manager.cc:1916] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:55.319584  1525 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.323242  1525 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:55.324147  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:55.324805  1676 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.325310  1432 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.330731  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:55.330961  2733 ts_tablet_manager.cc:1929] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:55.331467  2733 log.cc:1199] T 055cfab17a334683a9350a659118ac99 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/055cfab17a334683a9350a659118ac99
I20260709 12:59:55.331974  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:55.333015  2731 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.334887  2731 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:55.335947  2731 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.348228  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 055cfab17a334683a9350a659118ac99 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:55.348522  1605 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.348199  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:55.349720  1601 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.350011  1601 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:55.350771  1601 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:55.361119  2731 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.356767  1601 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.366214  1432 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.385488  1534 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:55.382328  1601 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:55.388074  2728 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:55.408037  1605 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:55.410640  2740 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:55.495932  1605 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.497287  2728 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.513741  1678 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.515290  2740 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.577621  1678 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.578974  2729 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.590024  1534 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.591755  2708 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.607591  1678 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.609004  2740 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.618810  1534 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.620028  2741 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.790866  1534 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.792289  2741 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.802012  1605 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.803455  2740 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.839323  1605 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.840574  2745 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.849885  1676 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.851220  2731 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.018771   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.058765   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.111076  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:56.111769  1678 raft_consensus.cc:606] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:56.114578  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:56.115200  1605 raft_consensus.cc:606] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:56.117856  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:56.118366  1678 raft_consensus.cc:606] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:56.120692  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:56.121155  1678 raft_consensus.cc:606] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:56.124090  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:56.124688  1605 raft_consensus.cc:606] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:56.127905  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:59:56.128572  1534 raft_consensus.cc:606] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:56.129904   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:56.131268   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:56.201870  2729 raft_consensus.cc:993] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.202390  2730 raft_consensus.cc:1081] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.203918  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:59:56.204412  2260 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.204700  2260 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.209987  2260 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.211730  2260 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:56.212437  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:56.212682  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:56.213020  1526 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.213187  1605 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.213514  1605 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:56.214426  1605 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.215634  1605 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.219875  1526 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.221361  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:56.221984  1605 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.222187  2728 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.222784  2728 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:56.223663  2728 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.232774  1432 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.288520  2764 raft_consensus.cc:993] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.289067  2700 raft_consensus.cc:1081] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.290904  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:59:56.291558  2260 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.291971  2260 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.300136  2260 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.302991  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:56.303347  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:56.303594  1607 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.303894  1678 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.304491  1678 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:56.305403  1678 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.307236  2260 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:56.308907  1678 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.314762  1678 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.314816  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.316155  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:56.316965  2728 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.317451  2728 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:56.318305  2728 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.330315  1432 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.363195  2634 raft_consensus.cc:993] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:56.363832  2745 raft_consensus.cc:1081] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:56.366250  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44456
I20260709 12:59:56.366838  1605 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.367389  1605 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.375222  1605 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.377104  1605 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:56.377341  1607 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:56.382016  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:56.382586  1526 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.382881  1526 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:56.383369  1683 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.383580  1526 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.383555  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:56.385257  2729 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.385870  1678 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.393127  1678 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 12:59:56.393636  1573 consensus_peers.cc:597] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01534d11942740ccb67a981fcde65180. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.394251  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:56.385257  1526 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.395591  2729 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.396888  1525 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.397226  2729 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:56.398023  2729 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.404666  2730 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.423435  2730 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.435384  1683 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.440915  1534 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.442642  1526 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:56.451457  1531 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:56.465919  1607 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:56.466236  1498 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 368dba0d8eac439897c0b05b32e05500. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.466053  1432 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.467658  2634 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.467376  1683 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:56.474150  1431 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.476948  2634 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.491638  2700 raft_consensus.cc:993] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.492136  2700 raft_consensus.cc:1081] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.493877  2259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:59:56.494525  2259 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.494918  2259 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.497473  2731 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.499439  1607 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.511132  1683 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.512614  2259 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.515473  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:56.515985  1531 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.522132  1531 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.523164  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:56.523926  2728 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.524576  2728 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:56.525127  2730 raft_consensus.cc:993] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.525591  2730 raft_consensus.cc:1081] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:56.525383  2728 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.527236  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:59:56.527737  2260 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.528043  2260 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.530606  1430 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.538709  2260 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.541800  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:56.541935  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:56.542392  1607 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.542547  1526 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.542747  1607 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 12:59:56.543330  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet 75b33947f35745f4809f8a533ebbdaf8: Remote error: Service unavailable: leader transfer in progress
I20260709 12:59:56.543802  1607 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.544648  1607 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.547583  2259 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:56.550007  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:56.550618  1678 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.550871  1678 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:56.551421  1607 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.551561  1678 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.552577  1678 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.542910  2260 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:56.552568  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 12:59:56.554859  2728 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.555305  2728 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:56.556090  2728 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:56.557842  1428 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.552587  1526 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.570228  1683 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:56.574235  1678 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:56.582593  1607 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:56.583901  1526 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:56.585721  2764 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:56.586892  1647 consensus_peers.cc:597] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b401d5a3c6a44966a0c0a7453f379808. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.587468  2700 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:56.590751  1428 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.596168  2764 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.597877  1607 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.602222  1526 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:56.616410  2700 raft_consensus.cc:993] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:56.616879  2674 raft_consensus.cc:1081] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:56.618465  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 12:59:56.619063  1605 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.619421  1605 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.629801  1428 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.626892  1605 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.635623  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:56.636270  1526 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.638983  1605 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:56.640177  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:56.640784  1683 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.641072  1683 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:56.641767  1683 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.642949  1683 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.656699  1683 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:56.657727  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:56.658007  1526 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:56.658519  2730 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.659032  2730 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:56.659865  2730 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:56.670897  1601 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.672520  2728 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.682858  1526 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.684427  2728 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.703317  1430 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.758637  1607 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.759761  2728 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.771932  1683 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.773439  2695 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.788475  1678 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:56.790122  2708 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.855146  1526 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:56.858351  2729 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:56.948590  1526 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.950508  2728 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.954236  2796 ts_tablet_manager.cc:933] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:56.964834  2796 tablet_copy_client.cc:323] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 12:59:56.970841  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 01534d11942740ccb67a981fcde65180 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 12:59:56.971385  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 01534d11942740ccb67a981fcde65180 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-01534d11942740ccb67a981fcde65180
I20260709 12:59:56.975715  1678 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.979678  2790 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:56.991110  1619 tablet_copy_source_session.cc:215] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.000595  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01534d11942740ccb67a981fcde65180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.028405  2796 tablet_copy_client.cc:806] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.029093  2796 tablet_copy_client.cc:670] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.033411  2796 tablet_copy_client.cc:538] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.044782  2796 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:57.048606  2800 ts_tablet_manager.cc:933] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 12:59:57.060993  2800 tablet_copy_client.cc:323] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 12:59:57.062860  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 368dba0d8eac439897c0b05b32e05500 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 12:59:57.063441  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 368dba0d8eac439897c0b05b32e05500 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-368dba0d8eac439897c0b05b32e05500
I20260709 12:59:57.069924  2796 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.071436  2796 tablet_bootstrap.cc:492] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:57.072212  2796 ts_tablet_manager.cc:1403] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 12:59:57.075358  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:57.075876  2796 raft_consensus.cc:359] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.076733  2796 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:57.077505  2790 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:57.077358  2796 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.080175  2796 ts_tablet_manager.cc:1434] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:57.082661  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-01534d11942740ccb67a981fcde65180 received from {username='slave'} at 127.0.0.1:49526
I20260709 12:59:57.083112  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-01534d11942740ccb67a981fcde65180 on tablet 01534d11942740ccb67a981fcde65180 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:57.085145  1544 tablet_copy_source_session.cc:215] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.089557  2800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368dba0d8eac439897c0b05b32e05500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.097357  1605 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:57.099574  2695 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:57.122552  1531 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.124262  2730 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.132166   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:57.143023  2800 tablet_copy_client.cc:806] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.143846  2800 tablet_copy_client.cc:670] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.152283  2800 tablet_copy_client.cc:538] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.165478  1678 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.167745  2729 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.201220  2796 ts_tablet_manager.cc:933] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:57.231252  2796 tablet_copy_client.cc:323] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 12:59:57.211570  2800 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:57.244539  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet b401d5a3c6a44966a0c0a7453f379808 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 12:59:57.245126  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet b401d5a3c6a44966a0c0a7453f379808 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-b401d5a3c6a44966a0c0a7453f379808
I20260709 12:59:57.256934  1692 tablet_copy_source_session.cc:215] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.262903  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b401d5a3c6a44966a0c0a7453f379808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.268501   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:57.281958  2796 tablet_copy_client.cc:806] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:57.282601  2796 tablet_copy_client.cc:670] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:57.286484  2796 tablet_copy_client.cc:538] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:57.300498  2796 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 12:59:57.301788  2800 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.303442  2800 tablet_bootstrap.cc:492] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:57.304103  2800 ts_tablet_manager.cc:1403] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.010s
I20260709 12:59:57.306996  2800 raft_consensus.cc:359] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.307811  2800 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:57.308431  2800 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.314195  2800 ts_tablet_manager.cc:1434] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:59:57.316571  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-368dba0d8eac439897c0b05b32e05500 received from {username='slave'} at 127.0.0.1:56406
I20260709 12:59:57.316991  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-368dba0d8eac439897c0b05b32e05500 on tablet 368dba0d8eac439897c0b05b32e05500 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:57.347868  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:57.348500  1678 raft_consensus.cc:606] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:57.351531  2796 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:57.352453  2796 tablet_bootstrap.cc:492] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 12:59:57.353206  2796 ts_tablet_manager.cc:1403] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.014s
I20260709 12:59:57.358105  2796 raft_consensus.cc:359] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.358955  2796 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 12:59:57.359750  2796 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:57.364053  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:57.364673  1678 raft_consensus.cc:606] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:57.365451  2796 ts_tablet_manager.cc:1434] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:59:57.368964  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-b401d5a3c6a44966a0c0a7453f379808 received from {username='slave'} at 127.0.0.1:33564
I20260709 12:59:57.369380  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-b401d5a3c6a44966a0c0a7453f379808 on tablet b401d5a3c6a44966a0c0a7453f379808 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 12:59:57.369887  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:57.370446  1607 raft_consensus.cc:606] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:57.374049  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:59:57.374256  2260 raft_consensus.cc:1217] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.374609  1526 raft_consensus.cc:606] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:57.381489   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:57.383678   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:57.417657  2260 raft_consensus.cc:1217] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.456008  2700 raft_consensus.cc:993] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:57.456528  2700 raft_consensus.cc:1081] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:57.458240  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 12:59:57.458636  1607 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.458870  1607 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.463610  1607 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.466238  1607 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:57.466972  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:57.468022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:57.468920  1531 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.469036  1683 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.469580  1683 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:57.470088  1683 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.470880  1683 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.475461  1531 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:57.476636  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:57.477416  2729 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.477850  2729 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:57.478541  1683 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:57.478664  2729 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.495918  1431 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.607127  2634 raft_consensus.cc:993] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:57.608284  2634 raft_consensus.cc:1081] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:57.615991  2700 raft_consensus.cc:993] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:57.615991  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 12:59:57.616818  2700 raft_consensus.cc:1081] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 12:59:57.617206  1683 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.617712  1683 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.618965  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:59:57.619609  2260 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.619958  2260 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.628638  1683 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.628638  2260 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:57.632372  1683 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:57.633905  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:57.634756  1525 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.635278  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:57.635831  1531 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.636108  1531 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:57.637051  1531 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.638589  1531 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.642867  1525 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:57.645493  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:57.647022  2804 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.659464  1531 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 12:59:57.665036  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:57.665892  2261 raft_consensus.cc:1217] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:57.665985  1607 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.672402  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:57.674706  2764 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.675196  2764 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:57.675892  2804 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 12:59:57.677240  2804 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:57.678020  1607 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 12:59:57.680606  2764 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.685400  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:57.686336  1683 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.686734  1683 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:57.687809  1683 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:57.688994  1683 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.692854  2260 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:57.693372  1428 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.705308  1683 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 12:59:57.719379  1431 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.787714  2730 raft_consensus.cc:993] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:57.788573  2730 raft_consensus.cc:1081] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:57.795971  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 12:59:57.796640  1678 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.797065  1678 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.825608  1678 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.828003  1678 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:57.829474  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:57.830175  1607 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.830252  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:57.831852  1607 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:57.832944  1607 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.833568  1532 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.833978  1607 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.841341  1532 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 12:59:57.842397  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:57.843113  2764 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.843995  2764 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:57.844980  2764 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:57.846946  1607 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 12:59:57.864522  1428 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.876116  1532 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.877622  2730 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.899468  2708 raft_consensus.cc:1064] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:57.902590  2708 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:57.910135  1678 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.914842  2828 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:59:57.921422  2260 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.921589  1678 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.923476  2827 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:57.924752  2729 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:57.926964  1531 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.954983  2828 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:57.981003  2827 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:57.991300  1676 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.007129  2811 raft_consensus.cc:1064] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:58.010699  2811 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:58.022603  1532 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.027345  2261 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.031584  1430 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.032930  2260 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.039214  2731 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:58.045424  1678 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.047637  1607 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:58.047407  2811 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.052418  2731 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.054833  2674 raft_consensus.cc:1064] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 12:59:58.057737  2674 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:58.108703  2634 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.113722  1604 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:58.116279  1607 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.121605  1605 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:58.126983  1532 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:58.128480  2700 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.129257  1676 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.130672  2700 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.133659  2261 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.135303  2729 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.146747  2828 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.147946  1678 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.150482  2260 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:58.149041  2261 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.152849  2764 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.157899  1430 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.163677  2827 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:58.163772  1683 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.167215  2817 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:58.169883  2259 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.174849  1678 raft_consensus.cc:2955] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.176324  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01534d11942740ccb67a981fcde65180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:58.189899  1428 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 3 to 4, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.203431  2700 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.214337  1531 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.226145  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 01534d11942740ccb67a981fcde65180 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:58.235224  1607 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.231591  1525 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:58.249284  2261 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.249447  1604 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:58.256039  2811 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.257419  2731 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.261234  1532 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.266619  2731 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.274837  2818 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:58.277431  1605 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:58.279088  2700 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:58.295421  1532 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:58.302006  1431 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 3 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.307682  1531 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:58.307482  2700 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:58.309742  2845 tablet_replica.cc:333] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:58.313314  2845 raft_consensus.cc:2243] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.310904  2260 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.314746  2764 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:58.317318  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 368dba0d8eac439897c0b05b32e05500 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:58.322975  1605 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:58.324856  2845 raft_consensus.cc:2272] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.324759  2764 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:58.290283  1604 raft_consensus.cc:2955] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.396770   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:58.406662  1428 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.408915  2845 ts_tablet_manager.cc:1916] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:58.412439  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79881.3us
I20260709 12:59:58.414469  2258 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.420933  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 368dba0d8eac439897c0b05b32e05500 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 12:59:58.473768  2852 tablet_replica.cc:333] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 12:59:58.523147  2852 raft_consensus.cc:2243] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.524048  2852 raft_consensus.cc:2272] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:58.559245  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59174us
I20260709 12:59:58.641690  1682 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 12:59:58.653728  2852 ts_tablet_manager.cc:1916] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:58.658128  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 107753us
I20260709 12:59:58.661302  2845 ts_tablet_manager.cc:1929] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:58.661893  2845 log.cc:1199] T 01534d11942740ccb67a981fcde65180 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/01534d11942740ccb67a981fcde65180
I20260709 12:59:58.676988  2260 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.680516  2852 ts_tablet_manager.cc:1929] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:58.681056  2852 log.cc:1199] T 368dba0d8eac439897c0b05b32e05500 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/368dba0d8eac439897c0b05b32e05500
I20260709 12:59:58.682325  2858 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:58.684022  1605 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.684667  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 01534d11942740ccb67a981fcde65180 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:58.692905  2860 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:58.695734  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 368dba0d8eac439897c0b05b32e05500 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:58.717024  2846 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.718739  1604 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.737357  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b401d5a3c6a44966a0c0a7453f379808 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:58.749271  2260 raft_consensus.cc:2955] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.756178  1430 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 4 to 5, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 12:59:58.769444  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet b401d5a3c6a44966a0c0a7453f379808 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46308
I20260709 12:59:58.770627  2845 tablet_replica.cc:333] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 12:59:58.771734  2845 raft_consensus.cc:2243] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.772456  2845 raft_consensus.cc:2272] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.781239  2845 ts_tablet_manager.cc:1916] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:58.807060  2845 ts_tablet_manager.cc:1929] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:58.807493  2845 log.cc:1199] T b401d5a3c6a44966a0c0a7453f379808 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/b401d5a3c6a44966a0c0a7453f379808
I20260709 12:59:58.809216  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet b401d5a3c6a44966a0c0a7453f379808 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 12:59:58.810559   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:58.846227  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 12:59:58.846678  1604 raft_consensus.cc:606] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 12:59:58.849105  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:59:58.849499  1534 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 12:59:58.852070  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 12:59:58.852509  1682 raft_consensus.cc:606] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 12:59:58.853646   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:58.855614   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:59.198868  2856 raft_consensus.cc:993] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:59.199462  2826 raft_consensus.cc:1081] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 12:59:59.200932  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 12:59:59.201407  1534 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.201745  1534 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.208850  1534 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.211366  1534 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:59.212179  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:59.212795  1605 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.213081  1605 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:59.213826  1605 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.214133  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:59.214617  1682 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.214768  1605 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.221068  1682 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:59.222514  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:59.222744  1605 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 12:59:59.223217  2634 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.227828  2634 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:59.229187  2634 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.239440  1431 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.314265  2863 raft_consensus.cc:993] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:59.314733  2860 raft_consensus.cc:1081] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 12:59:59.315161  2634 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:59.315630  2859 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 12:59:59.316087  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 12:59:59.316697  1605 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.317003  1605 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.317286  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 12:59:59.317744  1682 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.318059  1682 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.321502  1605 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.322543  1682 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.323012  1605 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 12:59:59.323755  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:59.324347  1525 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.324779  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 12:59:59.325430  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 12:59:59.325425  1681 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.325947  1534 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:59.325958  1681 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:59.326330  1534 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 12:59:59.325623  1682 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 12:59:59.327049  1534 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.326844  1681 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.328131  1534 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.328540  1681 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.331610  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 12:59:59.332176  1605 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.336938  1525 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:59.338176  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 12:59:59.338871  2826 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.339306  2826 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 12:59:59.341547  2826 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.343000  1681 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 12:59:59.341495  1605 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 12:59:59.345898  1534 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 12:59:59.346541  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 12:59:59.347337  2860 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:59.347767  2860 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 12:59:59.348529  2860 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 12:59:59.352500  1431 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.359813  1428 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.675447  1605 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.676523  2859 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.687853  1682 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.690929  2869 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.728696  1682 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.731132  2856 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.740338  1525 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.743749  2826 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.851861  1525 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:59.856724   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:59.857617  1682 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.857765  1605 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:59.858738  1498 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b12ac06d9474e6a97e219688d43cf30. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.859117  2859 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.860034  2869 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.871223  2634 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.873025  1605 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.877753  1682 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.885160  1607 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:59.888211  2863 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:59.893573  1428 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.927327  1531 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:59.932058  2863 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:59.939108  1525 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:59.949828   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:59.961899  1682 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:59.962007  1498 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82df41f800684066955da1e5fcf37da0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.963764  2869 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.964586  1605 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.965858  2869 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.977787  2634 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.980903  1605 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.984790  1682 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 12:59:59.991434  1681 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 12:59:59.998546  1431 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.006039  1534 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:00:00.007367  1647 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d36fd60901f543758f2f446ee106cf32. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.007385  1605 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:00.012665  2860 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.014214  2860 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:00.023744  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:39908
I20260709 13:00:00.024397  1534 raft_consensus.cc:606] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:00.029062  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:00.028617  1605 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.026918  2860 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.035493  1525 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.091496  1431 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 4, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.100663  1676 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:00.107607  1605 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.112769  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:00.116039  1607 raft_consensus.cc:606] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:00.119325   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:00.120440  1676 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:00.121065   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:00.122674  1573 consensus_peers.cc:597] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e796444a6ddd47bd9129de2ab82200a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.122967  2892 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:00.123783  1525 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:00.125944  2856 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:00.134829  2856 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.138942  1676 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.138906  1525 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.145406  2856 raft_consensus.cc:993] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:00.145962  2866 raft_consensus.cc:1081] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:00.148093  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 13:00:00.148751  1534 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.149104  1534 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.156865  1431 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 3, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:00.174656  1534 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.177419  1534 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:00.178928  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:00.179381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:00.179998  1682 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.180266  1605 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:00.180608  1605 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:00.181355  1605 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.182493  1605 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.188362  1682 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:00.189574  1499 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:00.190400  2634 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:00.190858  2634 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:00.191522  1605 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:00.191663  2634 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.205260  1428 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.219442  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46308
I20260709 13:00:00.220330  1525 raft_consensus.cc:606] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Received request to transfer leadership
I20260709 13:00:00.220353  2634 raft_consensus.cc:993] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:00.220979  2869 raft_consensus.cc:1081] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:00.222644  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:00:00.223227  1676 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.223598  1676 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.224859  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46308
I20260709 13:00:00.225442  1525 raft_consensus.cc:606] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Received request to transfer leadership
W20260709 13:00:00.226681  1418 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for e796444a6ddd47bd9129de2ab82200a6 already in progress [suppressed 3 similar messages]
I20260709 13:00:00.229925  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46308
I20260709 13:00:00.230492  1525 raft_consensus.cc:606] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Received request to transfer leadership
I20260709 13:00:00.231663  1676 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:00.234402  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:00.234668  1676 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:00.235172  1525 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.235529  1525 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:00.235601  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:00.236229  1607 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.237154  1525 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:00.238433  1525 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:00.239683  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:00:00.240257  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e796444a6ddd47bd9129de2ab82200a6 already in progress
W20260709 13:00:00.240597  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e796444a6ddd47bd9129de2ab82200a6 already in progress
I20260709 13:00:00.243682  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:00.245397  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:00.246342  2860 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.246866  2860 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:00.246847  1607 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:00.248497  2860 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:00.261830  1428 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.296913  2897 ts_tablet_manager.cc:933] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:00.302867  2897 tablet_copy_client.cc:323] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:00.305190  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 8b12ac06d9474e6a97e219688d43cf30 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:00.305814  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 8b12ac06d9474e6a97e219688d43cf30 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-8b12ac06d9474e6a97e219688d43cf30
I20260709 13:00:00.315064  1544 tablet_copy_source_session.cc:215] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:00.318790  2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b12ac06d9474e6a97e219688d43cf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:00.339623  2897 tablet_copy_client.cc:806] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:00.340235  2897 tablet_copy_client.cc:670] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.344626  2897 tablet_copy_client.cc:538] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.357069  2897 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:00.404690  2900 ts_tablet_manager.cc:933] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:00.407037  2900 tablet_copy_client.cc:323] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 13:00:00.409358  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet d36fd60901f543758f2f446ee106cf32 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 13:00:00.410027  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet d36fd60901f543758f2f446ee106cf32 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-d36fd60901f543758f2f446ee106cf32
I20260709 13:00:00.421016  2897 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.421491  1692 tablet_copy_source_session.cc:215] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:00.422047  2897 tablet_bootstrap.cc:492] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:00.422839  2897 ts_tablet_manager.cc:1403] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.021s
I20260709 13:00:00.424589  2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fd60901f543758f2f446ee106cf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:00.426106  2897 raft_consensus.cc:359] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.426976  2897 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:00.427618  2897 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.438182  2897 ts_tablet_manager.cc:1434] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.006s
I20260709 13:00:00.440048  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8b12ac06d9474e6a97e219688d43cf30 received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:00.440582  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8b12ac06d9474e6a97e219688d43cf30 on tablet 8b12ac06d9474e6a97e219688d43cf30 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:00.443210  2900 tablet_copy_client.cc:806] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:00.443799  2900 tablet_copy_client.cc:670] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.447266  2900 tablet_copy_client.cc:538] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.459334  2900 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:00.482367  2900 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.483124  2900 tablet_bootstrap.cc:492] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:00.483706  2900 ts_tablet_manager.cc:1403] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:00:00.486549  2900 raft_consensus.cc:359] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.487394  2900 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:00.488116  2900 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.491022  2900 ts_tablet_manager.cc:1434] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:00:00.493928  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-d36fd60901f543758f2f446ee106cf32 received from {username='slave'} at 127.0.0.1:33564
I20260709 13:00:00.494410  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-d36fd60901f543758f2f446ee106cf32 on tablet d36fd60901f543758f2f446ee106cf32 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:00.509233  2900 ts_tablet_manager.cc:933] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:00.511014  2900 tablet_copy_client.cc:323] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:00.512454  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 82df41f800684066955da1e5fcf37da0 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:00.512995  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 82df41f800684066955da1e5fcf37da0 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-82df41f800684066955da1e5fcf37da0
I20260709 13:00:00.522444  1544 tablet_copy_source_session.cc:215] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:00.524930  2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82df41f800684066955da1e5fcf37da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:00.539779  2900 tablet_copy_client.cc:806] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:00.540328  2900 tablet_copy_client.cc:670] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.543845  2900 tablet_copy_client.cc:538] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.553776  2900 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:00.557274  2860 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:00.557895  2863 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:00.560160  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:00:00.560734  1607 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.561094  1607 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.568962  1607 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.572264  1607 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:00.572706  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:00.573264  1534 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.576987  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:00.577601  1676 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.577894  1676 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:00.578614  1676 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.579360  1534 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:00.580070  1676 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.588353  2900 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.589489  2900 tablet_bootstrap.cc:492] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:00.590260  2900 ts_tablet_manager.cc:1403] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.008s
I20260709 13:00:00.593515  2900 raft_consensus.cc:359] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.594412  2900 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:00.595077  2900 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.596884  2900 ts_tablet_manager.cc:1434] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:00:00.600703  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:00.601740  2856 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:00.602275  2856 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:00.602811  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:00.603205  2856 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.621315  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-82df41f800684066955da1e5fcf37da0 received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:00.621858  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-82df41f800684066955da1e5fcf37da0 on tablet 82df41f800684066955da1e5fcf37da0 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:00.632272  1428 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 4, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 4 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.660677  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:00.661152  1607 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Received request to transfer leadership
I20260709 13:00:00.664189  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:00.664783  1607 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Received request to transfer leadership
I20260709 13:00:00.667692  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:00.668244  1607 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Received request to transfer leadership
W20260709 13:00:00.672132  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:00:00.672463  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d36fd60901f543758f2f446ee106cf32 already in progress
W20260709 13:00:00.672730  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d36fd60901f543758f2f446ee106cf32 already in progress
W20260709 13:00:00.753880  1498 consensus_peers.cc:597] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e796444a6ddd47bd9129de2ab82200a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.790673  1676 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:00.790849  1607 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:00.793022  2634 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.794332  2258 raft_consensus.cc:1217] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:00.795002  2870 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.808347  2905 raft_consensus.cc:993] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:00.808856  2905 raft_consensus.cc:1081] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:00.832947  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:00:00.833534  1682 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.833899  1682 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.837787  1525 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.846006  2890 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.854868  1601 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.850145  1682 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.858523  2860 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.859824  1676 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.865339  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:00.866034  1607 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.868682  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:00.869349  1534 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.869673  1534 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:00.870494  1534 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.871912  1534 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.894840  1607 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:00.901440  1682 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:00.907634  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:00.908470  2863 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:00.908927  2863 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:00.910583  2863 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:00.927942  1534 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:00.954459  1430 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.015269  1682 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.016758  2866 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:01.023483  2856 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:01.024045  2856 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:01.029574  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 13:00:01.030189  1681 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:01.030543  1681 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.037415  2258 raft_consensus.cc:1217] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:01.045116  2258 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Advancing to term 4
I20260709 13:00:01.049137  1534 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.050778  2866 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.052670  1681 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.053898  1678 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:01.059638  1681 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:01.060623  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:01.061215  1531 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.062166  2856 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.061120  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:01.063109  1607 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:01.063438  1607 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:01.064191  1607 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.069221  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.069931  1607 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.074316  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:01.075868  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:01.077208  2860 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:01.077682  2860 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:01.077829  1607 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:01.078598  2860 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.094419  1430 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 5, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.122143   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:01.202836   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:01.258461  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.258996  1681 raft_consensus.cc:606] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:01.262176  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:01.262768  1607 raft_consensus.cc:606] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:01.267379  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.268028  1681 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:01.273412  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:01.274024  1681 raft_consensus.cc:606] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:01.275223   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:01.277132   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:01.285279  2860 raft_consensus.cc:993] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:01.285805  2863 raft_consensus.cc:1081] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:01.287531  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:00:01.288048  1531 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:01.288373  1531 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.293298  1531 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.295114  1531 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:01.296105  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:01.296105  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:01.297123  1681 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:01.297204  1607 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.297995  1681 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:01.298861  1681 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.300125  1681 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.305392  1607 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:01.306898  1681 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:01.306921  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:01.308027  2870 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:01.308566  2870 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:01.309504  2870 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.321300  1430 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.370460  2634 raft_consensus.cc:1064] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
W20260709 13:00:01.370605  1647 consensus_peers.cc:597] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e796444a6ddd47bd9129de2ab82200a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.373240  2634 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:01.379570  1682 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.379570  2260 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.384956  1607 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.386055  2905 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:01.388033  2914 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.389421  2905 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:01.414680  2905 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.417764  1682 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.420574  1601 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.424490  2869 raft_consensus.cc:1064] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:01.431665  1607 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.432071  1534 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.434032  2863 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.436774  2863 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.438287  1430 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.427953  2869 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:01.498745  1531 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:01.504987  1534 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:01.507303  2860 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:01.518822  1681 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.518303  2258 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.537580  2258 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.541568  2870 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.547891  2905 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.556483  2870 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.570662  2258 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.574676  2260 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.578372  1607 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:01.580520  2634 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.582772  2860 raft_consensus.cc:993] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:01.583273  2890 raft_consensus.cc:1081] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:01.588759  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b12ac06d9474e6a97e219688d43cf30 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:01.592705  2258 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Advancing to term 5
I20260709 13:00:01.594069  2923 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:01.596766  1428 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.603034  1682 raft_consensus.cc:2955] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.605400  1605 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.600705  1681 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.602995  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:00:01.609825  1607 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:01.610224  1607 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.614138  2905 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:01.617009  1607 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.618721  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b12ac06d9474e6a97e219688d43cf30 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:01.634264  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:01.635188  2905 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.636025  1607 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:01.642499  2927 tablet_replica.cc:333] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:00:01.643748  2927 raft_consensus.cc:2243] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.644567  2927 raft_consensus.cc:2272] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:01.648713  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:01.649426  1531 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.649276  2923 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.649885  2927 ts_tablet_manager.cc:1916] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.650665  2634 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.658107  1531 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:01.659149  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:01.659982  2826 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:01.660522  2826 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:01.661345  2826 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.662642  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:01.663257  1682 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:01.663542  1682 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:01.665817  1682 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.669392  1682 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:01.668267  2258 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.671026  2927 ts_tablet_manager.cc:1929] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.671547  2927 log.cc:1199] T 8b12ac06d9474e6a97e219688d43cf30 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/8b12ac06d9474e6a97e219688d43cf30
I20260709 13:00:01.675758  1682 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:01.678144  2923 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:01.689013  2923 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:01.690948  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 8b12ac06d9474e6a97e219688d43cf30 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:00:01.685689  1430 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.692644  1607 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.697506  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:00:01.698079  1604 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:01.698414  1604 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.705298  1682 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.706687  1604 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.711670  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:01.712182  1534 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.716856  1532 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:01.719281  1534 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:01.724974  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:01.725615  1682 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:01.725883  1682 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:01.726588  1682 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.728560  2259 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.730842  1604 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:01.733242  2914 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:01.742432  1682 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.742730  2634 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.752097  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:01.753086  2866 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:01.753595  2866 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:01.754526  2866 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.748948  2259 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.758730  2826 raft_consensus.cc:993] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:01.759357  2826 raft_consensus.cc:1081] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:01.761292  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 13:00:01.761834  1531 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:01.762176  1531 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.764173  1430 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.770183  1531 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.774171  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:01.774824  1607 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:01.775142  1607 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:01.775872  1607 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.777453  1607 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.783444  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82df41f800684066955da1e5fcf37da0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:01.777518  1682 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:01.777993  1531 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:01.785522  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:01.787073  1681 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.790824  1604 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.792778  1607 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:01.794641  2869 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.799924  1428 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.803592  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:01.804637  2870 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:01.805984  2870 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:01.807250  2870 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:01.822739  2933 ts_tablet_manager.cc:933] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:01.826395  1607 raft_consensus.cc:2955] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:01.835706  2933 tablet_copy_client.cc:323] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 13:00:01.839236  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 82df41f800684066955da1e5fcf37da0 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32902
I20260709 13:00:01.839792  1681 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:01.840469  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet e796444a6ddd47bd9129de2ab82200a6 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 13:00:01.840994  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet e796444a6ddd47bd9129de2ab82200a6 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-e796444a6ddd47bd9129de2ab82200a6
I20260709 13:00:01.857384  1692 tablet_copy_source_session.cc:215] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:01.857998  1607 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.860759  2933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e796444a6ddd47bd9129de2ab82200a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:01.860901  1428 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.859236  2914 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:01.878152  2936 tablet_replica.cc:333] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:00:01.877979  1430 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 5 to 6, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 6 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.879426  2936 raft_consensus.cc:2243] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.881129  2933 tablet_copy_client.cc:806] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.881714  2933 tablet_copy_client.cc:670] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:01.884943  2936 raft_consensus.cc:2272] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:01.887626  2933 tablet_copy_client.cc:538] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:01.896224  2936 ts_tablet_manager.cc:1916] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.897693  2933 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:01.901813  1682 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.903610  2634 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.928416  2936 ts_tablet_manager.cc:1929] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.928874  2936 log.cc:1199] T 82df41f800684066955da1e5fcf37da0 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/82df41f800684066955da1e5fcf37da0
I20260709 13:00:01.933130  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 82df41f800684066955da1e5fcf37da0 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:00:01.948375  2933 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:01.949229  2933 tablet_bootstrap.cc:492] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:01.949826  2933 ts_tablet_manager.cc:1403] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.008s
I20260709 13:00:01.954371  2933 raft_consensus.cc:359] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.955206  2933 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:01.955760  2933 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:01.957584  2933 ts_tablet_manager.cc:1434] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:01.960203  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e796444a6ddd47bd9129de2ab82200a6 received from {username='slave'} at 127.0.0.1:33564
I20260709 13:00:01.960632  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e796444a6ddd47bd9129de2ab82200a6 on tablet e796444a6ddd47bd9129de2ab82200a6 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:02.097393  1532 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:02.098394  2866 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:02.106678  1681 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:02.108542  2826 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:02.211377  2261 raft_consensus.cc:1217] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Deduplicated request from leader. Original: 3.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:00:02.214906  1681 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:02.216912  2925 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.229560  2261 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEARNER]: Advancing to term 6
I20260709 13:00:02.231318  1531 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:02.238096  2261 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:02.241482  1681 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.241904  2866 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.243752  2925 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.246897  2870 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:02.259840  2925 raft_consensus.cc:1064] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:02.267700  1604 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.263598  2925 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.269366  2870 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:02.278075   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:02.287376  2259 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:02.289250  2826 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.290261  1682 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:02.297755  1532 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:02.299055  2826 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.300339  2866 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.311565  2866 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.318187  1678 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.321056  1534 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.336349  1428 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 4 to 8, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.337306  2261 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.408924   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:02.453475  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "055cfab17a334683a9350a659118ac99"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:02.453953  1604 raft_consensus.cc:606] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:02.456379  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:39908
I20260709 13:00:02.456838  1531 raft_consensus.cc:606] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:02.459215  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:02.459692  1678 raft_consensus.cc:606] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:02.462096  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c802947c11486798c253f6688083e7"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:02.462598  1604 raft_consensus.cc:606] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:02.465224  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:39908
I20260709 13:00:02.465866  1531 raft_consensus.cc:606] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:02.467036   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:02.468694   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:02.586217  2870 raft_consensus.cc:993] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:02.586733  2634 raft_consensus.cc:1081] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:02.588173  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44456
I20260709 13:00:02.588670  1604 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.588928  1604 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.594229  1604 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.595856  1604 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:02.596787  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:02.596951  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:02.597437  1534 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:02.597532  2261 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.597803  1534 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:02.598626  1534 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.599848  1534 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.604704  2261 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:02.605906  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:02.606559  2826 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:02.607012  2826 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:02.607792  2826 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.608254  1534 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:02.619882  1431 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.648480  2923 raft_consensus.cc:1064] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:02.651182  2923 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.657984  1604 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:02.658627  2261 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:02.660632  1534 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:02.660789  2924 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:02.661796  2860 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:02.663558  2860 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:02.680083  2860 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.681813  2261 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.682111  1604 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.694139  1531 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.699841  1431 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 3 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.718743  1681 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.723116  2261 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:02.724694  1604 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:02.726722  2860 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.733160  2860 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:02.734546  2924 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.736419  1607 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.740913  2826 raft_consensus.cc:993] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:02.741425  2826 raft_consensus.cc:1081] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:02.743229  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c802947c11486798c253f6688083e7"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 13:00:02.743880  1681 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.746379  1681 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.749962  2261 raft_consensus.cc:2955] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.753175  2869 raft_consensus.cc:993] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:02.753794  2869 raft_consensus.cc:1081] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:00:02.755144  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e796444a6ddd47bd9129de2ab82200a6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:02.756292  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:00:02.757005  1682 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.757403  1682 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.758210  1430 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 6 to 7, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:02.775142  1682 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.779227  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet e796444a6ddd47bd9129de2ab82200a6 with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46308
I20260709 13:00:02.781255  1681 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.784017  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:02.784621  1534 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.785207  1682 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:02.786943  2950 tablet_replica.cc:333] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:00:02.788645  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:02.789211  1532 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:02.789490  1532 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:02.790203  1681 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:02.790179  1532 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.791123  2950 raft_consensus.cc:2243] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:02.791359  1532 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.792282  2950 raft_consensus.cc:2272] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:02.794224  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:02.799364  1607 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.798386  1534 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:02.798864  1532 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:02.801888  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:02.795198  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:02.803122  2950 ts_tablet_manager.cc:1916] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:02.803504  1604 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:02.804147  1604 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:02.805017  1604 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.803026  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:02.807257  2924 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:02.807363  2923 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:02.806350  1604 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.810164  1607 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:02.820429  2923 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:02.821273  2923 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.824901  2950 ts_tablet_manager.cc:1929] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:00:02.825166  1604 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:02.825510  2950 log.cc:1199] T e796444a6ddd47bd9129de2ab82200a6 P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/e796444a6ddd47bd9129de2ab82200a6
I20260709 13:00:02.827636  2924 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:02.827823  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet e796444a6ddd47bd9129de2ab82200a6 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:00:02.828841  2924 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:02.833446  2924 raft_consensus.cc:993] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:02.834184  2923 raft_consensus.cc:1081] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:02.836795  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:00:02.837402  1604 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.837721  1604 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.841568  1432 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.843366  1432 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.844653  1604 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.848636  1604 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:02.849378  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:02.849579  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:02.850033  2261 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.850004  1681 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:02.850622  1681 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:02.851421  1681 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.852785  1681 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.859674  1681 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:02.857738  2261 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:02.861600  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:02.862438  2866 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:02.862870  2866 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:02.863655  2866 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.873920  1432 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.926266  2826 raft_consensus.cc:993] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:00:02.927052  2826 raft_consensus.cc:1081] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:00:02.930557  2261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "055cfab17a334683a9350a659118ac99"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:00:02.931154  2261 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.931524  2261 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.938532  2261 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.941077  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:02.941134  2261 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:02.941246  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:02.941768  1604 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:02.941948  1678 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.942278  1604 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:02.943063  1604 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.944438  1604 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:02.948266  1678 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:02.949317  1534 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:02.950093  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:02.950857  2818 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:02.951300  2818 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:02.951952  2818 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:02.953313  1604 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
W20260709 13:00:02.957007  1498 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2ca98d137184e478468c21f485fafa4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:02.957756  1678 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:02.958012  1604 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:02.961429  2905 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:02.962462  2634 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:02.981388  2870 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:02.986114  1678 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:02.999722  1432 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.028712  1532 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:03.057385  1498 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a266117eb57049ceb80c4acd77766559. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.060230  1681 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.062163  2905 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.522187   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:04.024176  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 179) took 1019 ms. Trace:
I20260709 13:00:04.024761  1432 rpcz_store.cc:276] 0709 13:00:02.965450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.965619 (+   169us) service_pool.cc:224] Handling call
0709 13:00:03.026549 (+ 60930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.026594 (+    45us) write_op.cc:454] Released schema lock
0709 13:00:03.984684 (+958090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:03.010866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:03.011361 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:03.011391 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:00:03.011407 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:03.011720 (+   313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:03.011770 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:03.011801 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:03.011967 (+   166us) tablet.cc:701] Row locks acquired
0709 13:00:03.011984 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:00:03.012106 (+   122us) write_op.cc:270] Start()
0709 13:00:03.012201 (+    95us) write_op.cc:276] Timestamp: P: 1783602003012063 usec, L: 0
0709 13:00:03.012220 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:00:03.012799 (+   579us) log.cc:844] Serialized 536 byte log entry
0709 13:00:03.015622 (+  2823us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.015993 (+   371us) write_op.cc:301] APPLY: starting
0709 13:00:03.016062 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.016150 (+    88us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.016238 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.016465 (+   227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.016611 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:03.016654 (+    43us) write_op.cc:312] APPLY: finished
0709 13:00:03.016900 (+   246us) log.cc:844] Serialized 23 byte log entry
0709 13:00:03.017046 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.017118 (+    72us) write_op.cc:454] Released schema lock
0709 13:00:03.017155 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":1377,"apply.run_wall_time_us":1376,"num_ops":1,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":2161,"prepare.run_wall_time_us":2162,"replication_time_us":3291}]]}
I20260709 13:00:04.119694  2961 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.120428  2961 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.134632  2961 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.171342  2961 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.172148  2961 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.175038  2961 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:04.274319  2961 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.275171  2961 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.285496  2961 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.299929  2963 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.300674  2963 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.303148  2963 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.314878  2963 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.315692  2963 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.318308  2963 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.337431  2961 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.338222  2961 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.341423  2961 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:04.353454   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f640 after lost signal to thread 1604
W20260709 13:00:04.354104   436 kernel_stack_watchdog.cc:198] Thread 1604 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 326ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:00:04.363198  2961 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.364030  2961 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.367662  2961 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:04.407315  2963 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.445261  2963 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.448371  2963 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.498210  2964 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.498785  2964 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.501235  2964 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.501796  2964 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.502362  2964 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.504451  2964 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.515640  2963 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.516532  2963 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.519366  2963 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.528231  2961 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.529982  2962 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.530716  2962 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.533295  2962 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.533939  2962 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.534526  2962 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.537230  2962 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.579197  2961 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.581763  2961 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.582453  2961 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.588773  2962 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.605924  2962 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.609382  2962 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.660591  2970 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.661392  2970 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.663815  2970 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:04.623044  2968 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.751689  2968 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.705176  2964 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.596870  2961 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.707556  2963 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.719942  2962 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.751066  2972 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.761121  2965 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.757289  2963 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.771943  2969 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.772907  2963 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.772722  2969 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.763319  2962 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.751140  2967 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.776413  2973 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.776952  2973 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.779045  2973 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.779531  2973 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.775768  2965 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.783644  2961 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.756106  2964 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.786350  2964 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.781028  2968 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.781199  2967 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.784646  2965 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.807029  2975 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.792627  2966 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.808249  2974 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.822024  2977 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:04.822330  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.796s	user 0.012s	sys 0.009s
I20260709 13:00:04.822595  2977 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.823359  2968 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.824821  2976 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.762187  2972 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:04.827318  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.801s	user 0.013s	sys 0.010s
I20260709 13:00:04.844826   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:04.781510  2973 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.857379  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1237) took 1835 ms. Trace:
I20260709 13:00:04.823904  2968 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.813150  2964 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.821592  2965 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.857986  1604 rpcz_store.cc:276] 0709 13:00:03.013363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.023940 (+ 10577us) service_pool.cc:224] Handling call
0709 13:00:03.024402 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.024705 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.024729 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.025982 (+  1253us) log.cc:844] Serialized 506 byte log entry
0709 13:00:04.848736 (+1822754us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:04.848774 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.848839 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.848883 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:04.848893 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.849003 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1822270,"threads_started":1,"wal-append.queue_time_us":63769,"wal-append.run_cpu_time_us":2020,"wal-append.run_wall_time_us":1002029}
I20260709 13:00:04.826558  2974 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.832984  2979 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.843935  2967 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.845359  2962 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.847306  2977 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.839390  2985 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.925402  2991 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:04.926136  2991 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.868670  2969 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.941044  2982 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.827636  2976 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.944187  2982 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.946293  2976 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.866446  2964 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.922762  2967 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.825949  2966 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:04.952541  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080003c720 after lost signal to thread 434
I20260709 13:00:04.869804  2965 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.926717  2992 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.826069  2975 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.955315  2988 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:04.955506  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800034860 after lost signal to thread 1466
I20260709 13:00:04.939459  2977 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.960892  2986 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.965981  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:04.956080  2972 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:04.962627  2982 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.967425  2993 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:04.971706  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:04.972324  1607 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:04.984469  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:04.960810  2992 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.985165  1607 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:04.923005  2985 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.956193  2989 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:04.954481  2967 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:04.990720  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:04.870842  2979 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:04.968581  2977 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.006359  2973 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:04.998927  2969 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.007117  2975 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.007875  2965 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.013305  2995 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.013813  2990 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.014233  2978 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.016438  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.022964  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.030278  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.031153  1601 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:04.972991  2986 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.032899  2966 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.032169  2981 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.021472  2973 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.038671  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.026237  2968 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.020685  2992 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.041232  2259 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.054437  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:04.985641  2993 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:05.025971  2969 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.056460  2968 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.058637  2993 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.059116  2983 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:05.041913  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800034920 after lost signal to thread 1480
I20260709 13:00:05.003134  2989 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.037488  2978 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.067210  2989 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.067534  2978 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:05.068611  2978 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:04.971529  2988 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.058820  2969 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.039559  2994 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.039763  2984 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.090651  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.051455  2963 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.032177  2997 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.117254  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.118866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.120609  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.127095  2261 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:05.128337  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.128592  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.129135  2260 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:05.129539  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.130090  1605 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:05.131250  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.131773  1605 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:05.133104  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.140131  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.142354  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.144999  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.146561  2951 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.147349  2951 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.150705  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.154662  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.194224  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.064772  2975 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.238296  2951 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.243775  2966 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.244562  2992 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.061231  2996 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.256938  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:05.089918  2982 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.052007  2973 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.091526  2974 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.196291  2985 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.058892  2968 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.245434  2993 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.059752  2981 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.264489  2971 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.274857  2989 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.061226  2983 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.274837  3000 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.261396  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.285423  1605 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:05.097651  2978 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.036054  2995 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.036181  2990 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.277140  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:05.194214  2963 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.283713  2969 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:05.293115  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.309609  1601 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:05.285797  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.280961  2992 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.283883  2986 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.261803  2984 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.282287  2977 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.276063  2966 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.267148  2997 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.293624  2967 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.327559  2970 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.264707  2975 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.297920  2974 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.285223  2982 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.298657  2972 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.317556  2969 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.336257  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.296551  2989 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.298424  3001 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.330111  3000 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.256474  2994 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.359314  2987 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.344101  2967 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.365553  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.371073  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.371773  1601 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:05.299624  2993 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.351622  2969 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:05.360502  2964 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:05.372006  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800322f40 after lost signal to thread 1558
I20260709 13:00:05.343941  2970 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.348058  2974 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:05.417474  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67734.7us
I20260709 13:00:05.366907  2976 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.422309  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.364122  2984 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.422190  1604 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:05.299772  2971 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.423802  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.351840  2972 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.425561  1532 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:05.426460  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.386924  2979 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.428372  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.428803  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.430009  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:05.431125  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.421700  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.432507  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.418484  2968 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.290768  2996 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.422648  2985 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.422042  2999 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.424283  2951 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.372367  2967 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.442612  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.443899  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.451174  1534 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:05.447201  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:05.447942  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.433322  2993 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.454717  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.444589  2973 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:05.446722  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800322f00 after lost signal to thread 1633
I20260709 13:00:05.443166  2984 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.443007  2980 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:05.468621  2983 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.431154  2976 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.469592  1604 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:05.445123  2258 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:05.488819  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.490211  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.446507  2985 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.391956  2987 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.455149  2951 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.518669  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:05.386452  3001 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.474795  2988 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.489653  2980 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.529107  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.530278  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:05.572932  2998 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.597813  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.682377  2993 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:05.689224  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 247578us
I20260709 13:00:05.694747  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:05.696713  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:05.700827  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.700649  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.701542  1534 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:05.581241  1432 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.516810  2992 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.523352  3002 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.221s
I20260709 13:00:05.475139  2984 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:05.556684   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f300 after lost signal to thread 1604
I20260709 13:00:05.490273  2990 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.489843  2963 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.615247  1606 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:05.581492  2994 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.488658  3006 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.575063  2976 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.629782  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:05.659425  3000 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.582441  2995 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.563359  3009 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.577742  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.557464  2980 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:05.528443  2975 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.562379  2982 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.554307  1601 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:05.526618  2986 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:00:05.563776  2989 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.464975  2999 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.563465  3005 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.524566  2966 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.616688  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:05.528512  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08003293a0 after lost signal to thread 1707
I20260709 13:00:05.559676  1678 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.751202  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.877633  1681 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
W20260709 13:00:05.671255  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 333882us
I20260709 13:00:05.834240  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.879032  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:05.573382  2978 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.572009  2983 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:05.879912  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.880461  2983 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.880942  2983 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:05.784727  2969 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.883194  2969 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.827462  2994 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:05.573045  3004 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.616302  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.571688  2962 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:05.884265  2994 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.884914  2994 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:05.885985  3004 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.888482  3004 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.783872  1682 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.638604  2970 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.718938  3022 ts_tablet_manager.cc:933] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:05.729374  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:05.689515  2972 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.890100  1531 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:05.890681  2972 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:05.682313  2998 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.891443  2972 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:05.891979  2972 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.893594  2998 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.884794  2962 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.784402  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.894059  2983 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.740597  1604 raft_consensus.cc:606] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:05.741762  2991 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.895496  1607 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.890995  2970 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:05.710114  2993 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.905151  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:05.895442  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08002d87a0 after lost signal to thread 1708
I20260709 13:00:05.876724  3011 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:05.784951  2968 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.911819  2972 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:05.952899  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.953737  1678 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:05.941529  1608 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.787088  2967 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.904978  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.938894  2985 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.784526  2951 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.783931  3009 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.972700  2987 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.974684  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:05.978294  1678 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:05.904383  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:05.965586  3013 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:05.946120  2971 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:05.854056  3021 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.977002  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080030b700 after lost signal to thread 2285
I20260709 13:00:05.941962  2970 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:05.986901  2970 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.987253  2974 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.904415  3017 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.960989  2968 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:05.973610  2996 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.000010  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:05.991647  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800141620 after lost signal to thread 2286
I20260709 13:00:06.001255  1532 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:05.788921  3006 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:06.002660  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.005879  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.006690  1681 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:05.993105  3013 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:05.853883  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.012499  2997 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.001407  1602 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:06.012193  2981 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.015937  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.008929  2984 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.011022  3013 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.019804  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.027550  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.028066  2968 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.017741  2999 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:05.905309  3005 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:06.049444  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.004204  3017 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.054035  3017 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:05.973579  3011 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:06.063337  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 533062us
I20260709 13:00:06.065326  1649 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:06.066830  3014 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.067284  3014 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:06.068073  3014 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.079156  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.080579  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.086622  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.091913  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.089399  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.089643  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.097048  1532 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:06.098819  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.099762  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.000447  3021 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.104533  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.084867  2962 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.089344  2968 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:06.111547  3028 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:06.112787  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.114027  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.116703  1532 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:06.117456  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.118098  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.105688  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.118888  1681 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:06.122377  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.115962  2993 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.118839  3005 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.116778  3028 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:06.129873  1602 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:06.130460  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.119328  2968 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.130795  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.206668  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:06.195992  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 316995us
I20260709 13:00:06.511106  1531 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:06.403528  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.132472  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:06.506799  1525 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:06.512660  1683 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:06.513010  1605 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.227195  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.365303  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.365302  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.361217  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.226702  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.528476  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.181804  3027 ts_tablet_manager.cc:933] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:06.535594  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.545832  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.552445  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.559314  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.227648  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.535694  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.562666  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.563364  2261 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:06.200096  3009 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.158190  3029 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.564987  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.568041  1681 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:06.564910  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.526145  2974 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:06.158816  2981 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.206848  3022 tablet_copy_client.cc:323] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:06.297329  3021 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.228112  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.158641  2997 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.220966  3030 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.362540  3006 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.569264  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.570001  1683 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:06.571326  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.568620  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.572829  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.573364  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.296486  2994 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.587792  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.583078  1605 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:06.230932  2972 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.589748  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.572494  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.557677  2961 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:06.591008  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.593742  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.222908  3014 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:06.590378  1680 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:06.587740  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:06.579037  1530 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:06.594851  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.595158  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.598274  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.592301  3018 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:06.599864  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.597314  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.598522  1526 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:06.604370  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.629779  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.635764  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:06.636430  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.029s	sys 0.065s
W20260709 13:00:06.636723  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.029s	sys 0.065s
I20260709 13:00:06.637562  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.593690  3001 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.640189  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.600145  3005 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.602029  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.641574  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1260) took 1127 ms. Trace:
I20260709 13:00:06.641638  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.631582  3018 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.637180  2975 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.573841  3029 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.652441  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.649844  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.643399  1604 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:06.653398  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:06.654212  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:06.654626  3029 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.576119  2981 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:06.644827  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.656395  2259 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:06.656498  2981 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.656932  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.657112  1681 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:06.657677  2975 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.658104  2975 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.651643  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.659114  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.659548  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.659750  1532 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:06.641194  2261 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:06.588475  2997 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:06.650677  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.649210  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.650763  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.649925  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:06.651278  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.038s	sys 0.069s
I20260709 13:00:06.671557  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:06.671633  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.038s	sys 0.070s
I20260709 13:00:06.672297  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:06.672570  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 977840us
I20260709 13:00:06.673245  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.673858  3009 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.674239  3009 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.674849  3009 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:06.677091  3013 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.003s
I20260709 13:00:06.651062  3018 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.677526  3013 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.654140  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.662237  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:06.649812  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.587277  2974 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.667182  1676 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:06.679755  3013 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.659158  1679 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:06.666361  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.667907  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:06.591885  3030 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.681591  1680 raft_consensus.cc:606] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:06.603535  2962 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:06.683032  1675 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:06.683135  3030 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.674239  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:06.685843  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.685973  2983 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.686334  2974 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.686589  1675 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:06.687003  3011 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.687578  2961 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.647579  1601 rpcz_store.cc:276] 0709 13:00:05.514344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.519066 (+  4722us) service_pool.cc:224] Handling call
0709 13:00:05.553754 (+ 34688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.554073 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:06.038720 (+484647us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.640822 (+602102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.640877 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:06.641344 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.641417 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.641524 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":589351,"threads_started":1}
I20260709 13:00:06.688230  2961 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.690896  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.648497  3005 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:06.702948  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.706936  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.707674  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.661293  2972 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.709591  1681 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:06.712201  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.714176  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.716609  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:06.699892  2961 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.721561  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.722455  2968 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.724004  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet a266117eb57049ceb80c4acd77766559 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:06.724911  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:06.714085  3028 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.735387  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:06.710665  3005 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.710395  3018 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.737511  1677 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:06.733292  2961 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:06.749840  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.643s (SENT) [suppressed 1 similar messages]
I20260709 13:00:06.768147  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:06.740032  3027 tablet_copy_client.cc:323] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:06.770115  1683 raft_consensus.cc:606] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:06.742125  3018 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.771763  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.745756  3014 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.742293  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet a266117eb57049ceb80c4acd77766559 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-a266117eb57049ceb80c4acd77766559
I20260709 13:00:06.773880  3018 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.778632  2994 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.781231  2256 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:06.768523  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:06.784010  2980 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.011s
W20260709 13:00:06.784757  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 130687us
W20260709 13:00:06.787325  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 190052us
I20260709 13:00:06.783445  3009 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:06.797138  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 89560.7us
I20260709 13:00:06.796528  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:06.796059  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:06.801097  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.797183  2980 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.804889  2980 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.805713  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.805821  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.806573  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.807029  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.807936  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.808809  3009 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.809211  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.809562  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.809922  3037 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.810086  3040 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.828907   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:06.824570  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.834954   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:06.836143  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.838812  3046 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.839381  3046 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.839792  3046 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.840121  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.841672  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.810446  3037 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.838619  2962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56394 (request call id 10) took 3812 ms. Trace:
I20260709 13:00:06.842455  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:06.842720  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.823683  3040 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:06.822424  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.843828  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.832598  3009 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:06.802775  2997 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:06.786653  2975 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:06.843116  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47948.6us
I20260709 13:00:06.865126  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:06.865957  1606 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:06.843881  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94084.6us
I20260709 13:00:06.845873  3047 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.844563  2980 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.845257  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:06.850867  3045 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:06.856678  3036 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:00:06.873652  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:06.874352  3045 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.850406  3040 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.863763  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.845356  3037 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.868902  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.869690  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.864934  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:06.862126  3009 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.853328  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:06.877452  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.860546  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.885978  1607 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:06.878757  2983 raft_consensus.cc:993] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:06.886180  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.865782  2974 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.872915  3047 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.893951  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:06.874838  3045 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.871174  2980 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:06.872087  3041 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.900875  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:06.884599  3001 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:06.908524  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.897728  2258 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:06.909741  2972 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.911916  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.892351  3028 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:06.862950  2981 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:06.892066  1603 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.906900  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:06.921518  1605 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:06.922641  3030 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:06.922274  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 73033.4us
I20260709 13:00:06.880168  2961 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.924474  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:06.925489  2961 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.904676  3047 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.907569  3021 raft_consensus.cc:1081] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:00:06.906796  2980 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.923518  2999 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:06.928532  2999 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:06.928608  3030 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:06.929092  3030 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.929452  3030 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.929402  2999 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.933458  2999 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.933202  2980 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.935256  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.935632  2980 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:06.938639  3030 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:06.908806  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:06.908829  3001 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.908841  3041 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:06.910324  3013 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.942562  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.905730  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:06.848532  2962 rpcz_store.cc:276] 0709 13:00:03.026474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.026611 (+   137us) service_pool.cc:224] Handling call
0709 13:00:03.037227 (+ 10616us) log.cc:844] Serialized 506 byte log entry
0709 13:00:06.838514 (+3801287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21357,"raft.run_cpu_time_us":2152,"raft.run_wall_time_us":4940,"thread_start_us":15780,"threads_started":1,"wal-append.queue_time_us":49669,"wal-append.run_cpu_time_us":2254,"wal-append.run_wall_time_us":1002272}
I20260709 13:00:06.914793  3020 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.943410  2972 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.944473  1600 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.963289  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:06.953938  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60522.6us
I20260709 13:00:06.940080  3028 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:06.945042  3001 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.947312  3041 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.951297  2999 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.958281  2258 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:06.958868  3009 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:06.959415  1544 tablet_copy_source_session.cc:215] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:06.959774  2974 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:06.981259  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
W20260709 13:00:06.978621  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 103887us
I20260709 13:00:06.956918  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:06.920895  3031 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:06.973294  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:06.975749  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:06.976742  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61008.5us
I20260709 13:00:06.981915  1605 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.986232  1605 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.986546  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:06.988014  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:06.993697  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:06.994222  1544 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet e2ca98d137184e478468c21f485fafa4 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:06.994817  1544 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet e2ca98d137184e478468c21f485fafa4 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-e2ca98d137184e478468c21f485fafa4
I20260709 13:00:06.995147  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:06.995643  1533 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.994390  1530 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.999480  1606 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:07.002328  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 177848us
W20260709 13:00:07.019865  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 126338us
W20260709 13:00:07.026201  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 43747.7us
I20260709 13:00:06.974512  3005 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.031205  1649 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:07.008039  2962 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.007815  2975 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.036950  1526 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:06.985081  2974 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:07.093182  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47390.4us
I20260709 13:00:07.095492  1525 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:07.039134  2997 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.037813  2962 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:07.110091  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:07.123880  2997 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:07.124835  3022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a266117eb57049ceb80c4acd77766559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.125087  2997 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:07.039615  3013 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:00:07.108448  3035 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:07.135269  1533 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:07.109514  2962 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.048702  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:07.141541  1605 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:07.143810  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 103388us
I20260709 13:00:07.144567  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:07.145771  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:07.146961  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:07.093024  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:07.156069  3011 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:07.156420  2983 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:07.162155  1605 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:07.165102  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72175.3us
I20260709 13:00:07.092840  3028 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:07.167212  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 218680us
I20260709 13:00:07.137528  3030 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.172736  1530 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
W20260709 13:00:07.173319  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 232768us
I20260709 13:00:07.177129  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:07.179206  3005 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:07.158047  2974 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:07.127493  3018 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.178020  3062 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:07.217329  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:07.201359  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:07.201742  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:07.203608  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 297) took 1015 ms. Trace:
I20260709 13:00:07.158864  3029 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:07.164362  3021 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:07.209002  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 173014us
I20260709 13:00:07.210045  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 293) took 1814 ms. Trace:
I20260709 13:00:07.169358  3045 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.135581  3055 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:07.225991  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:07.158739  3051 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:07.219162  1428 rpcz_store.cc:276] 0709 13:00:06.188708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.188878 (+   170us) service_pool.cc:224] Handling call
0709 13:00:07.203549 (+1014671us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:00:07.256858  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:07.390030  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 188741us
I20260709 13:00:07.371054  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:07.391458  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:07.389590  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:07.392355  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:07.392614  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 175382us
I20260709 13:00:07.393746  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:07.394032  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:07.354358  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:07.396093  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 170177us
W20260709 13:00:07.402272  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 145929us
I20260709 13:00:07.402014  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:07.337785  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 316253us
I20260709 13:00:07.403388  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:07.403748  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:07.405669  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:07.406536  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:07.407471  2259 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:07.222580  1432 rpcz_store.cc:276] 0709 13:00:05.386920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.387057 (+   137us) service_pool.cc:224] Handling call
0709 13:00:07.200792 (+1813735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:06.603684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:06.673358 (+ 69674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:06.673400 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:00:06.673420 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:06.673792 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:06.673857 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:06.673887 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:06.674081 (+   194us) tablet.cc:701] Row locks acquired
0709 13:00:06.674114 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:00:06.674268 (+   154us) write_op.cc:270] Start()
0709 13:00:06.674388 (+   120us) write_op.cc:276] Timestamp: P: 1783602006674218 usec, L: 0
0709 13:00:06.674406 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:00:06.675139 (+   733us) log.cc:844] Serialized 599 byte log entry
0709 13:00:06.946763 (+271624us) op_driver.cc:464] REPLICATION: finished
0709 13:00:07.160012 (+213249us) write_op.cc:301] APPLY: starting
0709 13:00:07.160098 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:07.160211 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:07.163814 (+  3603us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:07.166551 (+  2737us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:07.166724 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:07.166774 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:07.168941 (+  2167us) log.cc:844] Serialized 23 byte log entry
0709 13:00:07.169247 (+   306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:07.169332 (+    85us) write_op.cc:454] Released schema lock
0709 13:00:07.169370 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:07.169714 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:07.169740 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":191152,"apply.run_cpu_time_us":2457,"apply.run_wall_time_us":9697,"num_ops":1,"prepare.queue_time_us":699568,"prepare.run_cpu_time_us":12782,"prepare.run_wall_time_us":193567,"raft.queue_time_us":104753,"raft.run_cpu_time_us":23720,"raft.run_wall_time_us":91859,"replication_time_us":272203,"thread_start_us":510622,"threads_started":4,"wal-append.queue_time_us":164242}]]}
I20260709 13:00:07.217741  3062 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:07.222851  3050 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:07.430699  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:07.222347  3021 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.431150  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:07.223129  3029 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:07.417011  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:07.419219  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 253299us
I20260709 13:00:07.262176  1544 tablet_copy_source_session.cc:215] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.225158  3030 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.278534  2983 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.269313  3020 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:07.264288  3072 raft_consensus.cc:993] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:00:07.387434  3018 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.222110  1603 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:07.437104  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:07.254877  3013 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:07.440948  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 225584us
I20260709 13:00:07.706033  1609 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:07.436036  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:07.409863  3037 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:00:07.401288  2961 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:07.432454  3062 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.260182  3045 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.262965  3001 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.397238  3051 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:07.292239  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:07.436122  3021 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.432564  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:07.349561  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:07.433295  3050 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:07.394004  3040 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.440653  3029 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.747292  1605 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:07.457477  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:07.255148  3046 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.444416  2983 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:07.458185  3020 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:07.509382  3041 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.258782  3069 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.268s
I20260709 13:00:07.322021  3056 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.216s
W20260709 13:00:07.606110  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 161483us
I20260709 13:00:07.761965  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:07.440817  3060 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:07.400684  2999 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:07.442163  2980 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:07.684233  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 78232us
I20260709 13:00:07.437902  3067 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:00:07.440644  3063 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:07.418174  3026 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:07.437757  3005 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:07.723812  3037 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.416901  3023 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:07.704502  3047 consensus_meta.cc:287] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.760s	user 0.006s	sys 0.015s
W20260709 13:00:07.704876  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.719657  2993 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:07.723397  2997 raft_consensus.cc:1081] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:00:07.726903  3072 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:07.727051  3051 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.760129  1525 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:07.741683  3050 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.432411  3061 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:07.758394  2975 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:07.766142  3026 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:07.764545  2980 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:07.776932  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:07.763934  2999 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:07.781742  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:07.782006  2975 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:07.784379  2975 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.779898  3063 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:07.789592  3053 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.789556  3063 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:07.790320  3063 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.777102  3047 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.819686  3054 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:07.821098  3047 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.821523  2975 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:07.822337  2962 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.011s
I20260709 13:00:07.817996  2983 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.823786  2983 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.824738  2975 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.787209  2980 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.822774  2962 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.787648  2999 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.782289  3026 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.779729  3073 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:07.786842  3077 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:07.848147  3051 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.857883  3051 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:07.849893  3046 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.783401  3072 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:07.792323  3020 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.876456  3068 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:07.863683  3076 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:00:07.864012  3083 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:07.876981  3078 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:00:07.860874  3040 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:07.876951  3068 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:07.873456  3069 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:07.877940  3072 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:07.879304  3068 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.890916  3068 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.883996  3062 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.859612  3073 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.862063  3077 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.900836  3063 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:07.902957  3077 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:07.889811  3069 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:07.903345  3063 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.904908  3062 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:07.904214  3069 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.900668  3073 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:07.936498  1530 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:07.951026   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.827639  3001 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.004992  3009 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:08.005574  3009 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:07.977974  2962 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.003976  3022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 284) took 2810 ms. Trace:
I20260709 13:00:08.024474  3023 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.025698  3009 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.026830  3023 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:07.892060  3041 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:08.048565  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 259675us
W20260709 13:00:08.096832  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 304535us
I20260709 13:00:08.065780  2261 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:08.087860  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.020s	sys 0.037s
I20260709 13:00:08.094806  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:08.108775  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 52514.7us
I20260709 13:00:08.069455  2254 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:08.109047  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.048450  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 609113us
W20260709 13:00:08.119956  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.021s	sys 0.040s
W20260709 13:00:08.102190  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.049s
W20260709 13:00:08.127027  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.128536  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:08.129889  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.122964  3069 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:08.133508  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.014s	sys 0.051s
W20260709 13:00:08.109300  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 603962us
I20260709 13:00:08.102969  3020 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.136112  3054 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:08.125209  3009 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.142609  3026 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.146266  2258 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.145182  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.070479  2256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 13:00:08.151118  3021 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.154120  3050 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.155622  1683 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:08.155766  1531 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.156021  1682 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.022476  3022 rpcz_store.cc:276] 0709 13:00:05.192876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.261453 (+ 68577us) service_pool.cc:224] Handling call
0709 13:00:05.896547 (+635094us) ts_tablet_manager.cc:934] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:07.032286 (+1135739us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:07.444236 (+411950us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:07.509810 (+ 65574us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:08.001780 (+491970us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:08.002786 (+  1006us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:08.003495 (+   709us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:08.003663 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":55242,"tablet-copy.queue_time_us":409053,"thread_start_us":564696,"threads_started":2}
I20260709 13:00:08.158651  2999 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.159334  3022 tablet_copy_client.cc:806] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.102525  3013 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.102250  3037 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:08.161764  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 718482us
I20260709 13:00:08.160225  3022 tablet_copy_client.cc:670] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.168708  3029 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.151763  2256 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:08.181087  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.172112  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:08.172911  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.173300  3026 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:08.173771  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.174587  3013 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.176337  3021 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.177218  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.184453  3085 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:08.184916  3021 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:08.184361  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56113.2us
I20260709 13:00:08.181107  2256 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.178259  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.185633  3021 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.192279  3037 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:08.192838  3037 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:08.193953  3037 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.194603  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.194944  3027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ca98d137184e478468c21f485fafa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.154183  2980 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.185088  3085 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.197873  3086 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.201450  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:08.202232  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:08.219467  3041 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.220526  3095 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.221110  3095 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:08.221563  3095 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:08.221758  1647 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:08.199772  3050 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.222059  3094 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:08.222405  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.226004  2260 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.228487  3098 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.230360  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:08.233812  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:08.237923  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.237828  3087 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.239099  3087 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.239688  3087 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.224738  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.243698  2260 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:08.243299  3028 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:08.238641  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.247632  3028 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:08.238535  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:08.245568  2980 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:08.245760  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.248935  3028 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.252473  2258 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:08.252624  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.254091  3028 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.254333  3026 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:08.260951  3026 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.262233  3026 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.256729  3069 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.257187  3085 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:08.257789  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61122.7us
I20260709 13:00:08.259560  3021 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.255630  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:08.266091  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48389.6us
I20260709 13:00:08.268151  3069 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.268424  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.270678  3093 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.271405  3069 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.271358  3093 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.272761  3093 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.270540  3098 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:08.264343  2999 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.278046  3069 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.284534  3054 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.284879  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.287042  1607 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:08.287145  3021 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.285133  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.259614  2256 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.287616  1603 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 13:00:08.319664  3099 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:00:08.344256  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.279374  3041 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:08.341877  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.284688  3069 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:08.350137  2260 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.350831  2257 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.352465  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.350001  3071 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:08.357303  2254 raft_consensus.cc:2368] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:08.356841  3071 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.285406  3029 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.365537  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.347066  3041 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.369139  2961 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:08.371053  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2399691129999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:00:08.377249  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2381691129999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:00:08.371536  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:08.296633  3021 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:08.295208  3094 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.375221  2260 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:08.375597  1682 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:08.383868  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1670691129999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:00:08.389333  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:08.377789  3041 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.318037  3090 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:00:08.395224  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1238691129999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:00:08.389575  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:08.398147  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0878691129999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:00:08.398496  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0662691129999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:00:08.398766  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0545691129999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:00:08.399045  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0437691129999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:00:08.399355  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0194691129999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:00:08.378247  3021 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:08.401539  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.402362  1681 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.408090  2258 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:08.415897  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.436286  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47049.9us
I20260709 13:00:08.391888  3054 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:08.437811  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:08.409955  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.412271  3094 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.448051  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.410089  2968 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.449447  3053 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:08.403743  3037 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.455528  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.455277  3054 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.396028  2961 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.461436  2981 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:08.463829  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.461935  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.463517  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.467144  1606 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.456151  3029 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.471685  1676 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.475907  3071 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.476275  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 514) took 1069 ms. Trace:
I20260709 13:00:08.477160  2257 rpcz_store.cc:276] 0709 13:00:07.406368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.410088 (+  3720us) service_pool.cc:224] Handling call
0709 13:00:07.709444 (+299356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.351450 (+642006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.475793 (+124343us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54005ddc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:08.476073 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385508224}
I20260709 13:00:08.476423  2974 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:08.479693  3020 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:08.479367  2974 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.481884  2974 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.482365  2256 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.468354  3095 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.484762  3095 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:08.486425  3037 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.492120  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.491724  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.488824  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.494283  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.494724  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:08.495535  2257 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 2: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:08.496052  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.497592  3031 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:08.498405  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.500936  1606 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.500648  3021 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.501214  3093 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.501825  3021 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.482029  2961 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.500939  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.498262  3031 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.498413  2256 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.506706  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:08.508859  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.512490  1681 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:08.515843  1606 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.516758  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.518160  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:08.519910  3054 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.519963  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.521016  3094 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.480168  3020 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.509537  2981 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:08.505023  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.521382  3053 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.527308  1531 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:08.520854  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61497.6us
I20260709 13:00:08.518744  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.532879  1606 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:08.537174  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.537405  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.546597  1525 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 1.
I20260709 13:00:08.546789  1530 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:08.596068  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.596283  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.596828  1677 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.598492  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:08.598914  3064 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.600625  3064 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:08.601040  3064 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.603750  1432 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.604888  1674 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:08.606969  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.604732  3029 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.596558  3023 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.609390  3023 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.608800  3029 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:08.610941  3029 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:08.613049  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 160543us
I20260709 13:00:08.614821  2981 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.618067  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.521134  3087 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.532538  3053 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:08.626499  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.625702  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.621758  3018 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:08.646140  3018 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.647866  3087 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.647531  3018 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.619639  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.648658  3018 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.621054  1675 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.645447  1681 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:08.641398  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.632010  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.645125  3053 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.619536  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.622078  3091 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:08.621136  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.625288  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.633644  1683 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.623808  1428 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.654052  1674 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.680166  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.680542  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.681144  1605 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.664757  1676 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:08.671672  1681 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:08.654430  3091 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:08.676474  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.677018  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:08.689726  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.690210  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:08.678129  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46261.7us
I20260709 13:00:08.679119  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.666999  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:08.674793  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.675747  1525 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.677011  1530 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:08.674026  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45464.6us
I20260709 13:00:08.679674  1677 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:08.678591  1680 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.674929  1608 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:08.709546  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.703949  3087 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:00:08.657234  3103 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:08.679450  3027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 288) took 2986 ms. Trace:
I20260709 13:00:08.676903  3022 tablet_copy_client.cc:538] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.668349  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.676832  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.719028  1683 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
W20260709 13:00:08.677690  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.720232  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.722398  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.729251  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:08.729051  2968 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.667477  1428 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:08.721938  1680 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:08.730784  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:08.733103  1681 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:08.677778  2993 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:08.734805  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.678488  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.705585  3085 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:08.743736  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.745580  1677 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.670253  3093 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.625692  3041 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.741721  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.736765  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:08.737582  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:08.715816  3053 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:08.747476  1525 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:08.748613  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58503us
I20260709 13:00:08.750797  1678 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.751008  1605 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:08.752651  3088 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:08.755353  1530 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.751936  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:08.715898  1674 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:08.668550  3029 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.759121  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.753309  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.763692  1680 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.764406  1529 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.765110  1530 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.766129  1533 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.767822  3018 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.747087  3087 consensus_queue.cc:1243] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:08.770843  3087 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.749635  2980 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.774211  3023 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.743345  3085 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:08.776945  3085 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.777403  3098 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:08.777835  3098 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:08.774544  1676 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.778964  3098 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:08.780282  1676 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:08.746906  2999 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:08.835544  1526 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:08.816900  1525 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.836338  3041 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.816876  3009 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.819458  3031 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.821347  3091 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.810736  2968 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:00:08.837540  3009 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.840413  1682 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.803119  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.818818  1681 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.793669  1606 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.793483  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.788831  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:08.843030  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70345.5us
I20260709 13:00:08.843588  1676 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:08.845182  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 93527.8us
I20260709 13:00:08.816294  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.845837  3026 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.857190  1532 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.857424  3028 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:08.857900  3009 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.846796  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:08.847473  2968 consensus_queue.cc:1243] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:08.860455  3054 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:08.861196  3054 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:08.862136  3054 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.862960  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.821569  1534 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:08.840488  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 102046us
W20260709 13:00:08.866000  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.867743  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.758599  3013 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:08.864679  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:08.875396  1601 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.823149  3064 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:08.881399  3064 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:08.825968  1674 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.882483  3085 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.882880  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:08.822257  3029 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.774251  2980 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:08.796937  3098 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:08.891677  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61668us
I20260709 13:00:08.933630  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:08.932369  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 184415us
I20260709 13:00:08.918092  1678 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
W20260709 13:00:08.933166  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 179035us
I20260709 13:00:08.900674  1675 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
W20260709 13:00:08.902992  1498 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0746dbce2334050a0a5359c93c14f2c. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:08.938890  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48457.5us
I20260709 13:00:08.926157  1530 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.940557  1679 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:08.942085  3020 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.943677  3085 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:08.947528  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:08.949571  1530 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:08.948685  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57341.4us
W20260709 13:00:08.953577  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 192718us
I20260709 13:00:08.954263  3095 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.954577  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.956404  3020 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.961299  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:08.962407  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.965749  1531 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.938005  2980 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:08.965989  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.967218  1532 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:08.967984  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.965173  3091 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.968806  3087 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:08.969923  1525 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:08.970450  3110 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:08.972388  3095 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:08.972856  3095 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:08.973831  3095 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.973861  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.975154  3095 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.976563  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.976781  3071 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.977022  2993 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:08.977378  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:08.977852  2961 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:08.723767  3027 rpcz_store.cc:276] 0709 13:00:05.691974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.693001 (+  1027us) service_pool.cc:224] Handling call
0709 13:00:06.570967 (+877966us) ts_tablet_manager.cc:934] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:08.189090 (+1618123us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:08.413816 (+224726us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:08.443993 (+ 30177us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:08.677579 (+233586us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:08.677868 (+   289us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:08.678522 (+   654us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:08.678641 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":286,"tablet-copy.queue_time_us":421452,"thread_start_us":464350,"threads_started":2}
I20260709 13:00:08.978641  2961 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:08.983960   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.981737  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:08.982206  3110 consensus_queue.cc:1243] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:08.997718  2980 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:08.998607  2256 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:08.999120  2980 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:08.892838  2999 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 13:00:09.002140  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.960265  3064 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:09.007938  3064 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:09.008375  3064 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.010619  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:09.011334  2256 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.012966  1525 raft_consensus.cc:2410] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:09.013566  1573 leader_election.cc:400] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:09.013898  1573 leader_election.cc:403] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:09.014816  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.015190  2974 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:09.016391  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.017166  1532 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:09.017987  3092 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.018574  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:09.018673  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.019526  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.020466  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:09.021353  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.021631  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:09.005374  3029 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.022238  3029 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:09.022591  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.022940  1527 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:09.023336  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.024233  1533 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.024905  1534 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.025007  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.025594  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:09.025714  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.006400  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:09.026386  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.026785  2254 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:09.007081  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:09.005009  2961 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.021641  3087 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.021503  3009 raft_consensus.cc:2764] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:00:09.028616  3087 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.026387  1534 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.029560  3087 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.030061  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.024755  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:09.019704  1528 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.004866  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.036957  1530 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:09.031559  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.028152  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.032277  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:09.004017  1601 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:09.027557  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.040633  1609 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:09.038509  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.044811  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:09.043887  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:09.023977  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.045378  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:09.048686  1532 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.050797  1601 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.049335  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:09.053158  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.053752  1533 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.053895  1534 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.047992  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.049075  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:09.021272  3111 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.059176  1606 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:09.059293  3111 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.052821  3090 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.061741  3090 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:09.062683  3090 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.055568  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:09.058023  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.067061  1532 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.068251  1607 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:09.041424  3009 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:09.068270  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:09.070667  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:09.071980  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 98360.2us
I20260709 13:00:09.072228  1677 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.049074  3026 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.076254  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:09.070530  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.080554  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:09.084237  1677 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:09.072485  1527 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.070490  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.091023  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:09.091594  2256 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:09.093410  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.049275  3086 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:09.084622  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:09.099695  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.099956  3027 tablet_copy_client.cc:806] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:09.100456  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:09.100983  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.100996  2993 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.104116  1527 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.104372  3041 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:09.107292  1530 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:09.083611  3022 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:09.060357  3111 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.111865  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.112730  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:09.023187  3029 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.113981  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.064669  3098 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:09.119026  1683 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:09.090973  3110 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:09.098519  3009 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:09.124142  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.118134  1677 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.127311  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.127909  1677 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.113744  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.128813  3037 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.120520  3027 tablet_copy_client.cc:670] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:09.123538  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.129114  2962 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.131361  3053 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:09.132752  3029 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.118767  3071 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.134406  3037 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.144441  3037 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.134991  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:09.136986  3009 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.136183  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.140575  2962 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.119545  3041 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.150871  1677 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.152504  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.152909  2962 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.153301  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:09.153833  3071 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:09.154695  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.126757  3054 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.156550  3094 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:09.157956  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.146013  3092 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.163017  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.172700  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.159190  3098 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.154902  3041 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.180016  3098 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.180935  3013 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.181432  3013 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.181761  3098 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.177214  3071 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:09.193817  3071 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:09.181851  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:09.194288  3071 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.216028  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:09.216228  3114 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:00:09.216528  3027 tablet_copy_client.cc:538] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:09.216908  3112 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.218464  3086 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.219619  3086 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.219971  3086 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.220943  3086 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.223297  3112 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.224581  1533 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:09.224464  3112 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.227512  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:09.268987  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.269858  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.182399  2980 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:09.160487  3064 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.164036  3054 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.317636  1607 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:09.279112  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.276333  1680 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.336272  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:09.344023  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:09.348893  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:09.349535  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.329119  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:09.352082  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.350752  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:09.346696  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:09.392680  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46130.1us
I20260709 13:00:09.393512  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:09.393767  1606 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:09.394392  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.310609  3013 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:09.332422  2962 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:09.340718  3093 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.366189  3095 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:09.276571  3050 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:09.361575  3110 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.362962  2993 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:09.309155  3086 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:09.408793  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 181346us
I20260709 13:00:09.364189  2974 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:09.403713  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 43934us
I20260709 13:00:09.399040  3053 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:09.409468  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.351429  2961 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:09.402220  2980 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.661904  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:09.402896  3085 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:09.401675  3023 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.676546  2255 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:09.630913  1602 raft_consensus.cc:1217] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:09.679301  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:09.666106  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:09.521502  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 239406us
I20260709 13:00:09.460662  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:09.419332  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:09.662904  1604 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:09.482798  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.680033  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.693672  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:09.701231  1601 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:09.521034  3113 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:00:09.624128  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.007s
I20260709 13:00:09.704526  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:09.706280  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.009s	sys 0.007s
W20260709 13:00:09.706924  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 652171us
I20260709 13:00:09.702862  1525 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 2: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:09.529784  3106 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:00:09.692062  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.602874  3027 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:09.579310  3064 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:09.712810  1531 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:09.713393  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.712795  1609 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.457705  3026 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.539696  1603 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:09.720502  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:09.721472  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:09.721910  3064 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:09.722675  3064 consensus_queue.cc:1243] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:09.514078  3117 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:09.711884  1530 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:09.547890  3054 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:09.521621  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.416766  3069 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.418584  3095 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:09.707123  2255 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:09.529309  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.603575  3071 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.522396  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.719447  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:09.532714  3110 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.740123  2968 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.740592  1601 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:09.741233  2968 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:09.741345  1527 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:09.741616  2968 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:09.719990  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.420152  3093 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.470945  3050 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:09.714700  1602 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:09.725982  3117 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:09.744503  3117 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.744885  3110 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:09.744786  3050 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.745811  1682 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.477120  3121 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.333s
I20260709 13:00:09.730597  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:09.711122  3053 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:09.735304  3137 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:09.736714  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:09.636755  3094 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:00:09.740127  1676 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:09.691886  3085 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:09.748966  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.760453  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.733399  3054 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:09.742250  1529 raft_consensus.cc:2376] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2. Re-sending same reply.
I20260709 13:00:09.733757  3095 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.741374  3071 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:09.763020  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51256.1us
I20260709 13:00:09.764870  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:09.710558  2993 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.728683  3089 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:00:09.782809  2993 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:09.768606  1528 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:09.738210  3069 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:09.764986  3085 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:09.794025  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47594.7us
I20260709 13:00:09.794544  1607 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:09.764918  3054 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:09.788103  2974 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:09.804360  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49260.5us
I20260709 13:00:09.784924  3088 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:00:09.820967  1679 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:09.824782  3134 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:09.838555  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:09.835887  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:09.795894  2968 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:09.898427  3141 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:00:09.837093  2961 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:09.941169  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72067.6us
W20260709 13:00:09.945509  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 118225us
I20260709 13:00:09.789108  2980 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.948611  3140 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:09.952939  2974 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:09.964764  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 209053us
W20260709 13:00:09.966624  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 139289us
I20260709 13:00:09.968220  2961 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:09.972548  3130 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:00:09.974028  3146 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:09.942130  3093 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.945140  3145 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:09.943712  3053 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:09.969470  3121 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:09.969517  3144 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:09.999308  3147 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:10.003885  3145 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:09.995694  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 272421us
I20260709 13:00:09.949381  1602 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:10.002597  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.073619  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.074667  3142 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.075683  3142 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.076051  3142 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.993348  2968 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.077548  3148 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 13:00:10.138659  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65130.1us
I20260709 13:00:10.139815  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.140720  3071 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:09.993614  3054 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.061954  3098 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:00:10.032408  3117 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:09.995769  3140 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 13:00:10.178786  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 223375us
W20260709 13:00:10.183079  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.185017  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 192) took 1063 ms. Trace:
W20260709 13:00:10.185850  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.172488  3088 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.195787  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.172955  3069 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:10.197052  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57359.3us
W20260709 13:00:10.182647  3086 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.002s
I20260709 13:00:10.172755  3131 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.185544  1532 rpcz_store.cc:276] 0709 13:00:09.117677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.117814 (+   137us) service_pool.cc:224] Handling call
0709 13:00:09.118089 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.120930 (+  2841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.120958 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.136899 (+ 15941us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.142735 (+  5836us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4800080058. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:00:09.398348 (+255613us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:09.398389 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.398451 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.153767 (+755316us) raft_consensus.cc:1685] finished
0709 13:00:10.153789 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.180888 (+ 27099us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16500,"raft.queue_time_us":5013,"raft.run_cpu_time_us":2132,"raft.run_wall_time_us":18923,"spinlock_wait_cycles":5012224,"thread_start_us":259283,"threads_started":1,"wal-append.queue_time_us":652350}
I20260709 13:00:10.187498  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:10.204542  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 209792us
I20260709 13:00:10.148674  3149 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:00:10.213033  3071 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:10.214272  3071 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.214704  3071 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.194586  3145 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.216758  3145 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.218428  3117 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.212956  3151 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.222136  3151 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:10.202901  3088 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.205657  3054 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.224504  3151 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.226128  3151 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.227499  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.207401  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.234040  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.234872  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:10.205760  1600 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:10.242345  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.243355  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.206384  3142 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.248068  3156 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.249938  3156 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.250689  3156 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.253620  3150 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.254987  3155 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.267067  3092 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.267704  3092 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.270043  3092 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:10.274080  2961 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:10.274731  3156 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.238422  2974 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.215891  3071 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:10.288089  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44856us
I20260709 13:00:10.291379  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:10.291947  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84637.8us
W20260709 13:00:10.290910  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 84723.6us
I20260709 13:00:10.295471  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.246755  3095 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:10.310184  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.313956  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.318593  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:10.319235  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.299481  2974 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.323220  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:10.323971  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.300877  3071 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.326699  3150 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.327175  3150 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.327669  3150 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.300550  3149 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.332929  3149 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.333436  3142 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.333827  3159 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.334242  3159 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.337065  3159 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.322815  3117 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:10.299973  3085 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.335012  2980 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:10.341241  3140 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.341503  3117 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.357890  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.357116  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.349709  1674 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:10.358842  3037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.010s	sys 0.017s
I20260709 13:00:10.350292  3088 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.352080  3053 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:10.357640  3117 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.370199  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.364972  3160 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.373971  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:10.367655  3037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.010s	sys 0.017s
I20260709 13:00:10.348271  3050 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:00:10.375736  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 158) took 1328 ms. Trace:
I20260709 13:00:10.376158  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.379406  1680 rpcz_store.cc:276] 0709 13:00:09.044674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.044805 (+   131us) service_pool.cc:224] Handling call
0709 13:00:09.055827 (+ 11022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.333836 (+278009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.372835 (+1038999us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540007c6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:10.373041 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396997888}
I20260709 13:00:10.362146  2980 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.383426  3144 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.383857  3144 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:10.385063  2980 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.384696  3144 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.386008  3144 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:10.387259  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.366410  3142 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:10.389464  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.383333  3022 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.390965  3095 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.391433  3140 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.392073  3085 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.372864  3053 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.388820  3149 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.401669  3029 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.433307  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.433385  3029 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.434376  3112 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.429901  3021 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.437000  3021 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.432636  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.437500  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:10.438306  3112 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:10.438704  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.439512  3112 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.441892  3021 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.435984  3029 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.443615  3022 tablet_bootstrap.cc:492] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:10.443636  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.448570  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.449894  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.451514  1683 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.454855  3098 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.371433  1602 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:10.455761  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:10.454447  1574 connection.cc:256] RPC call timeout handler was delayed by -1.8398868880000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:00:10.457465  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.457716  1683 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.458289  3053 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.459007  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.417958  3143 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:10.460392  3112 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.461621  1532 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.456147  1679 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.465389  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:10.466517  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57000.2us
I20260709 13:00:10.467552  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:10.467811  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:10.460724  3037 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:10.467881  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.468667  1678 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:10.469251  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.401837  3142 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.470634  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.469264  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.478428  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.479980  1530 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.481077  3022 ts_tablet_manager.cc:1403] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.447s	user 0.027s	sys 0.067s
I20260709 13:00:10.481411  1683 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:10.481364  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.482180  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:10.482293  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.482728  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:10.482947  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.483990  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.503626  1527 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.503834  1531 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.504973  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.505676  1531 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.506425  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.507117  1531 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.507339  3159 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.484645  3112 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.508576  1677 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:10.508785  3112 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.470763  3037 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.485942  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.486261  3054 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:10.484750  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.492733  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.463048  3143 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.511612  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:10.509261  3142 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.514407  1530 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.524116  1531 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.526995  1676 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:10.517522  1528 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.524833  3143 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.530007  2254 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:10.489583  3029 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.475014  3150 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:10.536932  3127 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.836s	user 0.006s	sys 0.005s
I20260709 13:00:10.522118  3037 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:10.540498  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54623.6us
I20260709 13:00:10.531494  3149 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.531688  3173 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:00:10.532033  3131 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:10.548475  3131 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.549299  3112 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.551983  3131 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.555138  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.556845  3037 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:10.582958  3110 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.583855  3037 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.585597  3117 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.586814  1609 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.585902  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.588006  3110 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.589366  3150 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.590516  1527 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:10.591333  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:10.600859  1604 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.584092  3159 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.593575  3143 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.594287  1679 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:10.589380  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.602576  1678 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
W20260709 13:00:10.596578  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74006.1us
I20260709 13:00:10.582600  3022 raft_consensus.cc:359] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:10.605542  3022 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:10.606669  3159 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.608479  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.608968  3071 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:10.609225  3159 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:10.610307  3132 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:10.614521  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:10.614876  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.615703  3144 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.616562  3020 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.617358  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.618212  1532 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:10.618525  3144 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.618943  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:10.623023  3085 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.624131  1532 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:10.610602  3071 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.625623  3071 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:10.625890  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.625288  3054 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.624924  2258 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:10.626449  3054 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.627534  3054 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.628360  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.629146  3092 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.610472  3022 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:10.621767  1530 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:10.622605  2961 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.630750  2961 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.631814  3098 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.632355  3098 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.626390  3071 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.632946  2961 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.633563  3071 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.630780  3092 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:10.635489  3098 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.635723  1525 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:10.635648  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1435) took 1478 ms (client timeout 1911 ms). Trace:
I20260709 13:00:10.624725  3111 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:10.636292  1534 rpcz_store.cc:269] 0709 13:00:09.157591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.157714 (+   123us) service_pool.cc:224] Handling call
0709 13:00:10.635414 (+1477700us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54000d48d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:10.635564 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070910208}
I20260709 13:00:10.637535  3142 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.637939  3142 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.638640  3142 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.639703  3142 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.640727  3138 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.641077  3138 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:10.641230  1603 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:10.641896  3138 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.643458  3138 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.617121  3020 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.624819  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.620460  2257 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.619922  3140 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:10.629180  3054 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.645779  1604 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:10.597131  3117 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.650857  3020 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:10.651769  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.637071  3111 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.653674  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.651898  1528 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:10.677619  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45373.8us
I20260709 13:00:10.647210  3027 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.671963  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 291) took 1328 ms. Trace:
I20260709 13:00:10.678479  3149 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.678764  3098 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.687587  2257 rpcz_store.cc:276] 0709 13:00:09.343474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.351697 (+  8223us) service_pool.cc:224] Handling call
0709 13:00:10.620058 (+1268361us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:10.620242 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.646984 (+ 26742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.671886 (+ 24902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6789376}
I20260709 13:00:10.696174  1676 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.648432  2961 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:10.653210  3110 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.678903  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 182) took 2262 ms. Trace:
I20260709 13:00:10.694494  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1442) took 1234 ms. Trace:
I20260709 13:00:10.670307  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.680970  3117 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.712740  3117 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.687186  3071 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:10.715116  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:10.716804  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 69632.4us
I20260709 13:00:10.717252  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.718361  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:10.718660  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.719280  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:10.713616  3151 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:00:10.647897  3150 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:10.709856  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.710090  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:10.700107  1526 rpcz_store.cc:276] 0709 13:00:09.460194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.460355 (+   161us) service_pool.cc:224] Handling call
0709 13:00:10.694355 (+1234000us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540042c2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:10.694447 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167089408}
I20260709 13:00:10.711531  3155 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.680298  3111 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.720867  3027 tablet_bootstrap.cc:492] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:10.730180  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:10.624171  3085 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.707772  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.732441  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:10.732735  1676 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:10.689971  3092 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.670475  3131 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:00:10.722211  3098 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.746166  3177 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:10.746711  3177 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.748353  3177 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.721776  3117 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.751646  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.728260  2974 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.749253  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.751019  1676 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:10.725402  3155 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:10.733799  2962 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.734391  3020 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:10.762770  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:10.770093  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.771263  1601 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.778695  1680 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:10.772967  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.778713  1601 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.780525  1601 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.781520  1601 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.785739  1601 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:10.660395  3140 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.725728  3071 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:10.744129  3111 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.725693  2961 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.770717  3027 ts_tablet_manager.cc:1403] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.168s	user 0.054s	sys 0.026s
I20260709 13:00:10.792080  3173 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.751443  3132 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.793056  2962 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.793344  3111 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.811124  3111 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.811643  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 298) took 2344 ms. Trace:
I20260709 13:00:10.797981  3176 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:00:10.773723  3159 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:10.801185  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 100635us
I20260709 13:00:10.802940  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.803694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.822125  1604 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:10.705955  3149 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.805075  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:10.805217  2258 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.805840  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:10.813093  3156 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:10.805873  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:10.806866  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:10.835877  2261 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.836107  1606 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:10.807940  2253 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Advancing to term 2
I20260709 13:00:10.807801  3098 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:10.808799  1674 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:10.809190  2961 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.778026  3151 consensus_queue.cc:1243] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:10.741662  3092 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.698945  1432 rpcz_store.cc:276] 0709 13:00:08.434177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.456064 (+ 21887us) service_pool.cc:224] Handling call
0709 13:00:10.675564 (+2219500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.823644 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.824336 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.824392 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:00:08.824430 (+    38us) tablet.cc:662] Decoding operations
0709 13:00:08.824919 (+   489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.824988 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.825019 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:08.825336 (+   317us) tablet.cc:701] Row locks acquired
0709 13:00:08.825385 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:00:08.825552 (+   167us) write_op.cc:270] Start()
0709 13:00:08.825722 (+   170us) write_op.cc:276] Timestamp: P: 1783602008825491 usec, L: 0
0709 13:00:08.825771 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.826532 (+   761us) log.cc:844] Serialized 536 byte log entry
0709 13:00:09.124420 (+297888us) op_driver.cc:464] REPLICATION: finished
0709 13:00:09.521171 (+396751us) write_op.cc:301] APPLY: starting
0709 13:00:09.521292 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:09.521399 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:09.522270 (+   871us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:09.522602 (+   332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:09.522822 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:09.522869 (+    47us) write_op.cc:312] APPLY: finished
0709 13:00:09.528663 (+  5794us) log.cc:844] Serialized 23 byte log entry
0709 13:00:09.528857 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.528929 (+    72us) write_op.cc:454] Released schema lock
0709 13:00:09.528978 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:09.529325 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.529353 (+    28us) write_op.cc:454] Released schema lock
0709 13:00:09.755057 (+225704us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.761243 (+  6186us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":789,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":319079,"apply.run_cpu_time_us":2228,"apply.run_wall_time_us":17699,"num_ops":1,"prepare.queue_time_us":180988,"prepare.run_cpu_time_us":22911,"prepare.run_wall_time_us":120925,"raft.queue_time_us":318467,"raft.run_cpu_time_us":58167,"raft.run_wall_time_us":660978,"replication_time_us":285185,"thread_start_us":461807,"threads_started":4,"wal-append.queue_time_us":131108,"wal-append.run_cpu_time_us":17579,"wal-append.run_wall_time_us":1576082}]]}
I20260709 13:00:10.789633  3094 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:10.821477  1605 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:10.804760  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:10.823803  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 131033us
I20260709 13:00:10.851461  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:10.851397  1682 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
W20260709 13:00:10.852562  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.812057  1428 rpcz_store.cc:276] 0709 13:00:08.467234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.471968 (+  4734us) service_pool.cc:224] Handling call
0709 13:00:10.811574 (+2339606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.944673 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.945214 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.945243 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:00:08.945261 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:08.982057 (+ 36796us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.982114 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.982152 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:08.997268 (+ 15116us) tablet.cc:701] Row locks acquired
0709 13:00:08.997292 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:00:08.997440 (+   148us) write_op.cc:270] Start()
0709 13:00:08.997564 (+   124us) write_op.cc:276] Timestamp: P: 1783602008997396 usec, L: 0
0709 13:00:08.997591 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.998234 (+   643us) log.cc:844] Serialized 1175 byte log entry
0709 13:00:09.457775 (+459541us) op_driver.cc:464] REPLICATION: finished
0709 13:00:09.529658 (+ 71883us) write_op.cc:301] APPLY: starting
0709 13:00:09.529727 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:09.529833 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:09.529916 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:09.530287 (+   371us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:09.530429 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:09.530473 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:09.530626 (+   153us) log.cc:844] Serialized 29 byte log entry
0709 13:00:09.530761 (+   135us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.530831 (+    70us) write_op.cc:454] Released schema lock
0709 13:00:09.530861 (+    30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1141775,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":52532,"apply.run_cpu_time_us":1430,"apply.run_wall_time_us":1431,"num_ops":2,"prepare.queue_time_us":179760,"prepare.run_cpu_time_us":3101,"prepare.run_wall_time_us":53817,"replication_time_us":420688,"thread_start_us":265396,"threads_started":1}]]}
I20260709 13:00:10.825572  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.826735  3188 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.806524  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:10.806552  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:10.836653  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 114255us
I20260709 13:00:10.859809  2260 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:10.797170  3179 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:10.789361  3117 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:10.788818  3020 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.823376  1600 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:10.842481  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:10.815258  3087 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:00:10.832049  3159 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:10.835602  3156 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:10.865036  1606 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:10.865069  1605 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:10.866436  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:10.846160  3064 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.857169  3022 ts_tablet_manager.cc:1434] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.344s	user 0.006s	sys 0.006s
I20260709 13:00:10.868116  3176 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:10.870038  3180 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.850034  3094 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:10.851046  3143 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:10.878366  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 56845.8us
I20260709 13:00:10.880875  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01534d11942740ccb67a981fcde65180"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:10.881551  3027 raft_consensus.cc:359] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:10.977842  3027 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:10.905195  3085 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.871551  3050 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.896627  3156 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:10.910532  3131 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:10.902778  3020 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:10.905311  1529 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.909071  3071 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:10.897271  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1439) took 1547 ms. Trace:
I20260709 13:00:10.859835  3069 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:10.988584  3085 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.988806  3069 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.989208  3069 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.989168  3085 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.989563  3131 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.978498  3182 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:10.991160  3182 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:10.991586  3182 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.991874  3131 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.904160  3159 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.992727  3085 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:10.902257  3110 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.866281  3151 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.943975  1609 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.952667  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:10.877480  3188 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:10.958315  3146 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:10.859472  2255 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:10.960944  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94561.2us
I20260709 13:00:10.910684  3149 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:10.897554  2961 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:00:11.015594  3137 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:10.963937  3037 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:00:10.966481  3178 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.026538  3178 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.966841  3180 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.954185  3098 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.962375  3064 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.961536  3179 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.969439  1603 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:10.978279  1602 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.965008  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.986902  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:10.996397  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:10.988602  1533 rpcz_store.cc:276] 0709 13:00:09.349415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.351799 (+  2384us) service_pool.cc:224] Handling call
0709 13:00:10.897027 (+1545228us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003430d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:10.897201 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175876864}
I20260709 13:00:10.998979  1609 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:10.844208  3181 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
I20260709 13:00:11.015020  3146 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:11.044138  3160 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:11.048928  3160 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:11.020933  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.022677  3069 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.023232  3188 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:11.024802  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:11.052086  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:10.871796  3155 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.052488  3121 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.052757  3069 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:10.981606  3027 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:11.056728  3027 ts_tablet_manager.cc:1434] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.242s	user 0.007s	sys 0.001s
I20260709 13:00:10.985906  3050 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:11.049983  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66939.4us
I20260709 13:00:11.033970  2254 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:11.055270  3054 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:11.066465  3054 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:11.066843  3181 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.067194  3181 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:11.067531  3054 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.068913  1609 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.070062  1609 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.058418  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.053211  3142 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:11.059708  1675 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:11.041965  1602 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:11.078261  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:11.027527  3178 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.053875  3092 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:11.039822  3098 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.089872  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.075652  3140 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.098131  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.043807  3184 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:00:11.075299  3142 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:11.100354  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 346876us
I20260709 13:00:11.068145  3181 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.103116  3181 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.106734  1606 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:11.086097  3037 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:11.088182  1430 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.049292  3146 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:11.109069  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 295291us
I20260709 13:00:11.081519  3138 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.053993  3179 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.108724  3037 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:11.042636  3094 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.099424  3069 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.107645  3110 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:11.126607  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.127558  1606 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:11.129747  1606 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:11.131196  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.132068  3138 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:11.132416  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:11.133216  3138 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.133682  3138 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:11.136735  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.137480  1534 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:11.136756  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.124351  3037 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.113494  3151 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.134245  1533 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:11.125038  3146 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.133615  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.115741  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:11.141894  1534 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.145236  1533 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.144351  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.145996  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.148101  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.149053  1534 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.099398  3064 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.134423  3112 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.148778  1526 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.151917  1531 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:11.137576  3094 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.137310  3050 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.145536  1606 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.148609  2961 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:11.154541  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.155041  3188 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:11.156405  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.170511  1606 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.165409  3112 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.158916  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:11.159037  3085 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:11.159968  3142 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.159997  3020 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:11.161777  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.181792  2257 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:11.162000  3098 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.140806  1603 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:11.184336  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.182157  3140 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:11.190878  1605 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:11.164165  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.164284  3064 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.164690  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:11.151453  3176 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.096539  3160 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.167347  2252 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.168435  1531 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:11.129294  3069 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.202401  3069 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:11.084801  3180 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.173910  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.204228  2260 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:11.176807  3112 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.169823  3144 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:11.170161  3188 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:11.176546  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.152819  3110 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.135187  1602 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.209672  1679 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:11.208576  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.214540  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:11.221938  1606 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:11.223539  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:11.179828  3145 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:11.233989  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:11.213253  3188 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:11.239104  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.226493  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:11.239769  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.227572  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.203459  3180 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.203387  2962 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:11.232973  3183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:11.256052  3121 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.255931  3098 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:11.223505  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.225034  1526 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:11.245352  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.229709  3181 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:11.251087  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.231308  3021 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.251106  1675 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:11.230000  3088 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.204329  3176 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.267867  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.258890  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.266435  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.269624  1675 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:11.270664  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:11.268510  3181 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.264933  1679 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:11.272578  3140 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:11.276401  1604 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:11.279937  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:11.230538  3138 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.229813  3131 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:11.309898  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.318482  2252 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Advancing to term 2
I20260709 13:00:11.321563  1606 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:11.259574  3050 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:11.296193  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:11.287151  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.312040  3121 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:11.282841  3029 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.291878  1530 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:11.313170  3176 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.316673  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.282620  3021 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:11.301367  1531 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.339468  3021 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.262056  3156 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.309808  3140 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:11.345316  3140 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.345714  3140 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.336086  3112 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:11.333096  3179 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.283027  3026 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:11.326390  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:11.342011  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.363612  1607 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.342324  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.342567  3021 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:11.344017  3173 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:11.340842  3121 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.344857  1532 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:11.343561  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.346293  3112 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.373728  3112 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.359419  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:11.366935  1675 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.276530  3088 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.376976  2256 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:11.339056  3037 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.327548  3182 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:11.414459  3187 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:00:11.431262  3121 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:11.403542  3111 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.002s
I20260709 13:00:11.436188  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.339725  3029 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.433410  3158 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.439067  1604 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:11.446975  1606 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:11.371414  3026 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.450465  3026 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:11.458966  3029 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.461804  3037 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:11.462319  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.446681  3111 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.464533  3151 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.464090  3021 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.473307  3182 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.476748  1534 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:11.477764  3181 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:11.478137  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.479010  3188 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.481213  3188 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:11.481243  2261 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:11.481688  3041 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:11.455106  3158 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:11.477672  1526 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:11.475430  3156 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:11.487632  1683 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:11.487473  2962 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:11.493407  3131 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:11.495184  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:11.503101  3131 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:11.503652  3131 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.504070  3131 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:11.506649  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.511130  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 151795us
W20260709 13:00:11.511927  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 168460us
I20260709 13:00:11.515551  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.516467  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.517134  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.517305  3069 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.518549  3069 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.518574  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.521207  1607 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:11.521404  1532 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:11.522262  1534 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:11.524187  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.010s	sys 0.034s
I20260709 13:00:11.527343  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:11.528451  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.529353  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.010s	sys 0.056s
W20260709 13:00:11.529683  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.010s	sys 0.056s
I20260709 13:00:11.517063  3089 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:11.525794  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.010s	sys 0.034s
W20260709 13:00:11.540722  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 687870us
W20260709 13:00:11.543709  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 481438us
I20260709 13:00:11.520140  3160 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.544665  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.553455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.498891  3158 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.559439  3158 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.562855  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.565573  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.569700  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.572515  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.574682  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.587262  1534 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
I20260709 13:00:11.589622  1675 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:11.590648  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.591349  1534 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:11.528154  3111 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.594753  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.543732  3151 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.543916  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1516) took 1062 ms. Trace:
I20260709 13:00:11.597482  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.530701  3029 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:00:11.597482  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.543286  3182 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:11.603242  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:11.588598  3144 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.616567  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.617314  1530 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.606997  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.608139  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:11.567899  1600 raft_consensus.cc:606] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:11.622196  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.622474  2256 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.614348  3182 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:11.625216  2259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.022s	sys 0.024s
W20260709 13:00:11.625612  2259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.022s	sys 0.024s
I20260709 13:00:11.601104  3069 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:11.604104  1529 rpcz_store.cc:276] 0709 13:00:10.479641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.513219 (+ 33578us) service_pool.cc:224] Handling call
0709 13:00:10.905085 (+391866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.988018 (+ 82933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.524639 (+536621us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54003430d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:11.542406 (+ 17767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882151168}
I20260709 13:00:11.624161  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:11.626176  3182 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.631707  2968 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:11.641542  1526 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:11.641821  2968 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:11.642230  2968 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:11.618541  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.644001  1675 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:11.645610  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.644397  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.647581  2968 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.649258  2968 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:11.203516  3143 consensus_queue.cc:1175] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:11.656787  3155 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.657218  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.658283  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:11.663286  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:11.659096  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:11.661017  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.719859  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:11.721220  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:11.564685  3156 consensus_queue.cc:1175] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8ff9782cd95483c905cd1d906f41aaf" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:11.723539  3094 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:00:11.826218  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:11.827847  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.632105  3179 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:00:11.647428  1544 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a266117eb57049ceb80c4acd77766559 received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:11.839556  1544 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-a266117eb57049ceb80c4acd77766559 on tablet a266117eb57049ceb80c4acd77766559 with peer 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:11.728544  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.019s	sys 0.027s
W20260709 13:00:11.841125  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.020s	sys 0.031s
I20260709 13:00:11.846199  1677 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:11.848484  3190 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:11.849362  3190 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:11.853758  3190 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:11.855938  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.855832  3041 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:11.858561  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:11.859488  1526 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:11.861143  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:11.864476  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.869241  1530 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:11.873257  1543 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e2ca98d137184e478468c21f485fafa4 received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:11.874221  1543 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e2ca98d137184e478468c21f485fafa4 on tablet e2ca98d137184e478468c21f485fafa4 with peer 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:11.880690  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.762104  2980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.006s	sys 0.051s
I20260709 13:00:11.889955  3064 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:11.890585  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.027s	sys 0.041s
I20260709 13:00:11.890993  3064 consensus_queue.cc:1243] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:00:11.891698  2980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.008s	sys 0.051s
I20260709 13:00:11.847364  3069 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:11.891016  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.027s	sys 0.041s
I20260709 13:00:11.894274  3069 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:11.895330  3069 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:11.897365  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:11.831307  3026 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:11.917048  3026 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.917470  3026 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:11.930533  1682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.014s	sys 0.027s
W20260709 13:00:11.931095  1682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.015s	sys 0.028s
W20260709 13:00:11.932668  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.024s	sys 0.026s
W20260709 13:00:11.933105  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.024s	sys 0.026s
W20260709 13:00:11.962589  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 95977.5us
I20260709 13:00:11.978988  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.980381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:11.981060  1682 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:11.932469  3087 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.006s	sys 0.036s
I20260709 13:00:11.832182  3021 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:11.832420  3182 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.833004  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.827872  2258 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.629199  3173 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:11.637992  3176 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:11.988251  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.831060  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:11.914726  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 545) took 1109 ms. Trace:
W20260709 13:00:11.930295  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.024s	sys 0.031s
W20260709 13:00:11.882077  3177 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.023s	sys 0.053s
I20260709 13:00:11.976842  3092 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:11.897228  2253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.000s	sys 0.002s
I20260709 13:00:11.865394  3137 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
W20260709 13:00:12.001349  1680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.001s	sys 0.007s
I20260709 13:00:11.993757  1675 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:11.588634  3189 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:00:11.994215  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:11.881788  3112 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.001811  1601 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 2: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:11.988098  3159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.003s	sys 0.032s
W20260709 13:00:11.996061  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.025s	sys 0.031s
I20260709 13:00:12.007606  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:11.985126  3087 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.007s	sys 0.036s
W20260709 13:00:11.999992  3177 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.024s	sys 0.053s
W20260709 13:00:12.001246  2253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.003s
W20260709 13:00:12.010772  1430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.046s	sys 0.036s
W20260709 13:00:12.001760  1680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.002s	sys 0.007s
W20260709 13:00:12.003762  3178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.007s	sys 0.011s
I20260709 13:00:11.982947  2962 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:00:12.013417  1430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.047s	sys 0.036s
I20260709 13:00:12.014737  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:12.006100  3142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.008s	sys 0.010s
I20260709 13:00:11.996707  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.023866  1525 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:11.993696  2259 rpcz_store.cc:276] 0709 13:00:10.805737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.806008 (+   271us) service_pool.cc:224] Handling call
0709 13:00:10.806356 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.806559 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:11.625949 (+819390us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.914317 (+288368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.914375 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:11.914420 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.914505 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.914659 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38669,"prepare.queue_time_us":1098344,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":145,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":158777600,"thread_start_us":1042680,"threads_started":2,"wal-append.queue_time_us":288308}
I20260709 13:00:12.032006  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:12.032737  1675 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:12.008319  3159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.004s	sys 0.032s
W20260709 13:00:12.022121  3178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.008s	sys 0.011s
W20260709 13:00:12.030532  3142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.011s
I20260709 13:00:12.030839  3176 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:12.027319  3054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.010s	sys 0.019s
I20260709 13:00:12.050237  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:12.042101  3140 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.696s	user 0.004s	sys 0.009s
I20260709 13:00:11.997702  3182 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:12.000913  3179 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:12.030913  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.059099  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:12.068044  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.083966  2260 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
W20260709 13:00:12.053259  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.000s	sys 0.015s
W20260709 13:00:12.044001  2252 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.710s	user 0.004s	sys 0.007s
I20260709 13:00:12.098366  3182 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:12.085727  3176 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:12.084522  3054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.011s	sys 0.019s
I20260709 13:00:12.042872  3173 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:12.133986  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.019s	sys 0.027s
W20260709 13:00:12.251492  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.019s	sys 0.027s
I20260709 13:00:12.054926  3098 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.136639  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.132203  1675 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
W20260709 13:00:12.157166  3160 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
W20260709 13:00:12.157483  3219 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:00:12.131577  3178 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:12.270911  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:12.271747  1675 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:12.167708  3158 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.608s	user 0.002s	sys 0.006s
I20260709 13:00:12.170142  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1299) took 1219 ms. Trace:
I20260709 13:00:12.173642  3112 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.266119  3146 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:12.282469  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.275247  3178 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.283221  2254 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:12.284674  3178 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.174503  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 546) took 1368 ms. Trace:
I20260709 13:00:12.052407  3137 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
W20260709 13:00:12.215180  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.156093  3199 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.245s	user 0.002s	sys 0.002s
I20260709 13:00:12.132283  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1297) took 1181 ms. Trace:
W20260709 13:00:12.252936  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.094825  3026 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:12.185426  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.000s	sys 0.015s
I20260709 13:00:12.251291  3194 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.274585  1678 rpcz_store.cc:276] 0709 13:00:10.951131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.056392 (+105261us) service_pool.cc:224] Handling call
0709 13:00:11.056769 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.057113 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.057140 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.057634 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.933534 (+875900us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:11.933585 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.933677 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.169807 (+236130us) raft_consensus.cc:1685] finished
0709 13:00:12.169834 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.170061 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3461,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":2756,"spinlock_wait_cycles":78592,"thread_start_us":875508,"threads_started":1,"wal-append.queue_time_us":973034}
I20260709 13:00:12.336251  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 1517) took 1210 ms. Trace:
I20260709 13:00:12.335441  3194 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.336639  1677 rpcz_store.cc:276] 0709 13:00:11.131180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.217075 (+ 85895us) service_pool.cc:224] Handling call
0709 13:00:12.336031 (+1118956us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000ed3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:12.336154 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376808704}
I20260709 13:00:12.249112  3176 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:12.268836  1498 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.632s (SENT) [suppressed 27 similar messages]
I20260709 13:00:12.338372  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1314) took 1003 ms. Trace:
I20260709 13:00:12.338769  1677 rpcz_store.cc:276] 0709 13:00:11.336477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.337561 (+1001084us) service_pool.cc:224] Handling call
0709 13:00:12.337890 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.338048 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.338074 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.338115 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.338146 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.338211 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.338313 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.251827  2980 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.101135  3140 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.249871  3181 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:12.137305  2257 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:12.302127  1674 rpcz_store.cc:276] 0709 13:00:10.950634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.002458 (+ 51824us) service_pool.cc:224] Handling call
0709 13:00:11.015701 (+ 13243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.015937 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.015968 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.016777 (+   809us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.024397 (+1007620us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.033963 (+  9566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.050488 (+ 16525us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.052527 (+  2039us) raft_consensus.cc:1685] finished
0709 13:00:12.055048 (+  2521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.100723 (+ 45675us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":944531,"threads_started":1,"wal-append.queue_time_us":856376}
I20260709 13:00:12.297979  2253 rpcz_store.cc:276] 0709 13:00:10.806074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.807417 (+  1343us) service_pool.cc:224] Handling call
0709 13:00:10.807768 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.180741 (+372973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.182657 (+  1916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.231915 (+ 49258us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.044152 (+812237us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:12.100955 (+ 56803us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.174125 (+ 73170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.174218 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.174284 (+    66us) raft_consensus.cc:1685] finished
0709 13:00:12.174299 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.174431 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38884,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1813,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":3111,"thread_start_us":764104,"threads_started":1,"wal-append.queue_time_us":660695}
I20260709 13:00:12.320680  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1312) took 1051 ms. Trace:
I20260709 13:00:12.271144  3098 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.322120  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.271521  3173 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:12.326656  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:12.327320  3137 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:12.320742  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.373756  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47199.5us
I20260709 13:00:12.328022  3160 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:12.288036  2252 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:12.331786  3180 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.332499  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:12.333772  3191 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.431s	user 0.002s	sys 0.000s
I20260709 13:00:12.363380  1682 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:12.363915  1675 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:12.365141  2968 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.335404  3223 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.421s	user 0.000s	sys 0.002s
I20260709 13:00:12.365765  3088 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.413697  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.366438  1532 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:12.372898  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.414983  2258 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:12.368184  1683 rpcz_store.cc:276] 0709 13:00:11.269214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.491098 (+221884us) service_pool.cc:224] Handling call
0709 13:00:11.491378 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.528330 (+ 36952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.528370 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.543015 (+ 14645us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.915468 (+372453us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:11.915625 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.915692 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.156839 (+241147us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:12.320357 (+163518us) raft_consensus.cc:1685] finished
0709 13:00:12.320380 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.320613 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55820,"raft.queue_time_us":34342,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15434,"spinlock_wait_cycles":27272960,"thread_start_us":314519,"threads_started":1,"wal-append.queue_time_us":338198}
I20260709 13:00:12.301630  3158 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.364351  3131 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.005s
W20260709 13:00:12.382288  1531 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.017s	sys 0.018s
W20260709 13:00:12.423132  1531 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.017s	sys 0.018s
W20260709 13:00:12.376931  3138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.007s	sys 0.027s
I20260709 13:00:12.406713  2261 raft_consensus.cc:1217] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:12.430721  2261 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: [1.2-1.2]
W20260709 13:00:12.406873  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.044s	sys 0.130s
I20260709 13:00:12.371078  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:12.382205  3021 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:12.427930  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.036s
I20260709 13:00:12.392632  3180 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:12.431633  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.045s	sys 0.130s
I20260709 13:00:12.369747  2980 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.371196  3181 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:12.421638  1603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.015s	sys 0.021s
W20260709 13:00:12.435088  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.017s	sys 0.021s
I20260709 13:00:12.382314  3137 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.426342  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 549) took 1154 ms. Trace:
W20260709 13:00:12.447455  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.017s	sys 0.021s
W20260709 13:00:12.434854  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.036s
I20260709 13:00:12.437855  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:12.411311  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:12.441203  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 171) took 1635 ms. Trace:
I20260709 13:00:12.427809  2254 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:12.421677  2968 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.433902  3194 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:12.433840  3140 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.439074  3021 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:12.468662  1600 raft_consensus.cc:614] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:12.429932  3158 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:12.473246  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.479264  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1301) took 1485 ms. Trace:
W20260709 13:00:12.482987  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.036s
W20260709 13:00:12.482868  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.028s
W20260709 13:00:12.485805  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.008s	sys 0.028s
W20260709 13:00:12.485445  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.004s	sys 0.036s
I20260709 13:00:12.482720  1676 rpcz_store.cc:276] 0709 13:00:10.994042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.061569 (+ 67527us) service_pool.cc:224] Handling call
0709 13:00:11.061898 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.062287 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.062313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.062782 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.841705 (+778923us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:11.841752 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.841835 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.155404 (+313569us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:12.472241 (+316837us) raft_consensus.cc:1685] finished
0709 13:00:12.472266 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.479170 (+  6904us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2166,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":157921152,"thread_start_us":778470,"threads_started":1,"wal-append.queue_time_us":847944}
I20260709 13:00:12.460270  2253 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:12.486128  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 618848us
I20260709 13:00:12.431891  3131 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.448655  1608 rpcz_store.cc:276] 0709 13:00:10.800771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.804105 (+  3334us) service_pool.cc:224] Handling call
0709 13:00:10.804459 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.823346 (+ 18887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.823375 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.839230 (+ 15855us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.547242 (+708012us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:11.917872 (+370630us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.918112 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.918193 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.333095 (+414902us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:12.414428 (+ 81333us) raft_consensus.cc:1685] finished
0709 13:00:12.435953 (+ 21525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.436162 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26329,"prepare.queue_time_us":372479,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":84365,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":11083,"spinlock_wait_cycles":195230976,"thread_start_us":988255,"threads_started":2,"wal-append.queue_time_us":1055463}
W20260709 13:00:12.452834  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.015s	sys 0.022s
W20260709 13:00:12.489409  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 590934us
W20260709 13:00:12.430537  3138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.008s	sys 0.027s
I20260709 13:00:12.496892  2968 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.497504  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 183) took 1207 ms. Trace:
I20260709 13:00:12.503822  1609 rpcz_store.cc:276] 0709 13:00:11.289977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.432214 (+142237us) service_pool.cc:224] Handling call
0709 13:00:11.456234 (+ 24020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.483406 (+ 27172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.483441 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.510752 (+ 27311us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.270685 (+759933us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.270724 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.270799 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.497295 (+226496us) raft_consensus.cc:1685] finished
0709 13:00:12.497319 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.497446 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8908,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9548,"thread_start_us":424030,"threads_started":1,"wal-append.queue_time_us":930263}
I20260709 13:00:12.505699  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:12.506316  1609 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:12.506464  3131 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.507545  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:12.507772  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:12.479820  3021 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:12.508508  3160 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:12.509061  3160 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.509450  3160 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:12.511685  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.010s	sys 0.033s
W20260709 13:00:12.512475  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.017s	sys 0.026s
I20260709 13:00:12.512780  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:12.514714  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:12.508509  2254 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:00:12.512081  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.010s	sys 0.033s
I20260709 13:00:12.515970  3088 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:12.521122  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:12.519701  3160 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.530578  3088 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.531200  3088 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.532235  2254 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
W20260709 13:00:12.512797  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.017s	sys 0.026s
I20260709 13:00:12.501608  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:12.453419  2252 rpcz_store.cc:276] 0709 13:00:11.267832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.268592 (+   760us) service_pool.cc:224] Handling call
0709 13:00:11.318318 (+ 49726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.392358 (+1074040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.421865 (+ 29507us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.545989  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.497593  3026 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:12.457171  3173 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:12.549863  1609 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:12.577370  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.019s
I20260709 13:00:12.558007  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:12.584824  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83295.5us
I20260709 13:00:12.492542  3180 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:12.584609  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.047s
W20260709 13:00:12.545854  3209 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:00:12.605789  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.018s	sys 0.047s
I20260709 13:00:12.604573  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:12.557405  3205 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:00:12.575731  2255 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.011s
I20260709 13:00:12.543287  2968 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:12.585870  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.017s	sys 0.019s
W20260709 13:00:12.573290  3155 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.916s	user 0.008s	sys 0.004s
I20260709 13:00:12.610849  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:12.611142  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:12.551285  3160 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.615391  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:12.575592  3159 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:12.584184  3098 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:12.575512  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:12.603894  3178 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.677527  3178 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:12.677743  3054 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:12.678290  3054 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:12.678610  3178 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.679171  3054 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:12.680903  3233 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:12.681779  3159 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.654651  1530 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:12.655720  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44673.2us
I20260709 13:00:12.656867  1525 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:12.657049  1526 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:12.583271  3088 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:12.659296  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:12.605373  3050 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.670915  3156 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:12.673130  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 318) took 1062 ms. Trace:
I20260709 13:00:12.675027  2253 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:12.676525  3026 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:12.677364  2256 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:12.616937  2255 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.011s	sys 0.012s
I20260709 13:00:12.792474  2261 rpcz_store.cc:276] 0709 13:00:11.610818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.621642 (+ 10824us) service_pool.cc:224] Handling call
0709 13:00:12.406560 (+784918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.431126 (+ 24566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.672899 (+241773us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54008002d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:12.673059 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803861760}
I20260709 13:00:12.684038  3159 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:12.762471  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.000s	sys 0.033s
W20260709 13:00:12.813109  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.000s	sys 0.033s
W20260709 13:00:12.767880  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.008s	sys 0.051s
W20260709 13:00:12.813931  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.009s	sys 0.051s
I20260709 13:00:12.619095  3092 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:12.764459  3041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.032s	sys 0.032s
I20260709 13:00:12.775992  3160 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:12.778584  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:12.842343  1676 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:12.779349  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:12.859401  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 590545us
I20260709 13:00:12.840648  3092 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:12.913401  3207 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
I20260709 13:00:12.786265  1675 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:12.783772  3093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.021s	sys 0.026s
I20260709 13:00:12.764345  3098 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:12.838177  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1305) took 1763 ms. Trace:
W20260709 13:00:12.939116  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.859234  1529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.022s	sys 0.049s
W20260709 13:00:12.844828  3041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.032s	sys 0.033s
I20260709 13:00:12.813530  3180 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.660439  2968 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:12.973549  1529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.025s	sys 0.060s
W20260709 13:00:12.942116  3093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.022s	sys 0.027s
I20260709 13:00:12.857800  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1330) took 1512 ms. Trace:
I20260709 13:00:12.974445  1680 rpcz_store.cc:276] 0709 13:00:11.074880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.258566 (+183686us) service_pool.cc:224] Handling call
0709 13:00:11.258901 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.259237 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.259266 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.263041 (+  3775us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.013653 (+750612us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.013697 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.013774 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.837941 (+824167us) raft_consensus.cc:1685] finished
0709 13:00:12.837965 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.838113 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30000,"raft.queue_time_us":3501,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":12412,"thread_start_us":748651,"threads_started":1,"wal-append.queue_time_us":1174658}
W20260709 13:00:12.980877  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.055s	sys 0.150s
I20260709 13:00:12.981057  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1281) took 2280 ms. Trace:
W20260709 13:00:12.994661  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.055s	sys 0.150s
I20260709 13:00:12.816826  3156 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.810354  3050 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.942747  3155 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.858198  3235 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.993145  1681 rpcz_store.cc:276] 0709 13:00:10.696513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.696794 (+   281us) service_pool.cc:224] Handling call
0709 13:00:11.177885 (+481091us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:11.178035 (+   150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.178374 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.178398 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.178800 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.251946 (+1073146us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.251990 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.252068 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.915039 (+662971us) raft_consensus.cc:1685] finished
0709 13:00:12.915060 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.976752 (+ 61692us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2836,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8275,"spinlock_wait_cycles":10262912,"thread_start_us":1072768,"threads_started":1,"wal-append.queue_time_us":1377499}
W20260709 13:00:12.999002  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.048s	sys 0.061s
W20260709 13:00:13.007265  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.048s	sys 0.062s
I20260709 13:00:12.942373  3086 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:12.893611  3160 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.010206  3069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.030s	sys 0.054s
I20260709 13:00:12.841217  3026 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.009083  3210 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:00:13.022931  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:13.038126  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.018s	sys 0.009s
W20260709 13:00:13.038528  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.018s	sys 0.009s
I20260709 13:00:13.041062  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 206) took 1470 ms. Trace:
I20260709 13:00:13.041443  1531 rpcz_store.cc:276] 0709 13:00:11.570673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.571441 (+   768us) service_pool.cc:224] Handling call
0709 13:00:11.571761 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.571987 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:12.423587 (+851600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.040044 (+616457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.040100 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:13.040144 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.040237 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.041002 (+   765us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327430,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":1439497,"threads_started":2}
I20260709 13:00:13.008773  3041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56394 (request call id 11) took 4462 ms. Trace:
W20260709 13:00:13.017351  3069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.030s	sys 0.054s
W20260709 13:00:13.045694  1605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.029s	sys 0.074s
W20260709 13:00:13.054620  1605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.030s	sys 0.075s
I20260709 13:00:13.060075  3146 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.060627  3146 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:13.061444  3224 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:13.062698  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 212) took 1463 ms. Trace:
I20260709 13:00:13.069483  1534 rpcz_store.cc:276] 0709 13:00:11.599291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.599495 (+   204us) service_pool.cc:224] Handling call
0709 13:00:11.599795 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.627508 (+ 27713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.627543 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.643242 (+ 15699us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.448396 (+805154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.448433 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.448496 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.062457 (+613961us) raft_consensus.cc:1685] finished
0709 13:00:13.062476 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.062630 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46,"raft.queue_time_us":14358,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":131,"thread_start_us":618791,"threads_started":1,"wal-append.queue_time_us":1249487}
I20260709 13:00:13.055173  3232 ts_tablet_manager.cc:933] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:13.009636  3155 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.048275  3110 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.007606  3098 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.101856  3231 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:13.016860  3235 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.024360  3086 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:13.096899  3215 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 13:00:13.097223  3213 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
I20260709 13:00:13.080902  3071 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:13.108798  1602 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:13.107499  3110 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:12.992388  1603 rpcz_store.cc:276] 0709 13:00:11.345620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.478644 (+133024us) service_pool.cc:224] Handling call
0709 13:00:11.479075 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.487835 (+  8760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.488072 (+   237us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.488592 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.534494 (+1045902us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:12.543604 (+  9110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.583949 (+ 40345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.857417 (+273468us) raft_consensus.cc:1685] finished
0709 13:00:12.857445 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.857709 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8197,"raft.queue_time_us":8589,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":1010317,"threads_started":1,"wal-append.queue_time_us":1326198}
W20260709 13:00:13.133090  3220 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:00:13.134069  3092 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.134713  3221 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:00:13.135896  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1332) took 1634 ms. Trace:
I20260709 13:00:13.136386  1606 rpcz_store.cc:276] 0709 13:00:11.501403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.597668 (+ 96265us) service_pool.cc:224] Handling call
0709 13:00:11.597991 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.598373 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.598401 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.612813 (+ 14412us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.447946 (+835133us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.447989 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.448072 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.135574 (+687502us) raft_consensus.cc:1685] finished
0709 13:00:13.135599 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.135802 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3348,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6355,"thread_start_us":803707,"threads_started":1,"wal-append.queue_time_us":1033860}
I20260709 13:00:13.141748  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:13.142488  1603 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.143746  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1338) took 1284 ms. Trace:
I20260709 13:00:13.123426  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1520) took 1977 ms. Trace:
I20260709 13:00:13.144399  1601 rpcz_store.cc:276] 0709 13:00:11.855298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.897040 (+ 41742us) service_pool.cc:224] Handling call
0709 13:00:13.139602 (+1242562us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b5400454cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:13.139783 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194519936}
I20260709 13:00:13.148383  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.149163  1601 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:13.122895  3071 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:13.159847  2260 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:13.165448  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1329) took 1820 ms. Trace:
I20260709 13:00:13.165935  1604 rpcz_store.cc:276] 0709 13:00:11.345321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.453480 (+108159us) service_pool.cc:224] Handling call
0709 13:00:11.457050 (+  3570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.457250 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.457275 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.474298 (+ 17023us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.578298 (+1104000us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.578339 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.578412 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.165192 (+586780us) raft_consensus.cc:1685] finished
0709 13:00:13.165215 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.165375 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1103578,"threads_started":1,"wal-append.queue_time_us":1211099}
I20260709 13:00:13.171202  3069 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:13.172202  3069 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.171411  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1333) took 1669 ms. Trace:
I20260709 13:00:13.173919  1607 rpcz_store.cc:276] 0709 13:00:11.501828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.623010 (+121182us) service_pool.cc:224] Handling call
0709 13:00:11.625509 (+  2499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.625740 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.625765 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.626218 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.813609 (+1187391us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.813654 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.813733 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.171012 (+357279us) raft_consensus.cc:1685] finished
0709 13:00:13.171041 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.171249 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":985993,"threads_started":1,"wal-append.queue_time_us":1402790}
I20260709 13:00:13.175040  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.176069  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 191) took 1142 ms. Trace:
I20260709 13:00:13.177938  1606 rpcz_store.cc:276] 0709 13:00:12.033647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.148157 (+1114510us) service_pool.cc:224] Handling call
0709 13:00:13.175983 (+ 27826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.173570  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1313) took 1894 ms. Trace:
I20260709 13:00:13.179347  1678 rpcz_store.cc:276] 0709 13:00:11.279415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.336109 (+1056694us) service_pool.cc:224] Handling call
0709 13:00:12.336555 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.336957 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.336984 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.337466 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.995219 (+657753us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:12.995277 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.995365 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.173265 (+177900us) raft_consensus.cc:1685] finished
0709 13:00:13.173289 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.173473 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25443,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":11710,"thread_start_us":657293,"threads_started":1,"wal-append.queue_time_us":722815}
W20260709 13:00:13.164355  3240 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:13.185406  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:13.192453  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.188282  1680 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:13.195914  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:13.196674  1604 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:13.198625  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:13.198151  3088 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:13.204205  3138 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.202199  3159 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.209136  3244 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.253993  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 167) took 1696 ms. Trace:
I20260709 13:00:13.231086  3183 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.255093  1604 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:13.256127  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1328) took 1940 ms. Trace:
I20260709 13:00:13.255018  1677 rpcz_store.cc:276] 0709 13:00:11.557700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.361521 (+803821us) service_pool.cc:224] Handling call
0709 13:00:12.364870 (+  3349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.366167 (+  1297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.366196 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.370743 (+  4547us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.007787 (+637044us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:13.007827 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.007895 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.253716 (+245821us) raft_consensus.cc:1685] finished
0709 13:00:13.253751 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.253917 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":693,"raft.queue_time_us":802,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":636647,"threads_started":1,"wal-append.queue_time_us":688751}
I20260709 13:00:13.256537  1605 rpcz_store.cc:276] 0709 13:00:11.315614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.440969 (+125355us) service_pool.cc:224] Handling call
0709 13:00:11.452680 (+ 11711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.453030 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.453057 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.482718 (+ 29661us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.438777 (+956059us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:13.056213 (+617436us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.255130 (+198917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.255215 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.255909 (+   694us) raft_consensus.cc:1685] finished
0709 13:00:13.255925 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.256073 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":705232,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":9527,"raft.queue_time_us":3092,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":1734572,"threads_started":3,"wal-append.queue_time_us":1123688}
W20260709 13:00:13.281641  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111130us
I20260709 13:00:13.282451  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:13.238848  2256 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:13.205739  3071 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.308557  1677 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:13.253975  3086 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:13.280684  3234 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
W20260709 13:00:13.282375  3021 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.002s
I20260709 13:00:13.311177  1605 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:13.247021  3138 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.261008  3155 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.286510  3194 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:13.147709  1679 rpcz_store.cc:276] 0709 13:00:11.143437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.274140 (+130703us) service_pool.cc:224] Handling call
0709 13:00:11.274484 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.274869 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.274900 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.275407 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.334882 (+1059475us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.334961 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.335069 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.105598 (+770529us) raft_consensus.cc:1685] finished
0709 13:00:13.105623 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.121035 (+ 15412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":628,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":1058491,"threads_started":1,"wal-append.queue_time_us":1208589}
W20260709 13:00:13.315337  3243 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:13.315852  3250 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:13.316716  3237 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:00:13.316987  3245 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:13.317911  3098 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:13.318353  3026 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.321900  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1535) took 1792 ms. Trace:
I20260709 13:00:13.053244  3041 rpcz_store.cc:276] 0709 13:00:08.523576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.525178 (+  1602us) service_pool.cc:224] Handling call
0709 13:00:08.602540 (+ 77362us) log.cc:844] Serialized 506 byte log entry
0709 13:00:08.960067 (+357527us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b180020f200. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:12.985894 (+4025827us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7125,"raft.run_cpu_time_us":1927,"raft.run_wall_time_us":22596,"spinlock_wait_cycles":39067008,"thread_start_us":236278,"threads_started":2,"wal-append.queue_time_us":215987,"wal-append.run_cpu_time_us":2030,"wal-append.run_wall_time_us":1003310}
I20260709 13:00:13.253504  3159 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.250351  3088 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.327399  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136498us
I20260709 13:00:13.265184  3244 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.328892  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:13.347175  1605 rpcz_store.cc:276] 0709 13:00:11.529628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.276777 (+1747149us) service_pool.cc:224] Handling call
0709 13:00:13.310948 (+ 34171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.321632 (+ 10684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.321840 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.278451  3183 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.315208  3092 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:13.415710  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 203) took 1862 ms (client timeout 2246 ms). Trace:
I20260709 13:00:13.413662  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:13.325964  3227 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.456657  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 127877us
W20260709 13:00:13.458353  1532 rpcz_store.cc:269] 0709 13:00:11.553017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.553174 (+   157us) service_pool.cc:224] Handling call
0709 13:00:13.415516 (+1862342us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400343ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:13.415652 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867522432}
I20260709 13:00:13.324355  3054 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.323256  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1463) took 1483 ms. Trace:
I20260709 13:00:13.410944  3086 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.473018  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.325975  3021 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.457247  3098 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:13.487511  1573 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:13.487931  1573 leader_election.cc:403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:13.493837  1674 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:13.495042  3176 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.127s	user 0.021s	sys 0.007s
I20260709 13:00:13.495383  3088 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:13.495492  3176 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.485781  3111 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:13.413908  3250 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.496758  3111 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.497481  3262 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.497838  3183 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.498387  3250 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.413007  3026 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:00:13.499153  3111 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:13.479565  3226 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.489427  3041 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.503458  1603 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:13.333302  3194 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:13.473206  3255 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:13.416013  3245 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:13.509452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.510118  1603 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 1.
I20260709 13:00:13.511147  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:13.511700  1603 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:13.496147  3088 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.513136  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 219) took 1652 ms. Trace:
I20260709 13:00:13.513330  1608 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:13.490531  3069 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.518613  3232 tablet_copy_client.cc:323] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:13.520110  3245 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.520653  3245 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:13.521322  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43204 (request call id 14) took 2663 ms. Trace:
I20260709 13:00:13.521123  3245 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.521620  1532 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:13.483502  3086 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.489606  3098 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:13.515061  1526 rpcz_store.cc:276] 0709 13:00:11.860740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.860863 (+   123us) service_pool.cc:224] Handling call
0709 13:00:13.512966 (+1652103us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000b4ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:13.513080 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828737280}
I20260709 13:00:13.475346  1529 rpcz_store.cc:276] 0709 13:00:11.839722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.873078 (+ 33356us) service_pool.cc:224] Handling call
0709 13:00:11.873584 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.997174 (+1123590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.999942 (+  2768us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.063827 (+ 63885us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.260134 (+196307us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:13.282290 (+ 22156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.286347 (+  4057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.305932 (+ 19585us) raft_consensus.cc:1685] finished
0709 13:00:13.308529 (+  2597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.320579 (+ 12050us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122581,"raft.queue_time_us":166042,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9631,"thread_start_us":1123934,"threads_started":2,"wal-append.queue_time_us":190167}
I20260709 13:00:13.517207  3088 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.512632  3029 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:13.518086  3250 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:13.499490  3050 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.499538  3244 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:13.533792  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.499874  3226 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.503113  3142 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.525966  3255 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:13.524117  3214 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.868s	user 0.008s	sys 0.002s
W20260709 13:00:13.545337  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 262972us
I20260709 13:00:13.524120  3086 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.481554  3054 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:13.551441  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 558) took 1157 ms. Trace:
W20260709 13:00:13.535015  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.575513  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.503839  3254 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.473768  3227 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.530357  3098 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.586863  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 187) took 1524 ms. Trace:
I20260709 13:00:13.522480  1600 rpcz_store.cc:276] 0709 13:00:10.863060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.880694 (+ 17634us) service_pool.cc:224] Handling call
0709 13:00:12.468523 (+1587829us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540017e920. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aae520 00007f7e63b2b652 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:13.521027 (+1052504us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54001bcbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2b853 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:13.521193 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424141312}
I20260709 13:00:13.508641  3041 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:13.633109  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.649277  1603 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:13.536247  3190 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:13.572244  3064 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:13.541589  3029 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:13.654910  2260 rpcz_store.cc:276] 0709 13:00:12.394452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.047673 (+653221us) service_pool.cc:224] Handling call
0709 13:00:13.048042 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.160408 (+112366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.551064 (+390656us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400515254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:13.551355 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236344064}
I20260709 13:00:13.550961  3183 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:13.666908  3252 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:13.669469  3226 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.572597  3250 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:13.670424  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 256826us
W20260709 13:00:13.849556  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 250063us
I20260709 13:00:13.853019  3029 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:13.854161  3029 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.783813  3138 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:13.869038  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:13.595991  3244 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.648442  3142 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.870529  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:13.871068  3249 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:13.871273  3261 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:13.872061  1608 rpcz_store.cc:276] 0709 13:00:12.032249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.544744 (+512495us) service_pool.cc:224] Handling call
0709 13:00:13.555950 (+1011206us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400349ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:13.556142 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136118656}
I20260709 13:00:13.888041  3111 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.888569  3111 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.890659  3111 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:13.891721  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.675028  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:13.893852  2255 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:13.894819  3244 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.897373  3244 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:13.898074  3244 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.673951  3254 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.899612  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.593015  3260 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.671535  3245 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:13.937670  3214 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:00:13.902223  3247 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:13.883412  3253 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.880118  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.906173  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:13.965021  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58936.5us
I20260709 13:00:13.876394  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:13.966095  2260 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:13.912884  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.966290  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114526us
I20260709 13:00:13.884877  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:13.967216  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:13.967921  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 83104us
I20260709 13:00:13.968652  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:13.969743  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:13.970795  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:13.874168  3041 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.972460  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:13.972467  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:13.958518  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:13.940232  3258 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.959709  3159 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:13.905206  3183 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.904676  3190 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.995584  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:13.998339  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 434584us
I20260709 13:00:13.939131  3244 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.973851  1574 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:13.997321  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:13.901484  3142 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:13.977008  3026 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:13.963025  3021 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.001147  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:14.001857  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.976222  1600 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:14.007138  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:13.976591  3249 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:13.993840  3069 raft_consensus.cc:2764] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:13.999173  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:13.977761  3245 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:14.027709  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:13.997193  3064 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.013473  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:14.003664  3264 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.019090  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:13.998608  3261 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:14.044644  3245 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:14.045853  3245 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.011845  3026 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:14.050256  3146 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.989s	user 0.009s	sys 0.001s
I20260709 13:00:14.050527  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1456) took 2763 ms. Trace:
I20260709 13:00:14.024606  2257 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:14.051458  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.026683  3088 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.053301  3158 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.054055  3158 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.054457  3158 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.054845  3158 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.057089  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 175) took 2445 ms. Trace:
I20260709 13:00:14.032747  3064 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:14.058377  3064 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.025612  3263 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:14.059046  3263 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:14.060079  3263 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.057564  1674 rpcz_store.cc:276] 0709 13:00:11.611853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.426941 (+815088us) service_pool.cc:224] Handling call
0709 13:00:12.473876 (+ 46935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.494311 (+1020435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.056817 (+562506us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001d8b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:14.057020 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342103936}
I20260709 13:00:14.062541  2968 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.023290  1608 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:14.002859  3262 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:14.069082  3262 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.069830  3262 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.033517  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:14.003451  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:13.959192  3260 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.006222  3138 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.003063  3258 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.036057  2260 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:13.964073  3247 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:13.672341  3255 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.037928  3254 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.038614  3227 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.039387  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:14.044106  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.009668  3159 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:00:14.074514  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:14.189364  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 155932us
I20260709 13:00:14.079226  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.199819  1601 raft_consensus.cc:2410] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:14.010990  3268 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.206861  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:14.070385  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:14.058302  1602 consensus_meta.cc:287] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.926s	user 0.009s	sys 0.000s
W20260709 13:00:14.211383  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 208011us
I20260709 13:00:14.050175  3026 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:14.215548  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 210240us
W20260709 13:00:14.093303  3180 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.089s	user 0.011s	sys 0.000s
I20260709 13:00:14.193121  2259 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:14.218541  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:14.214468  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:14.224398  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.225883  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.226279  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.227692  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.228396  1679 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:14.229291  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.229928  1679 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:14.230909  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.231536  1680 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:14.138221  3271 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.082022  3176 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.202021  3183 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.248200  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.202235  3256 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.248952  1683 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:14.075644  3137 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.239108  1603 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:14.079643  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.079767  3110 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.239734  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.220288  3254 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.259240  1680 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:14.241545  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.231389  3142 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.196012  3029 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.201781  2968 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.262329  1679 raft_consensus.cc:2410] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:14.242954  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.089316  3190 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.195923  3248 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.090605  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:14.247489  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:14.220324  3173 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.050783  3146 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.256629  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:14.276327  1678 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.215564  3088 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.075326  3156 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.214773  3138 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.087990  3158 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.239575  3180 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.237336  3021 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:14.240195  3259 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:14.240171  3272 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.273561  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.275369  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.259306  1602 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:14.258980  2980 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.287074  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:14.287034  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 68579.8us
I20260709 13:00:14.262400  3250 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.264780  2968 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.249647  3098 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.097463  3264 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.264580  3029 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:14.302351  3021 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.309062  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.310045  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1316) took 3564 ms. Trace:
W20260709 13:00:14.310547  3117 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:14.287319  3286 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:14.289907  3069 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.312952  2226 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
I20260709 13:00:14.324133  1674 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.051023  1528 rpcz_store.cc:276] 0709 13:00:11.286961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.309668 (+ 22707us) service_pool.cc:224] Handling call
0709 13:00:11.335856 (+ 26188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.371796 (+ 35940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.403397 (+ 31601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.452017 (+ 48620us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.516093 (+1064076us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:12.518371 (+  2278us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.518618 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.518722 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.523586 (+1004864us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:14.005540 (+481954us) raft_consensus.cc:1685] finished
0709 13:00:14.024793 (+ 19253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.050418 (+ 25625us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59581,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":5478,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":32405,"spinlock_wait_cycles":4442496,"thread_start_us":1063590,"threads_started":1,"wal-append.queue_time_us":1203452}
I20260709 13:00:14.266607  3142 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.298508  1600 raft_consensus.cc:2410] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:14.250967  3271 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.315722  3138 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.271733  3248 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:14.327718  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 113322us
I20260709 13:00:14.329988  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.349159  1606 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:14.282939  3173 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.330986  1678 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:14.292183  3088 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.260325  3256 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.321343  2968 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.339015  2226 leader_election.cc:403] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:14.303002  3259 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.336254  1675 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:14.344401  1609 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:14.324678  3160 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.325299  3244 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.343361  3286 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.326099  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:14.334870  3182 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.460172  1682 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:14.304960  3272 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:14.454413  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.458119  3280 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:00:14.426316  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:14.332162  1602 rpcz_store.cc:276] 0709 13:00:10.745406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.777662 (+ 32256us) service_pool.cc:224] Handling call
0709 13:00:10.828186 (+ 50524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.978179 (+149993us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b54003a0d20. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:00:13.055289 (+2077110us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5800490ad0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63a8d0aa 00007f7e63b0f447 00007f7e63b27fe7 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:00:14.304471 (+1249182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.309927 (+  5456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031433344}
W20260709 13:00:14.428103  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 115300us
I20260709 13:00:14.495857  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:14.338580  3258 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.512027  3271 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.459045  3248 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.437829  3160 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.540360  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.538792  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 112593us
I20260709 13:00:14.543735  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:14.434058  3180 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:00:14.520961  3268 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:14.436031  3069 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
I20260709 13:00:14.556979  3259 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.557497  3248 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.560492  3263 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.559935  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:14.437515  3182 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.527339  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:14.565832  3283 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:00:14.526775  3235 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:14.573276  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.553139  3244 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.597065  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:14.608493  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48745.7us
I20260709 13:00:14.618136  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:14.562511  3258 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:14.621822  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:14.603516  3029 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.554586  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.552866  3138 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.605304  3266 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.609247  3263 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.564333  3160 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.669116  2255 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
W20260709 13:00:14.670763  3295 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:00:14.675757  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:14.676580  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50055.2us
I20260709 13:00:14.612932  3271 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.610512  3250 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.614753  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:14.656950  3244 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.619697  3260 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.682927  1602 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.532886  3293 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:00:14.698144  3301 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:14.700901  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1334) took 3197 ms. Trace:
I20260709 13:00:14.715132  1607 rpcz_store.cc:276] 0709 13:00:11.503103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.184144 (+1681041us) service_pool.cc:224] Handling call
0709 13:00:13.202975 (+ 18831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.543128 (+340153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.543159 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.904810 (+361651us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.198643 (+293833us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:14.198693 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.198766 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.700671 (+501905us) raft_consensus.cc:1685] finished
0709 13:00:14.700691 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.700838 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83,"raft.queue_time_us":125400,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":79156,"thread_start_us":549262,"threads_started":2,"wal-append.queue_time_us":387519}
I20260709 13:00:14.658927  3180 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:14.623584  3156 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:14.618538  1600 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 13:00:14.691393  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 166577us
I20260709 13:00:14.642439  3235 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:14.728076  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:14.695072  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:14.679100  3138 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.705569  3181 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.682541  3266 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.710145  3263 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.679385  3098 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.669579  3248 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:00:14.720708  3290 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:00:14.727042  3244 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.721832  3180 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:14.682593  3250 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.721946  3156 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.744803  3273 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:14.745275  3302 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:14.731983  3301 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:14.733198  3088 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.763495  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:14.764346  3250 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.739138  3249 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.764554  3302 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:14.764909  3269 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.706s	user 0.007s	sys 0.010s
I20260709 13:00:14.762816  3160 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.737387  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 334) took 1547 ms. Trace:
I20260709 13:00:14.770272  2253 rpcz_store.cc:276] 0709 13:00:13.190470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.203482 (+ 13012us) service_pool.cc:224] Handling call
0709 13:00:14.084293 (+880811us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:14.084599 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.085078 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.085111 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.085750 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.254640 (+168890us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.261329 (+  6689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.266856 (+  5527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.711052 (+444196us) raft_consensus.cc:1685] finished
0709 13:00:14.711071 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.733653 (+ 22582us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1502,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":5697792,"thread_start_us":154590,"threads_started":1,"wal-append.queue_time_us":447338}
I20260709 13:00:14.747416  3180 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.755527  3173 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.739490  3264 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:14.756021  3156 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:14.797930  3296 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:00:14.799177  3262 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.003s
I20260709 13:00:14.768464  3302 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.811080  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.764973  3249 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.800366  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:14.820747  3026 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
I20260709 13:00:14.821322  3026 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.818496  2253 raft_consensus.cc:2376] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3. Re-sending same reply.
W20260709 13:00:14.823961  3298 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:00:14.766345  3273 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:14.799613  3262 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.824817  3273 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.787981  3258 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:14.823716  2260 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:14.830193  3064 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.004s
I20260709 13:00:14.830850  3064 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.790030  3286 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.838228  3138 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.833513  3301 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:14.836298  3266 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:14.841449  3262 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.843506  1674 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:14.846988  2968 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.852542  2968 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:14.841529  3026 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:14.931129  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:14.932183  3254 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 13:00:14.932665  3254 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.932085  2256 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:14.934283  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.936534  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.945959  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.947211  3258 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:14.954998  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.190920  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.192489  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.192752  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.193785  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:15.194324  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.194952  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:15.195204  2257 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:14.956040  2253 raft_consensus.cc:2376] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4. Re-sending same reply.
I20260709 13:00:14.936067  3180 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:15.214120  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:14.955461  3273 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:15.218545  2256 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:15.220664  3249 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:15.209144  3156 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:15.227033  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:15.458283  3258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.005s
W20260709 13:00:15.520897  3258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.005s
I20260709 13:00:15.230157  3262 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.291s
I20260709 13:00:15.432374  3064 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:15.521631  3249 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:15.532892  2253 raft_consensus.cc:2376] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3. Re-sending same reply.
I20260709 13:00:16.027127  3262 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.049386  3262 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.051786  3262 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.053077  3302 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.227s	user 0.006s	sys 0.005s
I20260709 13:00:16.053655  3302 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.056056  3302 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:15.799605  3249 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:16.073904  3092 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.801s	user 0.024s	sys 0.034s
I20260709 13:00:16.130232  3293 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.107651  3262 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:16.151178  3092 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.091s	user 0.025s	sys 0.035s
I20260709 13:00:16.137249  3180 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:16.189224  3301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.252s	user 0.009s	sys 0.027s
I20260709 13:00:16.192389  3273 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:16.187183  3262 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.203158  3262 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:16.186259  3293 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.189306  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:16.215287  2252 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:16.194402  3156 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:16.200294  3301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.009s	sys 0.027s
I20260709 13:00:16.209882  3293 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:16.210731  3146 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:16.206158  3249 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:16.218044  3194 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.216168  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 313) took 2554 ms (client timeout 1634 ms). Trace:
W20260709 13:00:16.219049  2252 rpcz_store.cc:269] 0709 13:00:13.661708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.662341 (+   633us) service_pool.cc:224] Handling call
0709 13:00:16.183393 (+2521052us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:16.215872 (+ 32479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537567616}
W20260709 13:00:16.221321  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.526s	user 0.017s	sys 0.013s
W20260709 13:00:16.221829  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.527s	user 0.017s	sys 0.013s
I20260709 13:00:16.222407  3180 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:16.222937  3180 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:16.214030  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1558) took 1903 ms (client timeout 1658 ms). Trace:
W20260709 13:00:16.224656  1600 rpcz_store.cc:269] 0709 13:00:14.310693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.459952 (+149259us) service_pool.cc:224] Handling call
0709 13:00:16.213927 (+1753975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.225270  3180 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.225940  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1559) took 1915 ms (client timeout 1894 ms). Trace:
W20260709 13:00:16.226595  1574 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.576s (SENT)
I20260709 13:00:16.227927  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:16.226383  1600 rpcz_store.cc:269] 0709 13:00:14.310944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.225675 (+1914731us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:16.225829 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:16.228825  3180 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:16.230636  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:16.231114  3180 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.231503  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1555) took 1921 ms (client timeout 2130 ms). Trace:
I20260709 13:00:16.231675  3180 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:16.231920  1600 rpcz_store.cc:269] 0709 13:00:14.309756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.230317 (+1920561us) service_pool.cc:224] Handling call
0709 13:00:16.231442 (+  1125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.233744  3180 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:16.233623  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:16.236074  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1551) took 2017 ms (client timeout 2237 ms). Trace:
W20260709 13:00:16.236665  1600 rpcz_store.cc:269] 0709 13:00:14.218581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.233333 (+2014752us) service_pool.cc:224] Handling call
0709 13:00:16.235995 (+  2662us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:16.235129  1574 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.113s (SENT)
I20260709 13:00:16.237882  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:16.240542  3180 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.241140  3180 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.246348  3180 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:16.248874  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 312) took 2598 ms. Trace:
I20260709 13:00:16.249352  2254 rpcz_store.cc:276] 0709 13:00:13.650731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.654299 (+  3568us) service_pool.cc:224] Handling call
0709 13:00:16.247975 (+2593676us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:16.248213 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.248467 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.248496 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.248542 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:16.248578 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.248638 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.248780 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8495360}
W20260709 13:00:16.281594  3275 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 2.208s	user 0.007s	sys 0.019s
I20260709 13:00:16.283964  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 311) took 2633 ms. Trace:
I20260709 13:00:16.284338  2261 rpcz_store.cc:276] 0709 13:00:13.650439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.651046 (+   607us) service_pool.cc:224] Handling call
0709 13:00:13.651432 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.868560 (+217128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.868593 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.869107 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.998044 (+128937us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:13.998091 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.998187 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.280936 (+2282749us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:16.283641 (+  2705us) raft_consensus.cc:1685] finished
0709 13:00:16.283665 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.283910 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20763,"raft.queue_time_us":218963,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":54758272,"thread_start_us":103991,"threads_started":1,"wal-append.queue_time_us":203948}
I20260709 13:00:16.299693  3054 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.300805  1573 connection.cc:256] RPC call timeout handler was delayed by -1.3047500229999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:00:16.301393  3230 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:16.301892  3230 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:16.303009  3054 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:16.303580  3054 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:16.304147  3230 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:16.305575  3054 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.313520  3267 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 2.273s	user 0.022s	sys 0.020s
I20260709 13:00:16.376477  3021 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:16.377929  3054 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.378756  3054 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.379971  3318 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:16.380573  3318 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:16.381633  3054 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:16.382830  3318 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.402844  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 317) took 2270 ms (client timeout 1515 ms). Trace:
W20260709 13:00:16.403182  2260 rpcz_store.cc:269] 0709 13:00:14.132258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.206549 (+ 74291us) service_pool.cc:224] Handling call
0709 13:00:16.402642 (+2196093us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54001ecb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:16.402785 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416426240}
I20260709 13:00:16.411038  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:16.411914  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1351) took 2825 ms (client timeout 3311 ms). Trace:
W20260709 13:00:16.412273  1608 rpcz_store.cc:269] 0709 13:00:13.586111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.410685 (+2824574us) service_pool.cc:224] Handling call
0709 13:00:16.411858 (+  1173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.413142  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:16.414449  3272 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:16.422611  3142 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:16.441191  3274 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 2.397s	user 0.016s	sys 0.009s
I20260709 13:00:16.472616  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1335) took 4969 ms. Trace:
I20260709 13:00:16.473014  1604 rpcz_store.cc:276] 0709 13:00:11.503385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.277041 (+1773656us) service_pool.cc:224] Handling call
0709 13:00:13.277520 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.311674 (+ 34154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.311695 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.326814 (+ 15119us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.848524 (+521710us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:13.848564 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.848631 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.312878 (+2464247us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:16.472270 (+159392us) raft_consensus.cc:1685] finished
0709 13:00:16.472287 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.472549 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33739,"raft.queue_time_us":142520,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13615,"spinlock_wait_cycles":293479680,"thread_start_us":388119,"threads_started":1,"wal-append.queue_time_us":657638}
I20260709 13:00:16.475348  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1537) took 4945 ms. Trace:
I20260709 13:00:16.475716  1604 rpcz_store.cc:276] 0709 13:00:11.530294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.474286 (+4943992us) service_pool.cc:224] Handling call
0709 13:00:16.474651 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.474819 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.474843 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.475058 (+   215us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:16.475107 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.475166 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.475280 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.477494  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1538) took 4946 ms. Trace:
I20260709 13:00:16.477813  1604 rpcz_store.cc:276] 0709 13:00:11.531522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.476656 (+4945134us) service_pool.cc:224] Handling call
0709 13:00:16.476987 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.477173 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.477197 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.477251 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.477283 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.477331 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.477444 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.479224  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1336) took 4808 ms. Trace:
I20260709 13:00:16.479506  1604 rpcz_store.cc:276] 0709 13:00:11.670751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.478634 (+4807883us) service_pool.cc:224] Handling call
0709 13:00:16.478900 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.479018 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.479032 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.479058 (+    26us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:16.479075 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.479114 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.479182 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.481029  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1337) took 4640 ms. Trace:
I20260709 13:00:16.481333  1604 rpcz_store.cc:276] 0709 13:00:11.840878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.480324 (+4639446us) service_pool.cc:224] Handling call
0709 13:00:16.480585 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.480744 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.480768 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.480805 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:16.480829 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.480874 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.480982 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.623027  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:16.623979  1607 raft_consensus.cc:2410] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:16.624467  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1557) took 2314 ms (client timeout 1849 ms). Trace:
W20260709 13:00:16.624825  1607 rpcz_store.cc:269] 0709 13:00:14.310430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.722003 (+411573us) service_pool.cc:224] Handling call
0709 13:00:16.624397 (+1902394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.626297  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 185) took 4594 ms. Trace:
I20260709 13:00:16.626617  1607 rpcz_store.cc:276] 0709 13:00:12.031600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.625478 (+4593878us) service_pool.cc:224] Handling call
0709 13:00:16.625822 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.625994 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.626018 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.626059 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.626088 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.626138 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.626236 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.642797  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1324) took 2418 ms. Trace:
W20260709 13:00:16.650374  1648 connection.cc:256] RPC call timeout handler was delayed by -1.8829721199999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:00:16.650878  1648 connection.cc:256] RPC call timeout handler was delayed by -1.7837978899999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:00:16.651170  1648 connection.cc:256] RPC call timeout handler was delayed by -1.6210721199999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:00:16.651446  1648 connection.cc:256] RPC call timeout handler was delayed by -1.6118978899999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:00:16.651695  1648 connection.cc:256] RPC call timeout handler was delayed by -1.6048721199999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:00:16.651942  1648 connection.cc:256] RPC call timeout handler was delayed by -1.3934122229999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:00:16.652205  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0739122229999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:00:16.652510  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0514122229999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:00:16.652778  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0106995969999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 13:00:16.836460  1607 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:16.913291  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 186) took 4881 ms. Trace:
I20260709 13:00:16.913664  1607 rpcz_store.cc:276] 0709 13:00:12.032007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.835712 (+4803705us) service_pool.cc:224] Handling call
0709 13:00:16.836175 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.912973 (+ 76798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.913224 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.643323  1675 rpcz_store.cc:276] 0709 13:00:14.224412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.225462 (+  1050us) service_pool.cc:224] Handling call
0709 13:00:14.255098 (+ 29636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.336127 (+ 81029us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:14.477771 (+141644us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.620064 (+142293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.620112 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:14.620153 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.642460 (+2022307us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b54003570d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:16.642516 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.642709 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2228,"raft.queue_time_us":56467,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":23629,"spinlock_wait_cycles":185586432,"thread_start_us":139689,"threads_started":1,"wal-append.queue_time_us":237856,"wal-append.run_cpu_time_us":1440,"wal-append.run_wall_time_us":1074452}
I20260709 13:00:16.983343  3310 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:17.037122  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 190) took 5003 ms. Trace:
I20260709 13:00:17.037688  1607 rpcz_store.cc:276] 0709 13:00:12.033404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.009963 (+4976559us) service_pool.cc:224] Handling call
0709 13:00:17.036605 (+ 26642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.036792 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.036817 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.036858 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:17.036889 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.036940 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.037057 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.035588  3310 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:17.127698  3310 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.128990  3310 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:17.320166  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 415755us
W20260709 13:00:17.321108  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.658s (SENT) [suppressed 33 similar messages]
W20260709 13:00:17.376530  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 374172us
W20260709 13:00:17.378422  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.380857  1602 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 2.663s	user 0.022s	sys 0.011s
I20260709 13:00:17.381256  1602 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
W20260709 13:00:17.381835  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1556) took 3071 ms (client timeout 1765 ms). Trace:
W20260709 13:00:17.382174  1602 rpcz_store.cc:269] 0709 13:00:14.310132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.566982 (+256850us) service_pool.cc:224] Handling call
0709 13:00:17.381733 (+2814751us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.383983  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1542) took 5005 ms. Trace:
I20260709 13:00:17.384887  1607 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:17.390410  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 192) took 5356 ms. Trace:
I20260709 13:00:17.393412  1607 rpcz_store.cc:276] 0709 13:00:12.033925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.378761 (+5344836us) service_pool.cc:224] Handling call
0709 13:00:17.384660 (+  5899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.390158 (+  5498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.390352 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.387496  3158 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:17.394644  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1329) took 3168 ms (client timeout 2510 ms). Trace:
W20260709 13:00:17.400590  1682 rpcz_store.cc:269] 0709 13:00:14.225882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.226008 (+   126us) service_pool.cc:224] Handling call
0709 13:00:17.394408 (+3168400us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540031bad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:17.394536 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536224128}
I20260709 13:00:17.402724  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1544) took 4994 ms. Trace:
W20260709 13:00:17.385452  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.001s	sys 0.021s
I20260709 13:00:17.404539  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 184) took 5373 ms. Trace:
I20260709 13:00:17.405805  1604 rpcz_store.cc:276] 0709 13:00:12.031314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.482019 (+4450705us) service_pool.cc:224] Handling call
0709 13:00:16.482312 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.984010 (+501698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.984044 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.984626 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.401068 (+416442us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.401112 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.401186 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.404335 (+  3149us) raft_consensus.cc:1685] finished
0709 13:00:17.404354 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.404481 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":452677,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":75702,"threads_started":1,"wal-append.queue_time_us":158357}
I20260709 13:00:17.405522  1607 rpcz_store.cc:276] 0709 13:00:12.408656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.401751 (+4993095us) service_pool.cc:224] Handling call
0709 13:00:17.402109 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.402392 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.402420 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.402463 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:17.402491 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.402547 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.402654 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.384428  1602 rpcz_store.cc:276] 0709 13:00:12.378654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.383005 (+5004351us) service_pool.cc:224] Handling call
0709 13:00:17.383331 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.383622 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.383659 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.383703 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.383745 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.383819 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.383935 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.408839  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1339) took 3941 ms. Trace:
I20260709 13:00:17.409276  1604 rpcz_store.cc:276] 0709 13:00:13.468094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.407296 (+3939202us) service_pool.cc:224] Handling call
0709 13:00:17.407681 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.407928 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.407957 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.408548 (+   591us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:17.408586 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.408690 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.408791 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.410113  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1340) took 3938 ms. Trace:
W20260709 13:00:17.405570  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.001s	sys 0.022s
W20260709 13:00:17.411626  1649 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.676s	user 0.025s	sys 0.030s
W20260709 13:00:17.413371  1649 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.678s	user 0.026s	sys 0.030s
I20260709 13:00:17.410817  3183 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.413663  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 2.67803e+06us
I20260709 13:00:17.414181  3183 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.415822  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.415975  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.416527  1675 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.416726  3183 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.415436  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.417879  1682 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:17.418222  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.415477  1607 rpcz_store.cc:276] 0709 13:00:13.472177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.408467 (+3936290us) service_pool.cc:224] Handling call
0709 13:00:17.408761 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.408926 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.408950 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.408987 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.409014 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.409059 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.410063 (+  1004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.419654  1607 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:17.420627  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.421212  1682 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.422036  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.422547  1675 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.420049  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.410840  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1341) took 3938 ms. Trace:
I20260709 13:00:17.424511  1604 rpcz_store.cc:276] 0709 13:00:13.472511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.410128 (+3937617us) service_pool.cc:224] Handling call
0709 13:00:17.410422 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.410574 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.410597 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.410632 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.410659 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.410704 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.410791 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.426033  1604 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:17.426606  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 194) took 3578 ms. Trace:
I20260709 13:00:17.427042  1604 rpcz_store.cc:276] 0709 13:00:13.848602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.425484 (+3576882us) service_pool.cc:224] Handling call
0709 13:00:17.425750 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.426394 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.426556 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.435822  3159 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:17.436137  1647 connection.cc:256] RPC call timeout handler was delayed by -1.8310393729999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:00:17.436523  3159 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.437754  1604 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:17.438066  3158 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:17.436843  1647 connection.cc:256] RPC call timeout handler was delayed by -1.7871707539999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:00:17.438874  3159 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:17.439230  1647 connection.cc:256] RPC call timeout handler was delayed by -1.7619707539999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:00:17.438581  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 198) took 3562 ms. Trace:
I20260709 13:00:17.438661  3158 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.439385  3159 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.439911  1647 connection.cc:256] RPC call timeout handler was delayed by -1.6008707539999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:00:17.440600  1647 connection.cc:256] RPC call timeout handler was delayed by -1.32547075399998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:00:17.440493  3159 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:17.442673  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3200707539999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:00:17.443186  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1886707539999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:00:17.439860  1604 rpcz_store.cc:276] 0709 13:00:13.875734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.427859 (+3552125us) service_pool.cc:224] Handling call
0709 13:00:17.437112 (+  9253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.438233 (+  1121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.438443 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.443145  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:17.443454  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3a20 after lost signal to thread 431
W20260709 13:00:17.444332  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae5a0 after lost signal to thread 434
I20260709 13:00:17.444581  1604 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:17.444809  1679 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.445245  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1548) took 3227 ms. Trace:
W20260709 13:00:17.445286  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1560) took 3134 ms (client timeout 1749 ms). Trace:
I20260709 13:00:17.446703  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.448283  1604 rpcz_store.cc:276] 0709 13:00:14.217598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.444069 (+3226471us) service_pool.cc:224] Handling call
0709 13:00:17.444406 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.444986 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.445186 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:17.448768  1606 rpcz_store.cc:269] 0709 13:00:14.311212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.445070 (+3133858us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:17.445194 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:17.449389  1679 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:17.443672  1647 connection.cc:256] RPC call timeout handler was delayed by -1.0932707539999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2279s for a response
I20260709 13:00:17.450706  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.451097  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.451443  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.451737  1680 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.453323  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.454030  1680 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.453423  1676 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:17.454288  3159 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:17.441974  3158 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:17.455202  3159 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.456331  1677 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:17.456851  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.457641  1680 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:17.448125  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.458307  1682 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:17.456122  1675 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:17.412168  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1342) took 3939 ms. Trace:
I20260709 13:00:17.460466  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.479013  1676 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:17.479900  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.463956  1679 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:17.481335  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.481482  3245 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.481879  1679 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.464627  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.482031  3245 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.482903  1682 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:17.483846  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.484007  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.484453  3245 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.484865  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.485844  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.465312  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.486887  1675 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.487663  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.488607  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.489097  1675 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:17.489751  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.465447  1602 rpcz_store.cc:276] 0709 13:00:13.472781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.411383 (+3938602us) service_pool.cc:224] Handling call
0709 13:00:17.411710 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.411867 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.411891 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.411929 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:17.411967 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.412018 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.412117 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.490856  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.491256  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:17.491401  1604 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:17.492179  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.492285  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.492874  1602 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:17.493180  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.493674  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:17.494149  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.494915  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:17.495344  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.469233  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1347) took 3929 ms. Trace:
I20260709 13:00:17.466095  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1536) took 5936 ms. Trace:
I20260709 13:00:17.497202  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.497751  1679 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.498517  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.495450  1602 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.499002  1679 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.499151  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.499634  3310 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:17.464541  3159 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.500291  3310 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.502143  3159 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.502367  3310 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.499725  1604 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:17.461354  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.489779  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.506166  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:17.506013  1681 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.496816  1605 rpcz_store.cc:276] 0709 13:00:11.530006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.457737 (+1927731us) service_pool.cc:224] Handling call
0709 13:00:13.479872 (+ 22135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.487463 (+  7591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.487510 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.490291 (+  2781us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.653479 (+3163188us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b18002b4fe0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:17.465634 (+812155us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.465675 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.465753 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.465811 (+    58us) raft_consensus.cc:1685] finished
0709 13:00:17.465822 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.466024 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35277,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11910,"spinlock_wait_cycles":19078528,"thread_start_us":811978,"threads_started":1,"wal-append.queue_time_us":3876477}
I20260709 13:00:17.507436  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:17.496060  1607 rpcz_store.cc:276] 0709 13:00:13.540050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.419039 (+3878989us) service_pool.cc:224] Handling call
0709 13:00:17.419324 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.419518 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:17.427147 (+  7629us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.468874 (+ 41727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.468926 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.468988 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.469052 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.469175 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":515,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"thread_start_us":41370,"threads_started":1,"wal-append.queue_time_us":41731}
I20260709 13:00:17.508153  1676 raft_consensus.cc:2376] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4. Re-sending same reply.
I20260709 13:00:17.499846  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.508944  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.509305  1679 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:17.510221  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.510821  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.510210  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.510306  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:17.476668  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.511543  1607 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:17.514036  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.514273  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.511574  1681 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:17.509497  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.506253  1675 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.515774  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:17.515870  1649 connection.cc:256] RPC call timeout handler was delayed by -1.9004926829999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 13:00:17.516546  1676 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:17.516693  2227 connection.cc:256] RPC call timeout handler was delayed by -1.8034296049999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:00:17.486299  3071 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.513296  1605 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:17.516940  1649 connection.cc:256] RPC call timeout handler was delayed by -1.8185926830000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:00:17.505138  3310 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.517306  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.470484  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 310) took 8141 ms. Trace:
W20260709 13:00:17.519186  1649 connection.cc:256] RPC call timeout handler was delayed by -1.8176926830000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:00:17.527619  1649 connection.cc:256] RPC call timeout handler was delayed by -1.8041926829999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:00:17.531788  1649 connection.cc:256] RPC call timeout handler was delayed by -1.728592682999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:00:17.459468  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:17.482815  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.516036  3159 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.520398  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.520853  2252 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:17.540040  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.540076  1681 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.521063  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.522614  1602 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:17.523382  3137 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.523680  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.540525  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:17.525972  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.541360  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.527092  1604 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:17.541718  1675 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:17.532410  1649 connection.cc:256] RPC call timeout handler was delayed by -1.6880926829999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:00:17.519423  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.543350  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.543793  1679 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:17.542456  1649 connection.cc:256] RPC call timeout handler was delayed by -1.5533214220000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 13:00:17.537943  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.521005  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.546087  1606 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:17.539427  1680 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:17.524645  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.526531  3310 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.550505  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.536746  3158 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.551605  3158 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.551928  3310 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.552608  3310 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.553078  3310 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.553802  3158 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:17.554352  3158 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.554782  3158 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.555130  3310 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.557200  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.558612  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.559202  2252 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.560716  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.562529  1602 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:17.563529  3259 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.564080  3259 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.544739  3159 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.566639  3159 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.546344  1676 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:17.546869  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.567376  1608 raft_consensus.cc:606] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:17.542519  3137 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:17.567796  1681 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:17.568476  3137 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.568890  3253 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.568982  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.569458  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.569864  1681 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:17.570053  2256 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.570376  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.571105  1681 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:17.571712  1675 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:17.527544  1430 rpcz_store.cc:276] 0709 13:00:09.329293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.329417 (+   124us) service_pool.cc:224] Handling call
0709 13:00:10.636784 (+1307367us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:17.470392 (+6833608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:12.534519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:12.549525 (+ 15006us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:12.549569 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:00:12.549588 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:12.549925 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:12.550004 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:12.550039 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:12.550264 (+   225us) tablet.cc:701] Row locks acquired
0709 13:00:12.550281 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:00:12.550415 (+   134us) write_op.cc:270] Start()
0709 13:00:12.550524 (+   109us) write_op.cc:276] Timestamp: P: 1783602012550374 usec, L: 0
0709 13:00:12.550545 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:12.551270 (+   725us) log.cc:844] Serialized 536 byte log entry
0709 13:00:14.001423 (+1450153us) op_driver.cc:464] REPLICATION: finished
0709 13:00:14.347221 (+345798us) write_op.cc:301] APPLY: starting
0709 13:00:14.355732 (+  8511us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:14.427919 (+ 72187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:14.521226 (+ 93307us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:14.532532 (+ 11306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:14.532705 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:14.532752 (+    47us) write_op.cc:312] APPLY: finished
0709 13:00:14.548657 (+ 15905us) log.cc:844] Serialized 23 byte log entry
0709 13:00:14.548891 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.548998 (+   107us) write_op.cc:454] Released schema lock
0709 13:00:14.549051 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:14.549532 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.549575 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36940,"reported_tablets":1,"spinlock_wait_cycles":810033920,"child_traces":[["op",{"apply.queue_time_us":326820,"apply.run_cpu_time_us":3151,"apply.run_wall_time_us":209149,"num_ops":1,"prepare.queue_time_us":1358253,"prepare.run_cpu_time_us":65655,"prepare.run_wall_time_us":491167,"raft.queue_time_us":447713,"raft.run_cpu_time_us":46372,"raft.run_wall_time_us":334016,"replication_time_us":1414698,"thread_start_us":1919960,"threads_started":4,"wal-append.queue_time_us":511491,"wal-append.run_cpu_time_us":46545,"wal-append.run_wall_time_us":2604124}]]}
I20260709 13:00:17.567840  1608 raft_consensus.cc:614] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.574003  1675 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:17.569746  3137 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.574913  2255 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:17.575423  2255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 335) took 2835 ms (client timeout 2036 ms). Trace:
W20260709 13:00:17.575790  2255 rpcz_store.cc:269] 0709 13:00:14.740310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.741758 (+  1448us) service_pool.cc:224] Handling call
0709 13:00:17.482665 (+2740907us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:17.575351 (+ 92686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12024064}
I20260709 13:00:17.576367  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.577226  1683 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:00:17.577627  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1337) took 3348 ms (client timeout 3247 ms). Trace:
W20260709 13:00:17.577956  1683 rpcz_store.cc:269] 0709 13:00:14.229107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.260845 (+ 31738us) service_pool.cc:224] Handling call
0709 13:00:17.576205 (+3315360us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:17.577563 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21031808}
W20260709 13:00:17.547137  1649 connection.cc:256] RPC call timeout handler was delayed by -1.4756926830000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:00:17.579147  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3793926829999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:00:17.579486  1649 connection.cc:256] RPC call timeout handler was delayed by -1.254497108999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:00:17.579758  1649 connection.cc:256] RPC call timeout handler was delayed by -1.2202971090000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:00:17.580044  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0357971089999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:00:17.580282  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0033971089999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 13:00:17.543413  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.545699  2253 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:17.548434  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.551267  1605 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:17.584733  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.585965  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:17.587098  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.589041  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.534235  1682 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:17.574282  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 197) took 3698 ms (client timeout 2122 ms). Trace:
W20260709 13:00:17.590231  1603 rpcz_store.cc:269] 0709 13:00:13.875465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.996947 (+121482us) service_pool.cc:224] Handling call
0709 13:00:17.574121 (+3577174us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540011dd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:17.574219 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543264128}
I20260709 13:00:17.590729  2260 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:17.591244  2260 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:17.593467  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1546) took 5004 ms (client timeout 1673 ms). Trace:
W20260709 13:00:17.594426  1609 rpcz_store.cc:269] 0709 13:00:12.583470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.607602 (+ 24132us) service_pool.cc:224] Handling call
0709 13:00:17.588079 (+4980477us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:17.588189 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3587833728}
I20260709 13:00:17.594887  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.594098  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.598085  1677 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:17.592161  2260 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.600587  2260 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.598230  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.593178  3071 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.602698  3071 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.603087  3071 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.604722  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.600324  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.571342  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.574170  1600 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:17.590566  3117 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:17.613919  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.611636  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.590334  3180 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:17.589409  3259 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.615554  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.624678  1606 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:17.618196  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.626601  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.626905  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.628060  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.611577  3271 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:17.629513  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.636031  3327 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:17.638140  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.638180  3327 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:17.639539  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.639519  3327 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.636168  3183 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.640812  3183 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.641158  3183 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.614827  3143 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.642584  3143 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.642966  3143 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.643643  3247 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.644346  3247 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.644683  3247 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.645015  3247 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.624547  3142 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.646463  3142 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.646895  3142 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.646513  3182 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.624361  3180 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.645913  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.650642  3158 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.651870  3158 raft_consensus.cc:1064] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:17.611941  3159 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:17.652508  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:17.653221  1674 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:17.656102  3159 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.656561  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.650326  3180 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.652518  3259 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:17.658677  3259 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.659003  3259 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.660256  2261 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:17.656589  3159 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:17.671757  3294 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 2.957s	user 0.009s	sys 0.021s
I20260709 13:00:17.673395  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 563) took 3596 ms. Trace:
I20260709 13:00:17.673748  2258 rpcz_store.cc:276] 0709 13:00:14.076950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.216277 (+139327us) service_pool.cc:224] Handling call
0709 13:00:14.216627 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.216833 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.216856 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.217282 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.317763 (+100481us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.317800 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.317866 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.671209 (+3353343us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:17.673075 (+  1866us) raft_consensus.cc:1685] finished
0709 13:00:17.673100 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.673331 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9553280,"thread_start_us":53177,"threads_started":1,"wal-append.queue_time_us":380062}
I20260709 13:00:17.675230  3064 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.675717  3064 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.678450  3256 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.630280  2260 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:17.610625  3245 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.612352  1602 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:17.638360  3117 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.632182  3339 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.684718  2260 pending_rounds.cc:85] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 4
I20260709 13:00:17.676117  3064 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.685369  3245 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.687899  3117 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.648267  3071 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.678515  3158 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.635542  3337 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.686985  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:17.695413  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 144956us
I20260709 13:00:17.715728  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.637437  3271 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.689558  3245 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.688728  2260 pending_rounds.cc:107] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:00:17.723133  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:17.726183  2260 raft_consensus.cc:2889] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.690194  3117 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.727922  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:17.717442  3337 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.715504  3339 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:17.724869  3256 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:00:17.733836  3337 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.727028  3262 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:17.755214  3262 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:17.755615  3262 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.755975  3262 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.729948  3054 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:17.730777  3333 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:00:17.759567  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43204 (request call id 15) took 3880 ms. Trace:
I20260709 13:00:17.760501  3333 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:17.760938  3333 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:17.761292  3333 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.763305  1678 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:17.760064  1608 rpcz_store.cc:276] 0709 13:00:13.878675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.412978 (+2534303us) service_pool.cc:224] Handling call
0709 13:00:17.759334 (+1346356us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003c6254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2b853 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:17.759462 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653241216}
I20260709 13:00:17.692142  3071 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.723862  3246 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.724869  3271 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:17.781299  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50188.1us
I20260709 13:00:17.780934  3246 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.785321  3246 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.814884  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.815691  2260 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:17.817098  3071 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.817636  3071 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.826009  3285 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:17.826630  3285 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:17.827477  3285 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:17.828938  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002a76e0 after lost signal to thread 1466
I20260709 13:00:17.828697  3339 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.830602  3285 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.835273  3333 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.837324  3143 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.838253  2252 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
W20260709 13:00:17.829329  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6e80 after lost signal to thread 1480
W20260709 13:00:17.843506  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080022e760 after lost signal to thread 1497
W20260709 13:00:17.843809  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800101bc0 after lost signal to thread 1498
W20260709 13:00:17.844300  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080022e960 after lost signal to thread 1499
W20260709 13:00:17.844548  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002504c0 after lost signal to thread 1500
I20260709 13:00:17.843796  3069 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:17.845065  3069 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:17.845975  3069 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.847023  3069 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:17.838740  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 212178us
I20260709 13:00:17.849498  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.850229  2254 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:17.850632  3333 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:17.852869  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001a21a0 after lost signal to thread 1558
W20260709 13:00:17.853283  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6820 after lost signal to thread 1559
W20260709 13:00:17.854425  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9160 after lost signal to thread 1633
I20260709 13:00:17.855641  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.857055  3110 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:17.856812  3183 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.857458  3110 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.858026  3110 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.859333  3180 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.862640  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.863505  3342 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.863929  3342 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:17.864297  3342 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.866537  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.867204  2254 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.879545  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
W20260709 13:00:17.880228  1574 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.504s (SENT)
I20260709 13:00:17.880244  1680 raft_consensus.cc:606] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:17.881016  1680 raft_consensus.cc:614] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.882027  2980 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:17.882550  2980 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:17.883400  2980 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:17.885481  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1346) took 4347 ms (client timeout 3104 ms). Trace:
W20260709 13:00:17.897747  1600 rpcz_store.cc:269] 0709 13:00:13.538187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.237534 (+2699347us) service_pool.cc:224] Handling call
0709 13:00:17.885254 (+1647720us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003c6254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:17.885398 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071357312}
W20260709 13:00:17.899225  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800377ee0 after lost signal to thread 1707
I20260709 13:00:17.899435  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.900048  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:17.900200  2257 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:17.900574  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 3.87051e+06us
I20260709 13:00:17.900295  3246 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.902268  1428 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.904424  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.905263  2257 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:17.906546  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.907146  2257 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 1.
I20260709 13:00:17.908490  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.909133  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.909775  2259 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:17.910586  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.910989  1680 raft_consensus.cc:606] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:17.911221  2253 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:17.909751  1428 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:17.889806  1574 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.634s (SENT)
I20260709 13:00:17.909128  2257 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:17.891228  3050 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.891866  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.914701  3110 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.891789  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:17.891390  2258 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:17.892777  3086 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.893414  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.916778  2260 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:17.917635  3050 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:17.916392  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800391f80 after lost signal to thread 2285
I20260709 13:00:17.919236  3271 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:17.919739  3050 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.916289  3086 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.920346  3265 raft_consensus.cc:2764] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:00:17.920655  3086 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:17.919762  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800284c00 after lost signal to thread 2286
W20260709 13:00:17.921936  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800350680 after lost signal to thread 3232
I20260709 13:00:17.924710  2252 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:17.925128  2256 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:17.902940  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:17.933760  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:17.886066  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64760.4us
W20260709 13:00:17.934340  2226 connection.cc:256] RPC call timeout handler was delayed by -1.1816271150000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:00:17.911413  1680 raft_consensus.cc:614] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.908437  3064 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:17.934551  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:17.885728  2254 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:17.936546  3155 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.914724  1428 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.936107  3037 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.936584  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:17.939422  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:17.893657  3259 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:17.940112  1680 raft_consensus.cc:606] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:17.936802  3050 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:17.940626  1680 raft_consensus.cc:614] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.930444  3086 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:17.944073  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 81483.5us
W20260709 13:00:17.950028  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.961154  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:17.868031  3142 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:17.934672  2226 connection.cc:256] RPC call timeout handler was delayed by -1.1339271150000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:00:17.976697  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.976742  2226 connection.cc:256] RPC call timeout handler was delayed by -1.1339271150000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:00:17.971567  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.972134  1573 leader_election.cc:336] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.515s (SENT)
I20260709 13:00:17.937779  1428 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:17.937315  3037 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:17.937067  3155 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.990572   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:18.019665  3246 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.020576   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:18.021238  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.021546  3086 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:18.022682  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.020788  3143 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.023996  2256 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.024610  3183 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:17.960589  3278 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:17.973207  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:17.950095  3117 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.014797  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:17.997483  3037 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.015990  3259 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.017776  3180 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.018177  3071 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:17.947636  3050 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.004663  1428 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:18.027309  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.027357  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.045778  2260 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:18.045631  1428 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.028911  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.046802  2258 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.029963  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.030870  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.048663  2259 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:18.048072  2261 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:18.032191  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.014902  3110 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:18.037400  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.005820  3155 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.033754  3278 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.051633  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.051914  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:18.050347  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 4.05088e+06us
I20260709 13:00:18.053409  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:17.990825  3272 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:18.055223  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.053905  2258 raft_consensus.cc:2376] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3. Re-sending same reply.
I20260709 13:00:18.057112  1532 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:18.056898  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.058746  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.059556  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.059099  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.062752  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.045305  3339 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.081076  1532 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:18.086107  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.062106  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:18.086850  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.049245  3050 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.089207  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.051255  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:18.093724  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.055294  3278 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.037782  3337 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.055827  3180 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:18.054764  3253 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:18.041464  3245 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.059221  3069 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.111723  3194 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:18.101106  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:18.062845  3268 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.112258  3194 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:18.062783  3333 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.113811  2256 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.113436  3194 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.114589  2260 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3. Re-sending same reply.
I20260709 13:00:18.095793  3226 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.117437  3117 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.119184  3247 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.119903  3337 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:18.085064  3339 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.120684  3339 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.121632  3247 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.124308  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.126159  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.084916  3348 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:18.093693  3227 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.128635  3227 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.130985  3227 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.132354  3271 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.095932  3276 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:00:18.093931  3262 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.111245  3245 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.060148  3342 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.126566  3142 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.127290  3348 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:18.109104  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50636.9us
I20260709 13:00:18.133719  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.135366  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.137902  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.140072  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.178658  2259 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:18.107715  3041 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:18.179800  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.180441  1530 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:18.181191  3064 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.175997  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.183979  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.178200  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.185154  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:18.106918  3086 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.185386  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.093139  1543 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet e0746dbce2334050a0a5359c93c14f2c from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:18.167721  3271 raft_consensus.cc:2764] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:18.127326  2253 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
W20260709 13:00:18.173823  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 212727us
I20260709 13:00:18.102600  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.104859  1498 connection.cc:256] RPC call timeout handler was delayed by -3.4139581950000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:00:18.276957  1498 connection.cc:256] RPC call timeout handler was delayed by -3.3926159600000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 13:00:18.276504  1532 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:18.190368  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.172010  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 209047us
I20260709 13:00:18.176221  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.184478  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.205428  1543 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet e0746dbce2334050a0a5359c93c14f2c from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-e0746dbce2334050a0a5359c93c14f2c
I20260709 13:00:18.282080  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.283085  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.283257  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.181236  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.284556  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.284871  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:18.286023  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.286264  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:18.145455  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 92264.9us
I20260709 13:00:18.287863  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.206007  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.288417  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:18.289407  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 83353.4us
W20260709 13:00:18.197257  1574 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.728s (SENT)
I20260709 13:00:18.293438  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:18.294106  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 96721.3us
I20260709 13:00:18.295229  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.186080  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.298569  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:18.267819   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd00 after lost signal to thread 1499
I20260709 13:00:18.301985  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.303371  1681 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.303874  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.304921  1674 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.306025  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.306797  1674 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.309062  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.310174  1676 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.311448  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.282092  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.196254  2226 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.667s (SENT)
I20260709 13:00:18.209400  3037 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.105054  3253 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.228077  3050 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.328662  3253 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.330129  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.331010  1679 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.192327  3086 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.274158  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:18.239620  3155 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.333556  1534 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.126845  3159 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.334697  3131 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:18.103248  3180 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:18.340854  3180 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.342376  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.343350  1534 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.230654  3262 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.183851  3278 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.184182  3339 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:18.277554  1498 connection.cc:256] RPC call timeout handler was delayed by -3.3152159599999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:00:18.228832  3342 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:18.358659  3359 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.316066  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.296218  1526 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:18.360880  3366 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:18.361397  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.324379  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.326210  1683 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:18.277153  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.334431  3086 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.283288  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.364451  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.365657  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.366919  1531 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:18.365767  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.367571  1532 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.331140  3050 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.361943  3365 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:18.338008  1574 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.943s (SENT)
I20260709 13:00:18.340443  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:18.338630  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:18.335393  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58517.4us
I20260709 13:00:18.286260  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.348290  3256 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:18.349490  1676 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.349900  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.351073  3272 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:18.346012  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.314034  1527 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.346586  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.186160  3348 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.334738  3155 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:18.360044  1498 connection.cc:256] RPC call timeout handler was delayed by -3.2972717640000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:00:18.380270  1498 connection.cc:256] RPC call timeout handler was delayed by -3.1792408159999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:00:18.361174  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 73573.8us
I20260709 13:00:18.369231  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.367929  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.368288  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.335392  3131 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:18.366912  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.361967  3339 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:18.368580  3337 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.385396  1531 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.385592  3337 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.386060  3337 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.369154  3110 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:18.387065  3110 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.387507  3110 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.389372  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.390157  1683 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.373572  3159 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:18.362251  1526 raft_consensus.cc:2376] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4. Re-sending same reply.
I20260709 13:00:18.375679  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.394073  1678 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.396951  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.397136  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.397898  1678 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.398293  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.392871  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:18.399308  1680 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.401085  1533 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:18.357582  3301 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:18.404759  3301 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.404850  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.384850  1528 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.379014  3256 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.411011  3256 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.411780  3278 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.413790  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.415303  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:18.416460  3021 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.417105  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.417300  3339 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.418533  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.418911  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.419155  1528 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.419549  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:18.420490  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.394129  1530 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.401342  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:18.384075  1498 connection.cc:256] RPC call timeout handler was delayed by -3.0945929700000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3126s for a response
I20260709 13:00:18.368897  3363 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:18.327328  3037 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.398367  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.430778  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.447680  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.407541  1525 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:18.398772  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 202542us
I20260709 13:00:18.448035  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.410357  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.421497  3262 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:18.394055  3365 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:18.405419  3366 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.475183  1679 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.393752  1532 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.416600  3155 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.405254  3301 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.417110  3021 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:18.423749  1498 connection.cc:256] RPC call timeout handler was delayed by -3.0371164389999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:00:18.425422  3363 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:18.425765  1604 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:18.441583  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.437139  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:18.441162  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 103284us
I20260709 13:00:18.407691  1681 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.444864  3272 raft_consensus.cc:1064] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
W20260709 13:00:18.431512  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 139348us
W20260709 13:00:18.431850  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.441140  3182 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.429672  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.453044  3131 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:18.482491  1498 connection.cc:256] RPC call timeout handler was delayed by -2.9420515030000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:00:18.454730  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.420096  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.479611  1534 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:18.481621  1683 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:18.444585  1602 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:18.485143  1574 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.004s (SENT)
W20260709 13:00:18.486002  1498 connection.cc:256] RPC call timeout handler was delayed by -2.8098901559999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:00:18.488099  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.490329  1526 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:18.479280  3155 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.493331  1498 connection.cc:256] RPC call timeout handler was delayed by -2.7464159600000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27540000000000003s for a response
I20260709 13:00:18.475212  3366 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:18.497026  1498 connection.cc:256] RPC call timeout handler was delayed by -2.6235074090000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:00:18.496919  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.499724  1603 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.502039  1527 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.503712  1525 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.506215  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.506563  3110 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.507294  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.507759  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.508839  1601 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:18.509011  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.786s (SENT)
I20260709 13:00:18.509298  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.509594  3182 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.506304  3272 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.510492  3365 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.511022  3271 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.511988  3271 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:18.512387  3271 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:18.513414  3271 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.514671  3271 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.516647  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.516855  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.517987  1607 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:18.517609  3021 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:18.518321  1574 leader_election.cc:336] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.036s (SENT)
I20260709 13:00:18.518951  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.519824  1607 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:18.518340  3366 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.521133  3366 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.509821  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.517428  1683 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.511525  1676 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.444048  3337 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:18.527647  1498 connection.cc:256] RPC call timeout handler was delayed by -2.2764276539999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:00:18.528851  1678 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.521441  1609 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:18.533614  1498 connection.cc:256] RPC call timeout handler was delayed by -2.2719276539999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
I20260709 13:00:18.534133  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.495656  3155 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.539423  1526 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.504050  1527 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:18.540686  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.540997  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.541874  1679 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:18.542661  1498 connection.cc:256] RPC call timeout handler was delayed by -2.1360276539999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:00:18.543324  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.543547  3142 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.544430  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.545212  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.545213  1533 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.543330  3327 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:18.549516  3064 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:18.551798  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.552567  1601 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.553041  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.553866  1676 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.530187  3253 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.559722  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.565867  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.567077  3262 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.568723  1534 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:18.572459  1498 connection.cc:256] RPC call timeout handler was delayed by -2.1009276539999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:00:18.578580  1498 connection.cc:256] RPC call timeout handler was delayed by -2.0973276539999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:00:18.577517  1532 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.578927  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.579216  1683 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
W20260709 13:00:18.579495  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44675.3us
I20260709 13:00:18.544750  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.587936  1601 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
W20260709 13:00:18.593395  1498 connection.cc:256] RPC call timeout handler was delayed by -2.0865276539999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:00:18.593556  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 156581us
W20260709 13:00:18.598806  1498 connection.cc:256] RPC call timeout handler was delayed by -1.8012276539999448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24710000000000001s for a response
I20260709 13:00:18.558329  3253 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.605525  1678 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.516955  3363 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.579201  1674 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.612598  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.614776  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.603300  3110 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.617787  1681 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:18.615442  1531 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.619843  3117 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:18.623944  1680 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.641412  1543 tablet_copy_source_session.cc:215] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:18.641705  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.644351  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.646157  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.626986  3359 raft_consensus.cc:2764] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:18.655515  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.640650  3256 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.662189  3348 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:18.663362  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.663591  3256 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.664222  1526 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 1.
I20260709 13:00:18.664680  1533 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.664520  1607 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:18.665009  3342 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:18.668609  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.671504  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.673246  1609 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:18.673424  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:18.674217  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.674960  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:18.675771  1534 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.676704  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:18.677040  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.677380  1534 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.677263  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.677060  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.676649  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.679677  1528 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:18.680593  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.681227  2256 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:18.681363  1533 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.682308  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.682869  1530 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.683179  1679 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:18.658628  3142 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.689221  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.693658  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.685158  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:18.697753  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.698589  1529 raft_consensus.cc:2376] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3. Re-sending same reply.
I20260709 13:00:18.701702  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.674185  2252 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.684278  3142 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:18.704892  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45710.8us
I20260709 13:00:18.707435  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.699878  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.657963  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.712071  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.709370  1603 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:18.711542  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.707106  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.720518  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:18.721016  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.721304  2256 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.725554  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.728484  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.728511  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.710970  3142 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.729785  1532 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.729947  3375 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.730470  3375 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:18.731333  3379 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:00:18.732055  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.733088  3327 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:18.733830  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.734560  1526 raft_consensus.cc:2368] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
W20260709 13:00:18.735154  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66317.3us
I20260709 13:00:18.735643  1526 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.664959  3180 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.735725  3348 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.738889  3180 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.740641  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.734637  1527 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.711877  3110 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:18.744720  3110 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:18.745229  3110 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:18.728917  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:18.747668  2253 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.748281  1605 raft_consensus.cc:2368] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
W20260709 13:00:18.737141  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76857us
I20260709 13:00:18.751279  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:18.753436  3262 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.753856  3262 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:18.754199  3262 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.731626  3375 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.756594  3343 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.758049  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.758566  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.758733  1674 raft_consensus.cc:2376] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3. Re-sending same reply.
I20260709 13:00:18.760711  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.761533  1681 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.729803  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.762949  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.763656  1677 raft_consensus.cc:2368] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:18.758673  1683 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.764706  1677 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.765636  1683 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.766588  1676 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.730386  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.736786  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.765908  1677 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:18.737397  3131 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.770430  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.772601  1674 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:18.775025  1606 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.779150  2252 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:18.736776  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:18.785789  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 49137.2us
I20260709 13:00:18.787530  1498 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:18.779955  3117 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.788666  3117 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.788940  3371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.014s	sys 0.010s
I20260709 13:00:18.789439  3348 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:18.790015  3142 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.780687  3301 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.791430  1682 raft_consensus.cc:2368] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
W20260709 13:00:18.781483  3377 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:00:18.724089  3155 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.782806  3182 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.783200  3337 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.790362  3348 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.784087  1530 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:18.780435  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.795713  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:18.788168  1678 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:18.659657  3365 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 13:00:18.802552  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.789068  3117 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.806831  1531 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:18.807964  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.810557  1532 raft_consensus.cc:2368] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:18.819486  1677 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.800048  3182 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:18.823141  3142 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.824204  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.825695  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.825994  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:18.831610  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.829542  3110 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.809801  3180 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.832257  3278 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.829144  3301 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.803484  3348 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:18.834522  1531 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:00:18.837055  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.813210  3131 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.807535  2256 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:18.780169  3262 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.836509  3348 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.835438  3363 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:18.868254  1677 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:18.871179  1677 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.842585  3253 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:18.872643  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.838397  3337 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:18.875306  1531 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.876528  3142 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:18.840703  3180 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:18.885615  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.841964  3301 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:00:18.891852  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65953.6us
I20260709 13:00:18.892933  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.882082  3327 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.895450  1531 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:18.896974  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:18.887835  3142 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:18.903895  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.889163  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:18.899646  3363 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:18.913245  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 158118us
I20260709 13:00:18.915385  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.918606  1678 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.921001  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.921644  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:18.908828  3327 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:18.911916  3155 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:18.928581  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 160538us
I20260709 13:00:18.919559  3343 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.933635  1681 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.912948  3131 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.923221  1602 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.916642  3110 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:18.942536  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:18.944944  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48106.4us
I20260709 13:00:18.944621  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.933719  3343 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:18.950258  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.942281  3064 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:18.952942  1648 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.512s (SENT)
I20260709 13:00:18.958907  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.960753  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.961112  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.958609  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.966288  1679 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.965389  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:18.969964  1677 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:18.972225  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.915146  3182 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:18.953233  3245 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.975785  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:18.976867  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:18.979300  1682 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.952266  3183 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:18.986146  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.940652  3180 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:18.983937  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:18.987895  3182 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.976835  3110 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.989087  3262 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:18.995373  1677 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 2: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:18.974858  3064 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:19.034093  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55496.1us
I20260709 13:00:19.035553  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.036525  1532 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:19.037863  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 62421.4us
W20260709 13:00:19.038014  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 109737us
I20260709 13:00:18.957741  3394 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:19.053942  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:18.986752  3245 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.058780  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.059564  1677 raft_consensus.cc:2368] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
W20260709 13:00:19.054003  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 121899us
I20260709 13:00:19.056860  1678 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:19.066542  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.041039  3183 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.071437  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.072566  1678 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5.
I20260709 13:00:19.055873  1674 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:18.979959  3363 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.079077  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:19.066578  3278 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:18.975487  3142 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:19.087226  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.091567  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 149188us
W20260709 13:00:19.099017  3392 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:00:19.100833  3183 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.084290  2257 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:19.097442  1648 leader_election.cc:336] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.658s (SENT)
I20260709 13:00:19.114233  1679 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:19.073763  3395 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:19.057005  3327 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.124926  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.126766  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.125514  3247 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:19.130167  3399 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:00:19.131490  3262 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:19.135731   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.136528  3245 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.146872  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:19.130338  3247 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.126389  3342 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:19.155074  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62758.7us
I20260709 13:00:19.150897  2227 leader_election.cc:400] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
W20260709 13:00:19.162770  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66453.5us
I20260709 13:00:19.120332  3064 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.187064  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.187801  1677 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.145817  3401 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:00:19.164587  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 69837.3us
I20260709 13:00:19.166739  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.171478  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.171865  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.153327  1498 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87db66ba9ff145009d8e513e5d0ef1e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:19.089363  3343 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.173167  1525 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:19.173790  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.173866  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.204876  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.175244  1602 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:19.177033  1526 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.180058  2227 leader_election.cc:403] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.182329  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.184657  3247 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.149659  3348 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:19.198521  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61182.9us
I20260709 13:00:19.201653  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:19.203318  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.207396  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.209137  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.210520  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.212821  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.218052  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.219420  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.220924  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.222857  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:19.223412  1682 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:19.227808  1675 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:19.179662  3342 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:19.234157  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.235212  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.236385  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.237668  1532 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.238840  1534 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:19.240659  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.242105  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.715s (SENT)
I20260709 13:00:19.244700  1530 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:19.253033  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.257172  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:19.258687  3180 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.261162  3180 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.263571  3180 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:19.264846  3180 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:19.265468  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.266114  3180 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:19.268566  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67020.2us
I20260709 13:00:19.196468  3117 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.268482  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.270905  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.267845  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 184454us
I20260709 13:00:19.255355  1527 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:19.274012  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.749s (SENT)
I20260709 13:00:19.276556  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:19.277503  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51206.4us
I20260709 13:00:19.217491  3359 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:00:19.267843  3278 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:19.387903  1499 leader_election.cc:400] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:19.312523  3348 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:19.271600  3301 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:19.518772  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.548862  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 342036us
I20260709 13:00:19.393275  3342 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.285920  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.557547  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.406585  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:19.568212  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 365151us
I20260709 13:00:19.401893  2260 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.310245  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.568962  1530 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:00:19.551710  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.443531  1677 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:19.408802  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:19.278525  3413 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.566815  1499 leader_election.cc:403] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.583205  1574 leader_election.cc:400] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:19.581297  1678 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:19.545559  3403 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.583369  2259 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:19.571092  3301 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:19.586647  2260 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:19.571668  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.392397  3363 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:19.284570  1528 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.597566  3180 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:19.598091  3400 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.589532  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 183114us
I20260709 13:00:19.578662  3278 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:19.590569  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.578451  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.602859  2258 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:19.592111  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 318102us
I20260709 13:00:19.402110  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.593694  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.403319  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.310844  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.595500  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:19.594944  3271 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:19.308565  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:19.585512  3342 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:19.603996  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 307398us
I20260709 13:00:19.601472  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.584904  1574 leader_election.cc:403] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.605337  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.605795  2261 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:19.606726  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.750s (SENT)
I20260709 13:00:19.613065  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.614722  2260 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.604527  3348 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:19.616297  1526 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:19.618901  1530 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 4. Ops: []
I20260709 13:00:19.616632  3271 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.620482  3021 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.621625  2254 raft_consensus.cc:2376] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3. Re-sending same reply.
W20260709 13:00:19.622257  3389 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.701s	user 0.003s	sys 0.000s
I20260709 13:00:19.623193  2254 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:19.621308  3271 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.607939  3278 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.625067  1525 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.626648  3276 raft_consensus.cc:2764] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:19.625011  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:19.635618  1680 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:19.630053  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.626621  2261 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:19.626528  2259 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.638975  1526 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:19.639008  2260 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:19.641080  2254 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:19.646937  1525 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.647223  2258 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:19.624279  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.662935  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.667769  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.668761  1525 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:19.669142  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.672601  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 394247us
I20260709 13:00:19.634294  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.676203  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.677683  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:19.678380  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.681334  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 74638.7us
I20260709 13:00:19.610756  3403 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:19.679010  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 98717.1us
W20260709 13:00:19.689091  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 71570.3us
I20260709 13:00:19.674013  3245 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:19.690685  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.699767  3232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0746dbce2334050a0a5359c93c14f2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:19.700802  3407 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.549s	user 0.002s	sys 0.001s
I20260709 13:00:19.701365  3343 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.703907  3403 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:19.705545  3419 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:00:19.706717  3245 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:19.707171  3245 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.708252  3245 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.710125  3245 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.691726  3421 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:19.716701  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 68986.9us
I20260709 13:00:19.717803  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:19.662434  3348 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:00:19.718506  1528 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:19.725505  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.729082  1573 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0746dbce2334050a0a5359c93c14f2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:19.731032  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:19.732146  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.849s (SENT)
I20260709 13:00:19.732587  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.733331  3021 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:19.735256  2252 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:19.735771  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.735919  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:19.736591  1602 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:19.737524  1605 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.740468  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:19.741880  1648 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.894s (SENT)
I20260709 13:00:19.742372  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.676127  3301 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.720180  2255 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:19.738129  3247 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.748265  3110 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:19.750980  3401 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.754359  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:19.757581  1606 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:19.763192  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.765033  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.769758  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:19.770412  1676 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:19.770694  3423 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:19.771082  1677 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:19.771857  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:19.772223  2261 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.772508  3333 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.773098  1674 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:19.773022  3333 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.774667  1674 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:19.756991  3348 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:19.775537  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:19.741426  3421 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.744257  3395 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.772547  1677 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.744403  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 595) took 1057 ms. Trace:
I20260709 13:00:19.781119  2253 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:19.782615  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:19.781607  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:19.782119  3400 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:19.782696  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:19.784830  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0821118360000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2597s for a response
W20260709 13:00:19.790656  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.793263  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51412.6us
I20260709 13:00:19.759900  3393 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.796550  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.797878  1683 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.753039  3419 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:19.801457  2254 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:19.801231  1648 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.925s (SENT)
I20260709 13:00:19.805296  1530 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:19.806653  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.787343  3247 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:19.761729  3401 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.792974  3400 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.831776  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.830358  3110 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.841667  1648 leader_election.cc:336] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.508s (SENT)
I20260709 13:00:19.850013  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.846159  3348 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:19.893499  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 121717us
I20260709 13:00:19.894589  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:19.833532  3403 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:19.895377  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 96537us
I20260709 13:00:19.840093  3301 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.841298  3400 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:19.792698  3276 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:00:19.798327  3395 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.821496  3393 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.898699  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:19.924136  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82495.4us
I20260709 13:00:19.993950  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.037364  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.037949  3440 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:20.038400  3440 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.039003  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.011901  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.040405  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.992049  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.992571  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.992977  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:19.952975  3333 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:19.993319  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.064983  1534 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:20.030344  2252 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:20.043236  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:19.997502  3432 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
I20260709 13:00:20.044754  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:20.066926  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 264895us
I20260709 13:00:20.068681  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.073490  2260 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.067746  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.047778  3301 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:19.944145  3413 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
I20260709 13:00:19.785997  2257 rpcz_store.cc:276] 0709 13:00:18.680205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.698144 (+ 17939us) service_pool.cc:224] Handling call
0709 13:00:19.048896 (+350752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.108839 (+ 59943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.737424 (+628585us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54008002d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:19.737574 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774373632}
I20260709 13:00:20.050539  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.051271  1603 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.052430  3401 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:20.052944  1608 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.054497  1609 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:20.056160  1682 raft_consensus.cc:2410] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:19.923837  3363 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.057125  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.057801  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.060114  3434 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.061024  3375 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.999907  2259 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:20.067091  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 172605us
I20260709 13:00:20.110236  2226 leader_election.cc:400] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 2 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3.
I20260709 13:00:20.069018  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:20.074894  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.046424  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.077011  1531 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:20.078294  1525 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.112737  1525 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.078437  1675 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:20.079146  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.039453  3440 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:20.066705  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:19.915987  3430 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.300s
I20260709 13:00:20.078008  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:20.090132  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.141366  1607 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:19.924628  3348 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.152s
W20260709 13:00:20.091146  1648 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.535s (SENT)
I20260709 13:00:20.064807  1528 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
W20260709 13:00:20.107873  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.151607  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.536s (SENT)
W20260709 13:00:20.172600  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.181228  1531 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.183280  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:19.917325  3247 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.181722  1531 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.184280  3301 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:20.114996  3343 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.186230  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:20.187160  1525 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.172189  3403 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.202363  2258 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:19.917824  3421 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.226033  3333 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:20.222398  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.202605  3403 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.211623  3117 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:20.225478  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:20.241845  2253 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:20.212229  1531 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.219794  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1548) took 1165 ms. Trace:
I20260709 13:00:20.243479  3403 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:20.243111  1532 rpcz_store.cc:276] 0709 13:00:19.054088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.054283 (+   195us) service_pool.cc:224] Handling call
0709 13:00:19.066344 (+ 12061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.241385 (+175041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.219448 (+978063us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002cd154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:20.219678 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393568512}
I20260709 13:00:20.224180  3337 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.202877  1525 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.248562  3337 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:20.242940  1531 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:20.240860  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.254401  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.255025  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.244836  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.573s (SENT)
I20260709 13:00:20.244467  3333 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.245735  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.246299  1534 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:20.256983  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70866.2us
I20260709 13:00:20.257323  1534 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:20.243571  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 152480us
W20260709 13:00:20.246820  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136699us
I20260709 13:00:20.212782  3440 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:20.256043  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.259516  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.258898  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:20.262694  1573 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.573s (SENT)
I20260709 13:00:20.263101  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:20.266987  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 188066us
I20260709 13:00:20.272850  1525 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.273952  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:20.278077  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:20.279800  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.536s (SENT)
I20260709 13:00:20.280377  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.283072  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.283982  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:20.267787  3401 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:20.262434  3419 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.285895  1534 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:20.292909  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.278020  3434 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:20.301887  1574 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.782s (SENT)
I20260709 13:00:20.304816  2226 leader_election.cc:400] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5.
I20260709 13:00:20.305263  2226 leader_election.cc:403] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:00:20.315704  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.322063  3446 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:20.286573  3064 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:20.328778  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51043.9us
I20260709 13:00:20.323019  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.320642  1534 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.287840  3401 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.332904  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:20.277057  3363 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:00:20.279910  3110 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:00:20.354424  1531 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.354175  1534 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:20.354238  1574 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.017s (SENT)
I20260709 13:00:20.318280  3393 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:20.329931  3434 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:20.337270  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.334172  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:20.319422  3448 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:00:20.349319  2256 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:20.287752  3021 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:00:20.336884  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57117.8us
I20260709 13:00:20.335403  3333 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:20.336323  3403 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5.
I20260709 13:00:20.339520  3401 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.350951  3342 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.362607  3430 consensus_queue.cc:1243] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:20.317906  3301 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:20.301651  3419 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:20.388230  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49775.8us
I20260709 13:00:20.381920  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:20.383235  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 96123.5us
I20260709 13:00:20.391101  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:20.393314  1605 raft_consensus.cc:2368] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:20.376770  3454 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.363440  3395 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:20.397630  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 117877us
I20260709 13:00:20.411489  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.412268  1605 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:20.414989  1574 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.040s (SENT)
I20260709 13:00:20.417732  1607 raft_consensus.cc:2410] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:20.420820  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 98198.8us
I20260709 13:00:20.394265  3454 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.424475  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:20.424762  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:20.430235  3463 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:20.432986  1574 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.077s (SENT)
I20260709 13:00:20.434762  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:20.451474  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:20.453940  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 82837.9us
I20260709 13:00:20.455168  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:20.433341  3458 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.437888  3457 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:00:20.457772  1605 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.458134  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:20.459025  1605 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:20.459333  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:20.459949  3333 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.461110  3333 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.464941  1605 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:20.466253  1605 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.471778  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:20.456410  1648 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.040s (SENT)
I20260709 13:00:20.472934  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.444041  3403 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.437858  3278 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.434114  3463 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.432255  3232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 321) took 8565 ms. Trace:
I20260709 13:00:20.476495  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:20.477917  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44989.6us
I20260709 13:00:20.478112  3455 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.478639  3455 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.434216  3454 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.478768  3440 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:20.479482  3454 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.481266  3419 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:20.483086  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:20.483891  2258 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:20.436038  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 337) took 1160 ms. Trace:
I20260709 13:00:20.484982  2255 rpcz_store.cc:276] 0709 13:00:19.275293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.279213 (+  3920us) service_pool.cc:224] Handling call
0709 13:00:20.435802 (+1156589us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b5400760f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:20.435941 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195107200}
I20260709 13:00:20.434317  3453 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.488790  3453 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:20.478662  1574 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.110s (SENT)
I20260709 13:00:20.490240  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.434414  3459 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:20.491560  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:20.491596  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:20.437734  3464 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:20.496547  3464 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.497279  3180 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.497845  3180 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.497483  3464 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.498266  3180 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.498441  3463 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.499325  3463 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.500581  3420 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.501168  3465 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:20.501610  3465 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.434538  3439 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:00:20.475759  3278 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:20.473656  3403 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:20.507839  3403 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.511345  3464 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.449508  3434 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.505470  1601 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:20.489225  3343 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:20.488015  3232 rpcz_store.cc:276] 0709 13:00:11.866786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.888343 (+ 21557us) service_pool.cc:224] Handling call
0709 13:00:13.082911 (+1194568us) ts_tablet_manager.cc:934] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:19.698095 (+6615184us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:19.799807 (+101712us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:19.820352 (+ 20545us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:20.375246 (+554894us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:20.427009 (+ 51763us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:20.432017 (+  5008us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:20.432166 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10738,"tablet-copy.queue_time_us":983888,"thread_start_us":1093284,"threads_started":2}
I20260709 13:00:20.479496  3455 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.504209  3459 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:20.497709  1574 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.483s (SENT)
I20260709 13:00:20.525251  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:20.519570  1605 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:20.514858  3420 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.534482  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.534767  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.538239  1534 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:20.545882  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54410.1us
I20260709 13:00:20.546567  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.553790  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:20.557457  3232 tablet_copy_client.cc:806] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:20.557938  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:20.558281  3232 tablet_copy_client.cc:670] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:20.558748  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:20.521394  3394 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.559341  1675 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:20.563009  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.564896  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:20.535624  3458 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:20.489945  3453 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.568173  3458 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.569600  2253 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:20.572237  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:20.535480  3457 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.575064  1676 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:20.577158  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123728us
I20260709 13:00:20.579272  1681 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.535852  3343 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:20.521842  3375 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:20.489952  3400 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:20.582330  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84654.6us
I20260709 13:00:20.591795  3363 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:20.592406  3467 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:20.592860  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.046s (SENT)
I20260709 13:00:20.593415  3393 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.593123  1430 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:20.560138  3359 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.593957  3448 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:20.599637  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.656128  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:20.562294  3247 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.507839  3278 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:20.691334  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.752686  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:20.706509  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.798746  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.751693  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:20.744481  3439 consensus_queue.cc:1243] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:20.571228  3401 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.672734  3467 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:20.749668  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:20.732270  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.699496  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 116263us
W20260709 13:00:20.724457  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.833135  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 83552.3us
W20260709 13:00:20.833608  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 177606us
I20260709 13:00:20.834744  2257 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:20.689214  3180 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.694291  1678 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:20.629818  3359 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:20.748497  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 160294us
I20260709 13:00:20.594336  3465 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.785959  3459 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:20.837049  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145795us
I20260709 13:00:20.842118  3359 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.843520  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:20.778821  3343 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:20.828712  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:20.851263  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:20.868431  1648 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.058s (SENT)
W20260709 13:00:20.922049  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.951500  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 69493.5us
I20260709 13:00:20.841240  3424 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:20.947798  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 94364.2us
W20260709 13:00:20.953079  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 101886us
I20260709 13:00:20.953567  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:20.849468  3262 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.849143  3466 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.864650  3461 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.963310  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128934us
I20260709 13:00:20.880743  3278 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:20.960767  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 336550us
I20260709 13:00:20.864934  3400 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:20.956291  3424 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.864466  3471 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.848903  3182 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:00:20.988894  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.010473  1608 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.842686  3363 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:00:20.840708  3472 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:00:20.847554  3395 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.845149  3142 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:00:20.957371  3394 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:21.003266  3434 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:20.962534  3262 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.014358  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.995575  3245 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:20.959931  3419 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:00:20.999178  3429 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:20.969424  3459 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:00:21.019624  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:20.999991  3461 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.020537  3262 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.013983  3363 consensus_queue.cc:1243] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:20.970378  3421 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:00:21.009840  3424 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:21.023931  3475 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:00:21.032341  3253 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:21.058830  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57791.4us
W20260709 13:00:21.159946  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 75101.9us
I20260709 13:00:21.171669  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:21.204607  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:21.205829  1678 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:21.206110  3473 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:21.206912  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:21.207618  2261 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.000265  3466 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.022081  3395 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.221623  2261 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:21.215413  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50997.1us
W20260709 13:00:21.220997  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.164855  3180 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.226078  1678 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:21.226699  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:21.227252  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:21.227442  2261 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.228572  1679 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:21.217103  3401 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.238379  1681 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:21.234136  3419 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:21.276110  2261 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
W20260709 13:00:21.283125  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.025146  3467 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:21.251027  3479 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 13:00:21.282415  3419 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:21.290566  3481 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:00:21.284839  3401 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:21.294184  3477 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.445s	user 0.001s	sys 0.000s
W20260709 13:00:21.298120  3474 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:00:21.299930  3405 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:21.300562  3461 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:21.301975  3348 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:21.280805  3470 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 13:00:21.294008  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 355) took 1523 ms. Trace:
W20260709 13:00:21.306680  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.318615  3403 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.002s
I20260709 13:00:21.303550  2261 pending_rounds.cc:85] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 4
I20260709 13:00:21.287055  3365 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:21.302207  3395 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:21.342973  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:21.273610  3492 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:21.347427  3403 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.351457  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.329258  3348 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:21.352418  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:21.358898  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51870.8us
I20260709 13:00:21.344909  2261 pending_rounds.cc:107] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:00:21.332648  3461 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:21.351893  3458 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:21.329754  3405 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.347970  3365 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.401629  2261 raft_consensus.cc:2889] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.347935  3492 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:21.402501  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.402452  3494 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:21.333298  3401 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:21.351514  3403 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:21.404297  3337 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.443717  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.428437  2257 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:21.428160  3348 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.444775  3348 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:21.400904  3486 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:00:21.431725  1609 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:21.403424  3484 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:00:21.403007  3490 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:00:21.407613  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.429870  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:21.448590  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 602727us
I20260709 13:00:21.333112  2252 rpcz_store.cc:276] 0709 13:00:19.770120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.781340 (+ 11220us) service_pool.cc:224] Handling call
0709 13:00:21.293739 (+1512399us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54005ddc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:21.293914 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370154240}
W20260709 13:00:21.458406  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.450558  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.446743  2259 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:21.454449  3365 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:21.455390  3495 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:00:21.290601  3419 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.457600  3424 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.466094  1601 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:21.464363  1602 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.441541  3458 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.468837  3492 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:21.479220  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.060s (SENT)
I20260709 13:00:21.479699  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:21.479866  3434 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:21.480880  1648 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.105s (SENT)
I20260709 13:00:21.445935  3461 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:21.481778  1648 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.130s (SENT)
I20260709 13:00:21.482146  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:21.483139  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 183) took 7406 ms. Trace:
I20260709 13:00:21.484455  1600 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:21.484323  1430 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:21.485433  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:21.485345  3262 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.464102  3466 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.486606  3466 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.483166  3461 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:21.487221  3466 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.489001  3461 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.489481  3466 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.469380  2252 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:21.485973  1430 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.489530  3405 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:21.493266  2256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 340) took 2093 ms (client timeout 1794 ms). Trace:
I20260709 13:00:21.493546  1605 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:21.474854  1608 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:21.480491  3434 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:21.493709  2256 rpcz_store.cc:269] 0709 13:00:19.399834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.401800 (+  1966us) service_pool.cc:224] Handling call
0709 13:00:21.493095 (+2091295us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54005131d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:21.493193 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114389248}
I20260709 13:00:21.631609  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:21.642590  1601 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:21.492733  1430 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.680823  1430 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.682485  1608 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:21.682727  1430 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:21.479645  3492 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.686460  1430 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.489817  3461 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:21.725296  1430 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.757481  1430 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.759191  1430 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 2, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:21.762089  3469 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.031s	user 0.003s	sys 0.005s
I20260709 13:00:21.785060  3468 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:21.785640  3468 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:21.786698  3468 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.451692  3401 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.791404  3401 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:21.792677  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.794202  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.746805  1602 raft_consensus.cc:2410] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:21.751150  3434 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:21.753371  3359 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.871s	user 0.003s	sys 0.008s
I20260709 13:00:21.726105  3507 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:21.812057  3403 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:21.819578  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:21.827421  1683 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:21.788177  3468 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.817813  3461 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.818148  3110 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:21.825253  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:21.832484   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:21.766940  3395 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.794766  3262 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:21.827230  3359 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.850642  3395 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:21.851627  1682 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:21.483552  1428 rpcz_store.cc:276] 0709 13:00:14.076716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.076865 (+   149us) service_pool.cc:224] Handling call
0709 13:00:17.434540 (+3357675us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:21.482944 (+4048404us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:18.168423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:18.169081 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:18.169121 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:00:18.169146 (+    25us) tablet.cc:662] Decoding operations
0709 13:00:18.170949 (+  1803us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:18.171023 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:18.171067 (+    44us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:18.207630 (+ 36563us) tablet.cc:701] Row locks acquired
0709 13:00:18.209917 (+  2287us) write_op.cc:260] PREPARE: finished
0709 13:00:18.238821 (+ 28904us) write_op.cc:270] Start()
0709 13:00:18.238982 (+   161us) write_op.cc:276] Timestamp: P: 1783602018235837 usec, L: 0
0709 13:00:18.239009 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:00:18.242447 (+  3438us) log.cc:844] Serialized 2515 byte log entry
0709 13:00:18.880942 (+638495us) op_driver.cc:464] REPLICATION: finished
0709 13:00:19.090786 (+209844us) write_op.cc:301] APPLY: starting
0709 13:00:19.109950 (+ 19164us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:19.136251 (+ 26301us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:19.160415 (+ 24164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:19.177041 (+ 16626us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:19.177352 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:19.177412 (+    60us) write_op.cc:312] APPLY: finished
0709 13:00:19.177779 (+   367us) log.cc:844] Serialized 53 byte log entry
0709 13:00:19.177986 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:19.178147 (+   161us) write_op.cc:454] Released schema lock
0709 13:00:19.178217 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:19.178687 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:19.178715 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31503,"reported_tablets":8,"spinlock_wait_cycles":480608000,"child_traces":[["op",{"apply.queue_time_us":172013,"apply.run_cpu_time_us":3769,"apply.run_wall_time_us":103257,"num_ops":6,"prepare.queue_time_us":87504,"prepare.run_cpu_time_us":6301,"prepare.run_wall_time_us":76140,"raft.queue_time_us":576660,"raft.run_cpu_time_us":25666,"raft.run_wall_time_us":207163,"replication_time_us":599519,"thread_start_us":690469,"threads_started":4,"wal-append.queue_time_us":3415,"wal-append.run_cpu_time_us":25774,"wal-append.run_wall_time_us":1937037}]]}
I20260709 13:00:21.837066  3424 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:21.891943  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 410147us
I20260709 13:00:21.830935  3461 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:21.895938  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.896960  1648 leader_election.cc:336] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.237s (SENT)
I20260709 13:00:21.897323  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:21.831110  3110 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:21.899889  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.832139  3403 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.851506  3507 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:21.908448  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.910162  1674 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:21.910964  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1370) took 1357 ms. Trace:
I20260709 13:00:21.911304  1674 rpcz_store.cc:276] 0709 13:00:20.553349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.559784 (+  6435us) service_pool.cc:224] Handling call
0709 13:00:20.601467 (+ 41683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.909994 (+1308527us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400428220. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:00:21.910637 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.910876 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56097152}
W20260709 13:00:21.916671  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1369) took 1596 ms (client timeout 2104 ms). Trace:
W20260709 13:00:21.917184  1607 rpcz_store.cc:269] 0709 13:00:20.320579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.367705 (+ 47126us) service_pool.cc:224] Handling call
0709 13:00:21.916261 (+1548556us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54003840d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:21.916535 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53066496}
I20260709 13:00:21.926656  3450 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:21.927240  3450 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:21.930141  3110 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:21.931723  3359 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.932250  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 255) took 1408 ms. Trace:
I20260709 13:00:21.932505  3439 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:21.933532  3439 consensus_queue.cc:1243] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:21.934382  3439 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:21.934782  3439 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:21.935462  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:21.936264  1607 raft_consensus.cc:606] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:21.936443  3507 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:21.936918  1607 raft_consensus.cc:614] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:21.937767  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:21.937858  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:21.938372  1528 raft_consensus.cc:2376] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3. Re-sending same reply.
I20260709 13:00:21.938532  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:21.939225  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:21.939908  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:21.940529  1528 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:21.937448  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:21.903592  3519 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.928182  3450 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:21.942868  1648 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.549s (SENT)
I20260709 13:00:21.941355  1532 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3. Re-sending same reply.
W20260709 13:00:21.940963  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 943318us
I20260709 13:00:21.944154  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:21.945150  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.945592  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.919582  3460 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:21.947499  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:21.948117  3463 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:21.948758  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 254) took 1425 ms. Trace:
W20260709 13:00:21.948872  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.942862  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:21.950410  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.953666  3403 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:21.954319  3450 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.955435  1526 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:21.958719  1530 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:21.932657  1533 rpcz_store.cc:276] 0709 13:00:20.523447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.523564 (+   117us) service_pool.cc:224] Handling call
0709 13:00:20.525899 (+  2335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.531192 (+  5293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.531220 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.531724 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.627893 (+ 96169us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.760992 (+133099us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.297601 (+536609us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b2400191b28. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a8309d 00007f7e636b510e 00007f7e636cc88c 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221
0709 13:00:21.931728 (+634127us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b18000ff700. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:00:21.931936 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.932015 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.932055 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:21.932068 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.932191 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166017,"prepare.queue_time_us":203028,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3064,"raft.queue_time_us":1201703,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":31612,"spinlock_wait_cycles":174921728,"thread_start_us":228430,"threads_started":2,"wal-append.queue_time_us":230196}
W20260709 13:00:21.960945  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.965864  1683 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:21.958493  1525 rpcz_store.cc:276] 0709 13:00:20.523132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.523655 (+   523us) service_pool.cc:224] Handling call
0709 13:00:20.523994 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:20.528190 (+  4196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.528221 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:20.537902 (+  9681us) log.cc:844] Serialized 52 byte log entry
0709 13:00:20.874059 (+336157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:20.993384 (+119325us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.761179 (+767795us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4800080058. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:00:21.940623 (+179444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.940697 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.940734 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:21.948552 (+  7818us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.948695 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1140171,"prepare.queue_time_us":80298,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4831,"raft.queue_time_us":970471,"raft.run_cpu_time_us":8737,"raft.run_wall_time_us":1216357,"spinlock_wait_cycles":23321856,"thread_start_us":320627,"threads_started":2,"wal-append.queue_time_us":428946}
I20260709 13:00:21.969697  1530 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:21.971957  1675 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:21.972972  1532 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:21.973414  1532 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:21.985378  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:21.986241  1528 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:21.974263  1532 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.988860  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:21.970979  3446 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.991286  3446 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:21.961994  3455 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:21.935819  3439 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:21.984591  3518 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:22.008184  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77348.2us
I20260709 13:00:21.965788  3440 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:22.000906  3348 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.005625  1674 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:22.007223  3487 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:22.028892  3454 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:22.031633  3457 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.031931  3359 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.022737  3458 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:22.058359  3480 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.966s	user 0.033s	sys 0.051s
I20260709 13:00:22.047278  3439 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.008411  3455 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:21.978111  3395 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:22.042012  3348 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:22.044442  3440 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:22.052512  3463 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:22.078738  3454 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:22.061056  3359 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:22.053318  3487 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:22.081948  3446 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:22.084426  3461 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:22.091071  3430 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:22.070281  3457 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:22.103714  3430 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:22.125566  3487 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:22.126626  3454 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:22.135761  3457 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:22.142874  3440 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:22.145255  3455 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:22.146193  3430 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:22.147589  3430 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.148667  3348 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:22.151356  3359 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:23.179306  1531 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:23.231956  3494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.004s	sys 0.009s
W20260709 13:00:23.232600  3494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.004s	sys 0.009s
W20260709 13:00:23.273880  3530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.000s	sys 0.008s
W20260709 13:00:23.274431  3530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.000s	sys 0.008s
I20260709 13:00:23.547592  3337 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.927063  3419 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.933130  3471 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:23.935235  3471 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:23.937647  3471 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:23.955050  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.955650  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.955964  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.956626  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.970368  3537 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:23.971231  3537 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:23.973866  3537 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:24.145251  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.133s	user 0.014s	sys 0.019s
I20260709 13:00:24.348181  3537 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.348489  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.336s	user 0.014s	sys 0.021s
W20260709 13:00:24.349020  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 2.34835e+06us
I20260709 13:00:24.348806  3537 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.351063  3537 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:24.351843  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.352345  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.352823  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.380731  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.549275  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1613) took 4488 ms. Trace:
I20260709 13:00:24.551040  1604 rpcz_store.cc:276] 0709 13:00:20.061630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.458325 (+396695us) service_pool.cc:224] Handling call
0709 13:00:20.458589 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.563576 (+104987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.563605 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.563656 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:20.563685 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.548020 (+3984335us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54004380d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:24.548073 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.548261 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241078528}
I20260709 13:00:24.545158  3537 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.555660  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.556531  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.556360  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1373) took 2611 ms. Trace:
I20260709 13:00:24.557766  1674 rpcz_store.cc:276] 0709 13:00:21.944674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.955510 (+ 10836us) service_pool.cc:224] Handling call
0709 13:00:21.989988 (+ 34478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.042284 (+ 52296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.556123 (+2513839us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.558885  1600 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 3.073s	user 0.024s	sys 0.017s
I20260709 13:00:24.559724  1600 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
W20260709 13:00:24.560444  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1381) took 3093 ms (client timeout 2174 ms). Trace:
W20260709 13:00:24.560935  1600 rpcz_store.cc:269] 0709 13:00:21.471188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.485159 (+ 13971us) service_pool.cc:224] Handling call
0709 13:00:24.560264 (+3075105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.557055  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.567392  3538 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.568090  3538 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.556602  3537 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.571480  3537 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.572683  3537 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.573870  3453 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:24.574286  3453 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:24.575147  3453 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.576086  3453 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.581758  3539 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.582628  3539 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:24.584028  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.585464  1532 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.585717  3539 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.586817  3538 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.590746  3537 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.595778  3537 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.596412  2253 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:24.598585  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 360) took 3975 ms. Trace:
I20260709 13:00:24.598964  2253 rpcz_store.cc:276] 0709 13:00:20.623251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.628699 (+  5448us) service_pool.cc:224] Handling call
0709 13:00:20.758839 (+130140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.596842 (+3838003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.598262 (+  1420us) spinlock_profiling.cc:243] Waited 3.84 s on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:24.598491 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8824959232}
I20260709 13:00:24.603776  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:24.596333  3537 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.612741  3537 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.615609  3537 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:24.623194  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.598s	user 0.033s	sys 0.025s
W20260709 13:00:24.623785  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.599s	user 0.034s	sys 0.025s
I20260709 13:00:24.626327  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:24.627044  1534 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
W20260709 13:00:24.627555  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1537) took 2689 ms (client timeout 2122 ms). Trace:
W20260709 13:00:24.629622  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.624223  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.634907  3494 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:24.638442  3537 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:24.639050  3537 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.641378  3537 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.641479  3545 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.642007  3545 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.642338  3545 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.642908  3494 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.643450  3494 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.645742  3494 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.643362  3471 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.646293  3494 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:24.646680  3494 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:24.646626  3471 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:24.648437  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.647601  3494 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:24.627867  1534 rpcz_store.cc:269] 0709 13:00:21.937629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.940147 (+  2518us) service_pool.cc:224] Handling call
0709 13:00:24.626172 (+2686025us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0ce9c 00007f7e60a0ca5b 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:24.627465 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952832}
I20260709 13:00:24.658555  3494 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:24.661681  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.729s	user 0.026s	sys 0.054s
W20260709 13:00:24.662178  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.730s	user 0.026s	sys 0.054s
W20260709 13:00:24.663581  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.663962  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.671020  3545 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.673125  3465 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.673981  3494 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.674607  3494 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.679885  3545 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.690335  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1542) took 2751 ms. Trace:
I20260709 13:00:24.690871  1531 rpcz_store.cc:276] 0709 13:00:21.938977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.948767 (+  9790us) service_pool.cc:224] Handling call
0709 13:00:21.949045 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.179745 (+1230700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.689950 (+1510205us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002ce554. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:24.690199 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828334976}
W20260709 13:00:24.692530  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.692932  3494 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:24.693210  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.694356  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 615) took 3248 ms. Trace:
I20260709 13:00:24.694759  2259 rpcz_store.cc:276] 0709 13:00:21.445903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.446154 (+   251us) service_pool.cc:224] Handling call
0709 13:00:21.446442 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.446641 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:21.848293 (+401652us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.693977 (+2845684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.694039 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:24.694090 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.694156 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.694291 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4222,"thread_start_us":187957,"threads_started":1,"wal-append.queue_time_us":266502,"wal-append.run_cpu_time_us":1348,"wal-append.run_wall_time_us":1001362}
I20260709 13:00:24.652977  3471 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.697162  3540 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.702145  3540 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.704982  3542 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.697821  3537 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.698621  3539 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.715157  3539 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.701612  1532 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:24.716449  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1546) took 2776 ms. Trace:
W20260709 13:00:24.717304  3276 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:24.717489  3539 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.717767  3538 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.705541  3543 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:24.718243  3538 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.718602  3543 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.699750  3464 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.706300  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 204) took 4150 ms (client timeout 1963 ms). Trace:
I20260709 13:00:24.706048  3540 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.714563  3542 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.705165  3544 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:24.713481  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:24.720690  3543 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.721807  1529 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.722265  3543 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.722709  3543 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.724709  3543 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.726109  3542 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.715121  3537 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.710081  1677 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:24.721194  1682 rpcz_store.cc:269] 0709 13:00:20.556009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.564607 (+  8598us) service_pool.cc:224] Handling call
0709 13:00:24.706001 (+4141394us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003abe54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:24.706176 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2956532608}
I20260709 13:00:24.721244  3464 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.721715  3544 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.736287  3544 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.697189  3494 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:24.737190  3494 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:24.717279  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58353.5us
I20260709 13:00:24.741206  3537 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.741530  3464 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.739956  3494 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.743137  1527 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.746037  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1541) took 2807 ms. Trace:
I20260709 13:00:24.749390  1527 rpcz_store.cc:276] 0709 13:00:21.938674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.942709 (+  4035us) service_pool.cc:224] Handling call
0709 13:00:21.948208 (+  5499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.743560 (+2795352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.745757 (+  2197us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54000d48d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:24.745965 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6426740480}
I20260709 13:00:24.751093  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:24.753194  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:24.762844  3464 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.763248  3464 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:24.763602  3464 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.754765  3541 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.766412  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:24.766042  3541 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.769318  3541 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.756155  3542 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:24.770799  3419 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.843s	user 0.013s	sys 0.000s
I20260709 13:00:24.772549  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 613) took 3484 ms. Trace:
I20260709 13:00:24.771770  3542 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.773861  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1372) took 4116 ms. Trace:
I20260709 13:00:24.773008  2261 rpcz_store.cc:276] 0709 13:00:21.288375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.288562 (+   187us) service_pool.cc:224] Handling call
0709 13:00:21.289149 (+   587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:21.470892 (+181743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.470928 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:24.753704 (+3282776us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:00:24.754433 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:00:24.771809 (+ 17376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:24.771964 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.772055 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.772099 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:24.772110 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.772487 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7845,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5667,"spinlock_wait_cycles":11433344,"thread_start_us":16970,"threads_started":1,"wal-append.queue_time_us":15351}
W20260709 13:00:24.761392  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 157677us
I20260709 13:00:24.774780  3464 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.775281  3420 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.775856  3420 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.776081  3494 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.776546  1529 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:24.777105  3494 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:24.777499  3494 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:24.778506  3494 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.779093  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:24.779788  3494 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.779873  3420 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.780480  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:24.782660  1430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.781s	user 0.029s	sys 0.014s
W20260709 13:00:24.783077  1430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.783s	user 0.030s	sys 0.014s
I20260709 13:00:24.784341  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.786965  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.788023  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:24.789398  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:24.790971  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.791675  3494 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.792626  3494 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.793375  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.774261  1675 rpcz_store.cc:276] 0709 13:00:20.657585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.787607 (+130022us) service_pool.cc:224] Handling call
0709 13:00:20.830293 (+ 42686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.977517 (+1147224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.773623 (+2796106us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000ec4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:24.773796 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625070464}
I20260709 13:00:24.797043  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.775313  3542 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.797710  1601 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:24.797211  1603 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:24.799705  3540 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:24.800057  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.800493  3540 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.801406  3464 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:24.819597  3256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.648s	user 0.006s	sys 0.052s
I20260709 13:00:24.802841  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:24.800623  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.821764  1573 connection.cc:256] RPC call timeout handler was delayed by -2.5896920949999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:00:24.822438  1573 connection.cc:256] RPC call timeout handler was delayed by -2.4661563189999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:00:24.822974  1573 connection.cc:256] RPC call timeout handler was delayed by -2.1175510229999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:00:24.823282  1573 connection.cc:256] RPC call timeout handler was delayed by -1.9990955380000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:00:24.823560  1573 connection.cc:256] RPC call timeout handler was delayed by -1.5525595779999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:00:24.823838  1573 connection.cc:256] RPC call timeout handler was delayed by -1.2041788639999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 13:00:24.791306  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:24.812731  3262 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.813644  3343 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.813843  3538 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:24.814105  3333 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.814587  3498 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:24.815415  3393 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.815910  3405 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.816067  3485 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.816471  3403 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.816632  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:24.820722  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3495871250000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:00:24.837957  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3180871250000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:00:24.838361  1606 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:24.834908  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43687.7us
W20260709 13:00:24.838380  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3007258989999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:00:24.839609  1649 connection.cc:256] RPC call timeout handler was delayed by -1.1110871249999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 13:00:24.840417  3552 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.716847  1532 rpcz_store.cc:276] 0709 13:00:21.940699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.959175 (+ 18476us) service_pool.cc:224] Handling call
0709 13:00:21.959531 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.585083 (+2625552us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b58006305d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63a8d0aa 00007f7e63b0f447 00007f7e63b27fe7 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:00:24.716115 (+131032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.716383 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76796160}
W20260709 13:00:24.842262  1649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.551s (SENT) [suppressed 87 similar messages]
I20260709 13:00:24.850788  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:24.821403  3256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.662s	user 0.006s	sys 0.052s
W20260709 13:00:24.854152  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.821486  3395 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.840965  3552 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.857883  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.848732  3262 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.848922  3498 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.855656  3538 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.848701  3333 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.851076  3393 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.851300  3405 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.856521  3516 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:24.854058  3403 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.859642  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.872699  2254 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:24.834093  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:24.848454  3343 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.853874  3544 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.857792  1647 connection.cc:256] RPC call timeout handler was delayed by -1.6368775760000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:00:24.859143  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:24.859320  3494 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:24.865988  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 63250.4us
I20260709 13:00:24.866477  3395 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.870850  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.870850  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.855302  3375 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.875803  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.884630  2261 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:24.880043  3405 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.885577  2254 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:24.885861  3405 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.858754  3553 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.872412  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:24.855331  3548 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.858358  3485 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:24.880263  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0657088190000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
W20260709 13:00:24.887553  1647 connection.cc:256] RPC call timeout handler was delayed by -1.6053775760000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:00:24.887285  2259 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:24.886023  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:24.879729  3403 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.905606  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.889592  3544 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.889827  3553 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.890394  3375 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.913347  3375 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.891517  3513 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:24.914285  3513 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.892014  3494 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:24.858079  3547 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.892513  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:24.902848  1647 connection.cc:256] RPC call timeout handler was delayed by -1.5037978169999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:00:24.892450  3395 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.907383  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:24.892599  3333 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.933454  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.876793  3343 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.904983  3420 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:24.933527  2261 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.934352  3420 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.906776  3538 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.909201  3403 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.879906  3498 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.877601  1600 raft_consensus.cc:606] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:24.909782  3337 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.336s	user 0.014s	sys 0.007s
I20260709 13:00:24.910303  3552 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:24.916966  1647 connection.cc:256] RPC call timeout handler was delayed by -1.398377575999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:00:24.942189  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2705775759999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:00:24.942752  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.943475  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:24.903973  1500 leader_election.cc:400] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:24.944445  3545 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.945091  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:24.945633  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.941177  3403 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.920693  3513 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.921640  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.921548  3544 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.963454  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:24.964207  1675 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.965236  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.921873  1609 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.969072  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1378) took 3566 ms. Trace:
I20260709 13:00:24.969470  1609 rpcz_store.cc:276] 0709 13:00:21.426096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.462244 (+ 36148us) service_pool.cc:224] Handling call
0709 13:00:21.499245 (+ 37001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.921703 (+3422458us) spinlock_profiling.cc:243] Waited 3.36 s on lock 0x7b54003a1720. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:00:24.968749 (+ 47046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.968999 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7727248256}
I20260709 13:00:24.924093  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.909902  3485 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:24.925280  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.971302  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:24.926275  1607 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:24.926437  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.926633  3547 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.927294  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:24.974020  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46814.7us
I20260709 13:00:24.945088  3545 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:24.927556  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.927799  3494 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:24.927984  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:24.976966  1602 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:24.928949  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:24.930019  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.977114  3494 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.931625  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:24.978624  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:24.986330  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:24.987110  1678 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:24.988247  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:24.989117  1678 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:24.997789  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.999078  1648 connection.cc:256] RPC call timeout handler was delayed by -4.4325728119999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:00:24.999516  1648 connection.cc:256] RPC call timeout handler was delayed by -4.317913773999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:00:24.878515  3262 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:24.876760  3393 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:24.936152  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1377) took 3586 ms (client timeout 1776 ms). Trace:
I20260709 13:00:24.937964  1601 raft_consensus.cc:2410] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:24.950721  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.001191  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.001693  1683 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
W20260709 13:00:25.002077  2226 connection.cc:256] RPC call timeout handler was delayed by -2.507135624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:00:25.002475  2226 connection.cc:256] RPC call timeout handler was delayed by -2.2531383369999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:00:24.997805  2261 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:24.961338  1682 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.961628  2257 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:24.906792  3548 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:24.977511  2256 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:25.006313  3548 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.006170  3182 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:24.981115  3420 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:25.008889  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:24.977361  3547 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.009582  3547 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:25.010056  3547 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.010689  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.011509  1601 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:25.012902  1681 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.013926  3256 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:24.982326  3463 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.014729  3256 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:25.015363  1680 raft_consensus.cc:1217] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:00:25.015892  1680 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:25.015708  3256 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:25.016582  1574 leader_election.cc:336] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.987s (SENT)
I20260709 13:00:25.017277  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.020367  3548 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.021065  3548 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.021550  3548 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.021680  3182 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:25.015909  3403 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.024751   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:25.025763  3548 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:25.026226  3545 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:25.016290  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.001693  1675 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:25.029070  1674 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:00:25.029917  3547 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:25.000023  1648 connection.cc:256] RPC call timeout handler was delayed by -4.2737119859999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:00:24.932873  3553 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:25.000941  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.886379  3405 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:25.032049  1648 connection.cc:256] RPC call timeout handler was delayed by -3.8802664989999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:00:25.032503  1648 connection.cc:256] RPC call timeout handler was delayed by -3.1517788520000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:00:24.999560  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.002779  2226 connection.cc:256] RPC call timeout handler was delayed by -1.8994596500000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 13:00:24.962270  1676 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:25.033561  2226 connection.cc:256] RPC call timeout handler was delayed by -1.8707327560000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:00:25.028999  1682 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:25.033946  2226 connection.cc:256] RPC call timeout handler was delayed by -1.8196280509999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:00:25.001045  1603 rpcz_store.cc:269] 0709 13:00:21.349463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.434569 (+ 85106us) service_pool.cc:224] Handling call
0709 13:00:24.935930 (+3501361us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b540029bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:24.936075 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7710165376}
I20260709 13:00:25.001966  1679 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:25.034716  3463 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:25.037599  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.040617  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.041339  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:00:25.043635  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 201383us
I20260709 13:00:25.043890  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.044981  1682 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:25.044869  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.044205  3545 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:25.048485  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.050309  3276 raft_consensus.cc:2764] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:25.050383  3232 tablet_copy_client.cc:538] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:25.051530  3554 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.032610  3547 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:25.054661  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.056905  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.035948  3538 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:25.068159  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:25.068969  2259 raft_consensus.cc:2376] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5. Re-sending same reply.
I20260709 13:00:25.063036  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.063431  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.070118  1603 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:25.070626  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.075897  2259 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:25.072790  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.064218  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.062906  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.034121  3405 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.078275  2258 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.082927  2259 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.080070  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.079008  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.079432  1606 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:25.081244  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1620) took 3866 ms. Trace:
I20260709 13:00:25.088037  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.086313  1682 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:25.095355  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.091538  1677 rpcz_store.cc:276] 0709 13:00:21.214437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.214572 (+   135us) service_pool.cc:224] Handling call
0709 13:00:24.709889 (+3495317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.728832 (+ 18943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.080993 (+352161us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b54003abe50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:25.081162 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8015393024}
I20260709 13:00:25.095870  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:25.086301  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.096264  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.097137  1601 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:25.053295  3463 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.100795  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.103888  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:25.073915  3538 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:25.105947  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.050414  3420 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:25.121503  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.064549  3548 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:00:25.122306  2255 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:25.079252  3276 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:25.121692  3420 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:25.123102  3420 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:25.123342  2257 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:25.124336  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.124022  3420 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.125204  2257 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:25.125443  3420 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.048564  3545 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.128254  3545 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:25.101629  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.132602  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.100710  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.105093  3182 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 13:00:25.132603  2282 debug-util.cc:398] Leaking SignalData structure 0x7b0800273e40 after lost signal to thread 434
I20260709 13:00:25.101826  3453 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:25.132602  1648 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.570s (SENT)
I20260709 13:00:25.087037  3464 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.141592  1648 leader_election.cc:336] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.606s (SENT)
I20260709 13:00:25.142107  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.137084  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.143878  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:25.147537  1675 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:25.148619  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.138558  3542 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:25.151839  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.169569  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:25.170311  1680 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:25.152076  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.145659  3464 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.171862  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.150817  3552 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.147454  3547 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.153185  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.183480  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.153406  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.153329  3453 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:25.153924  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.140951  3142 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:25.123371  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.177199  3552 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.188901  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:25.155294  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0600 after lost signal to thread 1466
I20260709 13:00:25.155714  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.156769  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.157898  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.158630  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.149248  3463 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.152613  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.159335  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.193179  1601 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:25.159555  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.160025  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.160112  3424 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.194147  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.160549  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.161566  3538 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.162194  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.163676  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.164019  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:25.217008  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.217484  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:25.164430  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.168259  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.151551  3276 consensus_queue.cc:1243] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:25.168640  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.166730   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:25.232708  2259 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.169251  3542 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:25.231326  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:25.169363  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.235625  1683 raft_consensus.cc:2410] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:25.172947  3464 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.135895  3421 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:25.174297  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 294) took 7125 ms. Trace:
I20260709 13:00:25.174181  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.147876  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:25.175992  1648 leader_election.cc:336] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.954s (SENT)
I20260709 13:00:25.176023  1606 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:00:25.285140  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 137341us
I20260709 13:00:25.177155  1525 raft_consensus.cc:2410] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:25.177588  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.182696  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:25.184276  1605 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:25.186087  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.188760  3552 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.189808  2282 debug-util.cc:398] Leaking SignalData structure 0x7b080029b8a0 after lost signal to thread 1480
I20260709 13:00:25.189486  1534 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.187644  1682 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:25.192042  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.195287  2261 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.189231  1529 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:25.294091  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.294237  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:25.295230  3142 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.283061  3393 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.295646  3142 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.201862  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.296696  1681 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:25.210827  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.297605  1532 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.211597  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:25.215916  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 56444.3us
I20260709 13:00:25.218535  1679 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:25.300777  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.301463  2258 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:25.210189  3539 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.283352  2256 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:25.192036  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.215466  3453 consensus_queue.cc:1243] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:25.265956  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.236649  1432 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.309149  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.311193  1605 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:25.309756  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.267031  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.312467  1609 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:25.265820  1530 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:25.289466  1430 rpcz_store.cc:276] 0709 13:00:18.052205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.054878 (+  2673us) service_pool.cc:224] Handling call
0709 13:00:24.783362 (+6728484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:24.783391 (+    29us) write_op.cc:454] Released schema lock
0709 13:00:25.174228 (+390837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:22.135793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:22.139066 (+  3273us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:22.139135 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:00:22.139158 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:22.175460 (+ 36302us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:22.175522 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:22.175549 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:00:22.176435 (+   886us) tablet.cc:701] Row locks acquired
0709 13:00:22.176485 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:00:22.176667 (+   182us) write_op.cc:270] Start()
0709 13:00:22.176827 (+   160us) write_op.cc:276] Timestamp: P: 1783602022176585 usec, L: 0
0709 13:00:22.176848 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:22.177605 (+   757us) log.cc:844] Serialized 4087 byte log entry
0709 13:00:23.274580 (+1096975us) op_driver.cc:464] REPLICATION: finished
0709 13:00:23.442097 (+167517us) write_op.cc:301] APPLY: starting
0709 13:00:23.442190 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:23.442423 (+   233us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:23.442544 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:23.443769 (+  1225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:23.444022 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:00:23.444071 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:23.446023 (+  1952us) log.cc:844] Serialized 77 byte log entry
0709 13:00:23.465447 (+ 19424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:23.465596 (+   149us) write_op.cc:454] Released schema lock
0709 13:00:23.465651 (+    55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1121041,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":167176,"apply.run_cpu_time_us":3281,"apply.run_wall_time_us":23942,"num_ops":10,"prepare.queue_time_us":159713,"prepare.run_cpu_time_us":28867,"prepare.run_wall_time_us":908392,"raft.queue_time_us":741231,"raft.run_cpu_time_us":1796,"raft.run_wall_time_us":174338,"replication_time_us":1097403,"thread_start_us":3791767,"threads_started":4,"wal-append.queue_time_us":108401,"wal-append.run_cpu_time_us":12138,"wal-append.run_wall_time_us":2160790}]]}
I20260709 13:00:25.313155  1530 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:25.270291  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.312961  2259 raft_consensus.cc:2410] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:25.308852  2261 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.307797  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.285986  1606 pending_rounds.cc:85] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 1
I20260709 13:00:25.171985  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.315397  1525 raft_consensus.cc:2410] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:25.292207  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9c80 after lost signal to thread 1558
W20260709 13:00:25.315928  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9c60 after lost signal to thread 1559
I20260709 13:00:25.315408  1606 pending_rounds.cc:107] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:25.316609  1606 raft_consensus.cc:2889] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.192648  2254 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
W20260709 13:00:25.303288  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 127324us
I20260709 13:00:25.302739  1604 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:25.317682  1532 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:25.318617  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.269927  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.307658  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.306077  3567 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.312988  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46036.1us
I20260709 13:00:25.320389  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.285156  3538 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:25.322314  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9420 after lost signal to thread 1633
I20260709 13:00:25.323632  1534 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:25.238708  3276 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:00:25.324761  2282 debug-util.cc:398] Leaking SignalData structure 0x7b080032a4e0 after lost signal to thread 1707
I20260709 13:00:25.324956  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.325372  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:25.295750  3393 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.328423  3393 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.328956  3403 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.327481  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:25.327966  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6260 after lost signal to thread 1708
I20260709 13:00:25.329380  3403 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:25.330087  3403 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:25.330782  2282 debug-util.cc:398] Leaking SignalData structure 0x7b080032c040 after lost signal to thread 2285
I20260709 13:00:25.332168  1534 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:25.333163  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.296224  3142 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.334251  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.297411  3459 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.296886  3262 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.303840  3539 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.326906  3513 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.416008  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:25.344120  3567 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.323285  1432 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:25.419308  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.406203  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 87470.8us
I20260709 13:00:25.308708  3542 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.335780  2255 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:25.424455  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.327131  3421 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.424615  3232 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:25.425725  1525 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.467509  1534 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:25.329353  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:25.427395  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 125128us
I20260709 13:00:25.322196  3554 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.416008  1530 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:25.306947  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:25.326169  3463 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.322392  3471 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:00:25.468964  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.454267  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.468719  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.467718  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:25.481966  1534 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:25.482321  1525 raft_consensus.cc:2376] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2. Re-sending same reply.
I20260709 13:00:25.482831  1530 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.426776  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:25.468115  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 235265us
I20260709 13:00:25.471949  1432 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:00:25.469544  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:25.481890  1601 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:25.444272  3276 consensus_queue.cc:1243] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:25.487737  1528 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:25.450268  3539 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.489835  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.491458  1432 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.493363  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.497421  1534 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
W20260709 13:00:25.456600  3565 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:00:25.505843  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.445375  3262 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.498957  3421 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.500198  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.501187  1432 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.502710  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:25.505029  3561 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:00:25.505029  3564 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:25.509164  1532 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.513481  1432 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:00:25.471143  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.520931  1432 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.523475  1432 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.521629  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:25.490185  3554 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:25.550348  1432 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:25.568742  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.551959  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83061.6us
I20260709 13:00:25.549880  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.532253  1530 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:25.571525  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 87360us
W20260709 13:00:25.571941  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 242658us
I20260709 13:00:25.453450  3563 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:00:25.509370  3262 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:25.580967  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 111476us
I20260709 13:00:25.568519  1432 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:25.579907  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.582726  1432 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 5, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:00:25.581331  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59803.2us
I20260709 13:00:25.581235  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.584286  1534 raft_consensus.cc:2376] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4. Re-sending same reply.
I20260709 13:00:25.584836  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.585155  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.586181  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.588073  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.588696  1534 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.589615  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.590507  1534 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.590677  1432 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 2, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:00:25.591506  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.490748  3463 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:25.593791  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 378052us
I20260709 13:00:25.592453  1432 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:00:25.597810  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:25.594107  1534 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:25.598207  1432 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.599596  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.600288  1534 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:25.600205  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.602401  1530 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:25.605700  1432 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 3, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.606956  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.607581  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:25.615533  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.616564  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.578820  3554 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:25.587182  3567 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.626094  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.626699  1608 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:25.622634  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.632836  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.551661  3142 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.570533  3552 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.640333  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.641347  1528 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.645072  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.646359  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.649317  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:25.649106  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48964.6us
I20260709 13:00:25.650077  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:25.646579  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64874.2us
I20260709 13:00:25.653321  1530 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.660236  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.661403  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.662166  1534 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:25.663758  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.664851  1528 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:25.666430  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.665686  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.668893  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.669751  1534 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:25.668455  1528 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:25.671257  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:25.672068  1528 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:25.605469  3464 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:25.618954  3421 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:25.618438  3420 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:00:25.678045  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 83055.4us
I20260709 13:00:25.618582  3182 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:25.639209  3245 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.677142  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.682687  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.684828  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.686283  1526 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:25.694160  1530 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:25.695276  1530 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:25.695695  1530 pending_rounds.cc:85] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 4
I20260709 13:00:25.695915  1530 pending_rounds.cc:107] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:00:25.696090  1530 raft_consensus.cc:2889] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.646462  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.621357  3572 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:00:25.640062  3567 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:25.675264  3375 raft_consensus.cc:2764] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:25.703320  1528 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:25.679512  3424 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.706447  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:25.708458  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58863.5us
I20260709 13:00:25.709827  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.711001  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.712839  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.685420  3574 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:25.713596  3554 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.700439  3577 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.702381  3405 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.721105  3464 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.724852  3513 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.753813  3464 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:25.753960  3513 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.754582  3513 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.755285  3464 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.740864  3577 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.728675  3573 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.740711  1529 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:25.750417  3583 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.725262  3586 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.724532  3567 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.721400  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.707794  3543 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:25.765787  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:25.744477  3547 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:25.713201  3578 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:00:25.763127  1533 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:25.714902  3403 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:25.797968  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 85410.3us
W20260709 13:00:25.761775  1527 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.536s	user 0.004s	sys 0.004s
W20260709 13:00:25.782452  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 184717us
I20260709 13:00:25.732978  3538 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.752164  3245 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.745349  3405 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:25.799031  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.768512  3573 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.764791  3577 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.772385  3579 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:25.813303  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.779732  3583 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.743536  3576 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:00:25.814898  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.815689  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.825161  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:25.826170  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.816939  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.781107  3588 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:25.801163  3537 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:25.814182  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.823606  3583 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.837039  1682 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:25.838151  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.838944  1682 raft_consensus.cc:2410] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:25.839715  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.822525  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:25.841678  3574 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.841935  3587 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:25.796571  1600 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:25.843652  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:25.828961  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:25.816582  3553 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.831506  3403 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.832193  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.832953  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.833452  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.834205  3552 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:25.834650  3592 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:25.801596  3464 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.813843  3578 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:25.852851  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:25.853116  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 87431.7us
I20260709 13:00:25.801173  3567 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.853487  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.811560  3573 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.802857  3405 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.843796  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:25.802461  3538 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.859185  3516 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.801702  1527 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:25.860369  3587 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:25.894883  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:25.862190  1681 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:25.862530  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:26.036536  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 174081us
I20260709 13:00:25.864636  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:25.866006  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 181221us
I20260709 13:00:25.866482  1678 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:25.842679  3570 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
W20260709 13:00:25.867714  1574 connection.cc:256] RPC call timeout handler was delayed by -3.1343017020000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:00:25.842661  3574 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.853327  3575 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.854163  3553 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.856364  3572 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.945822  1529 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:25.925647  3463 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:25.916879  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:25.947814  3539 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:25.938576  1527 pending_rounds.cc:85] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 5
I20260709 13:00:25.893226  3538 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.872179  3182 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.865376  3578 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:25.892445  3516 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:25.865068  3579 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:25.916823  3513 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:25.873430  3567 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.028882  1677 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
W20260709 13:00:26.032049  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.893934  3587 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:26.039166  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 174612us
W20260709 13:00:26.039448  1574 connection.cc:256] RPC call timeout handler was delayed by -3.1325017020000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:00:26.042049  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.047170  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:26.031906  3393 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.703s	user 0.005s	sys 0.005s
I20260709 13:00:26.068454  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.093968  1681 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.025102  3262 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.055917  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.005362  3583 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.047240  3485 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:26.094529  1574 connection.cc:256] RPC call timeout handler was delayed by -3.089301702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:00:26.046890  3576 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.067044  1527 pending_rounds.cc:107] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:26.047447  3574 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.101524  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.103181  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.106245  1531 raft_consensus.cc:2368] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3.
I20260709 13:00:26.106936  1677 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:26.099341  1574 connection.cc:256] RPC call timeout handler was delayed by -2.949801702000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 13:00:26.097759  1603 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:26.096091  3182 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.099018  3587 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.100797  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.093541  3516 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.107298  1574 connection.cc:256] RPC call timeout handler was delayed by -2.896701701999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:00:26.113499  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.111795  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:26.112375  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:26.119975  1574 connection.cc:256] RPC call timeout handler was delayed by -2.7797017020000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:00:26.051537  3553 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.123421  1677 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:26.125270  2260 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:26.123665  1574 connection.cc:256] RPC call timeout handler was delayed by -2.7104017020000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:00:26.124009  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:26.126138  1574 connection.cc:256] RPC call timeout handler was delayed by -2.6195017019999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:00:26.127446  1574 connection.cc:256] RPC call timeout handler was delayed by -2.2937017019999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2597s for a response
W20260709 13:00:26.127862  1574 connection.cc:256] RPC call timeout handler was delayed by -1.6727017019999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3287s for a response
I20260709 13:00:26.128355  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.129638  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.133055  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.133635  1603 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:26.101173  1527 raft_consensus.cc:2889] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.137121  3585 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.097859  3485 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:26.136626  1681 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:26.141886  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.099536  3576 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:26.095413  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.108982  3597 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.162591  1600 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:26.112502  3579 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.142565  3577 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.139242  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.115089  3513 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.113735  3567 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.149072  3245 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:26.061306  3575 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.152576  3537 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.153306  3584 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.181550  3537 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.153736  3542 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.182144  3537 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.156301  3539 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:26.153061  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 324199us
W20260709 13:00:26.159273  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.111683  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.110239  3182 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:26.103359  3393 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.143569  3585 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:26.186177  1683 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:26.186439  3393 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.143769  3485 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.187217  3577 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:26.187919  1674 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:26.163801  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.188694  1530 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.190397  3262 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.189420  1674 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:26.156536  3464 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.192153  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.192602  3464 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.193499  1681 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.194468  3583 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:26.195087  1603 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:26.164938  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.131620  3554 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.115425  3405 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.161635  3576 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.176124  3256 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:26.181651  3584 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.231859  3584 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.232297  3182 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:26.131673  3403 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.227102  3539 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:26.233804  3182 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:26.234723  3182 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.210948  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.211012  1530 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:26.237739  3575 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:26.229852  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1385) took 1041 ms. Trace:
I20260709 13:00:26.240680  1603 rpcz_store.cc:276] 0709 13:00:25.188117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.175311 (+987194us) service_pool.cc:224] Handling call
0709 13:00:26.192592 (+ 17281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.228588 (+ 35996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.229788 (+  1200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.242985  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.194813  3464 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:26.244936  1603 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:26.246142  1603 pending_rounds.cc:85] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 2
I20260709 13:00:26.232060  3540 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.249151  1603 pending_rounds.cc:107] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:26.249629  1603 raft_consensus.cc:2889] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.166260  3573 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:26.250537  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 89796us
I20260709 13:00:26.250871  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.251617  1499 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:26.254922  1499 leader_election.cc:403] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.245510  3575 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.253831  1526 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:26.258328  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:26.256065  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.258957  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.228039  1677 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:26.247606  3463 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.282210  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.283370  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:26.259799  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.175333  3556 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:00:26.282135  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.240768  3516 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.285015  3375 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.291370  3516 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:26.257525  3539 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
I20260709 13:00:26.250437  3540 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:26.284433  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.285470  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:26.281179  3592 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.288805  3245 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.284783  3542 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:26.294381  1526 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:26.298107  3538 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.282721  3463 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.299185  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.316648  3584 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.301688  3421 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.317379  3538 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:26.304980  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.317590  3463 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:26.337955  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 166741us
I20260709 13:00:26.338264  1680 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.312160  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:26.313618  3592 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.314630  3573 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.304186  3245 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:26.316491  3577 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.300449  3567 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.354319  3567 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.354856  3567 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.282392  1600 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.356837  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1396) took 1071 ms. Trace:
I20260709 13:00:26.315936  3542 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.356967  3245 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.322258  3421 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.326027  3610 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:26.320201  3276 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.331723  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.308434  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.325980  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.334326  3403 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.318193  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.304199  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.341310  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:26.373317  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 69197.4us
I20260709 13:00:26.341892  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.374270  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.375568  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.376912  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.358300  3538 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.377888  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.378583  1605 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:26.379288  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.379900  1605 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:26.379632  3463 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.346545  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.388170  1603 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.347940  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.351229  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.343355  2258 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:26.389496  1678 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.389384  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.353415  2257 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.357940  2261 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.324805  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.361299  2259 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.365875  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:26.366344  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57966.7us
I20260709 13:00:26.393960  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:26.394133  1605 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:26.367631  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.324843  3405 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.369740  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.401798  1526 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.344285  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:26.380249  2252 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.380538  3464 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.381593  2255 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.341432  3583 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:26.336539  3540 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:26.414459  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1653) took 1232 ms. Trace:
I20260709 13:00:26.384596  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.386425  3538 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:26.315995  3574 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.381503  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.379904  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:26.364219  3421 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:26.403165  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59006us
I20260709 13:00:26.409013  3424 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.370575  3577 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.368220  3539 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:00:26.448345  3464 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.449515  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:26.450230  2252 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:26.450594  3553 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.451378  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:26.410794  3594 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.459095  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:26.409689  3579 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.415685  1606 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.414876  1607 rpcz_store.cc:276] 0709 13:00:25.177828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.177982 (+   154us) service_pool.cc:224] Handling call
0709 13:00:25.179197 (+  1215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.179408 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:25.183229 (+  3821us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.102221 (+918992us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b180033ac60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:00:26.170259 (+ 68038us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.405859 (+235600us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:26.405915 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:26.405959 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.406031 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.410451 (+  4420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29513,"prepare.queue_time_us":17729,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":43809,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5938,"spinlock_wait_cycles":2791808,"thread_start_us":801866,"threads_started":4,"wal-append.queue_time_us":521635}
I20260709 13:00:26.433970  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:26.404702  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:26.434239  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.461833  1532 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:26.438823  1603 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:26.358943  1600 rpcz_store.cc:276] 0709 13:00:25.285362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.230487 (+945125us) service_pool.cc:224] Handling call
0709 13:00:26.251418 (+ 20931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.356549 (+105131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.356773 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.406271  3575 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.431715  3538 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.439733  3262 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:26.445616  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1624) took 1272 ms. Trace:
I20260709 13:00:26.447297  3463 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.452579  1526 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:26.472198  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 81366.9us
I20260709 13:00:26.453794  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:26.463320  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:26.463976  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59382.8us
I20260709 13:00:26.465072  1681 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:26.410806  3598 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.470350  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:26.410701  2256 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.472122  1528 rpcz_store.cc:276] 0709 13:00:25.172858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.672713 (+499855us) service_pool.cc:224] Handling call
0709 13:00:25.696505 (+ 23792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.705811 (+  9306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.445368 (+739557us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b540008e3d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:26.445522 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54024448}
I20260709 13:00:26.385541  3403 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.450350  3485 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.409148  3554 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:26.456136  3594 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.494714  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:26.496433  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.496169  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.496883  1678 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:26.469956  3579 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:26.496387  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:26.500478  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.537165  1528 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:26.537711  2261 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:26.469612  3540 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.420564  3583 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.497157  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.543076  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.543687  3583 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.505609  1680 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:00:26.472536  3577 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.529609  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.499961  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.544222  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.506712  3393 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:26.541005  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.504591  3598 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.553010  1680 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:00:26.547679  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51427.6us
I20260709 13:00:26.549243  1681 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:26.492234  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 184463us
I20260709 13:00:26.548874  1677 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.532563  2257 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:26.538172  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.537284  3337 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.494760  3375 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:00:26.498775  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.555442  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.504884  3464 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.557384  1680 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:26.556651  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 248) took 1472 ms. Trace:
I20260709 13:00:26.494441  3589 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:00:26.536584  3579 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.544696  3574 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:26.548637  3577 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.563035  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:26.560211  3393 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:26.568260  1606 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:26.569604  3621 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:00:26.549587  3586 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:26.550769  3553 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:26.573796  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:26.537544  3575 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:26.537235  3594 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.602619  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.555629  3598 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:26.604202  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 150498us
I20260709 13:00:26.505332  3616 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:00:26.576967  1602 rpcz_store.cc:276] 0709 13:00:25.083774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.086517 (+  2743us) service_pool.cc:224] Handling call
0709 13:00:26.556412 (+1469895us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540012fa54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:26.556575 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496159616}
I20260709 13:00:26.562237  3617 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.613530  3577 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.638744  3586 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:26.603982  3618 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.644600  2255 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:26.670204  3615 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.006s
I20260709 13:00:26.671849  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:26.672770  1675 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:26.645211  3617 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.685004  1681 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:26.698341  1649 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.551s (SENT)
I20260709 13:00:26.698881  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:26.699764  3574 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:26.701781  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.702310  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.741421  1649 leader_election.cc:336] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.574s (SENT)
I20260709 13:00:26.671352  3420 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.683251  3463 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.696072  3262 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:26.671566  3537 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.687801  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:26.747134  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.702663  3538 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.687976  3617 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:26.785313  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.748018  3420 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.756013  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.779623  1609 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.877518  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.871377  2258 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:26.778861  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 249265us
I20260709 13:00:26.828616  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:26.876047  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 129005us
W20260709 13:00:26.826658  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1622) took 1654 ms (client timeout 1927 ms). Trace:
I20260709 13:00:26.889178  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:26.775938  1677 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
W20260709 13:00:26.889498  1531 rpcz_store.cc:269] 0709 13:00:25.171929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.211339 (+ 39410us) service_pool.cc:224] Handling call
0709 13:00:26.826440 (+1615101us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:26.826570 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852409600}
I20260709 13:00:26.889627  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:26.892236  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.892948  1604 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:26.893946  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:26.894639  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.895396  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 321711us
W20260709 13:00:26.869573  3245 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.003s
I20260709 13:00:26.752055  1606 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:00:26.899564  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.665s (SENT)
W20260709 13:00:26.753328  3593 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:26.909716  3543 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:26.868974  3576 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.004s
W20260709 13:00:26.868462  3626 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:00:26.806190  3337 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.916783  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1394) took 1678 ms. Trace:
W20260709 13:00:26.801455  3620 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:00:26.904906  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.749161  3572 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.886478  3420 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.808462  1600 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:26.801764  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.802681  3585 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.851013  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:26.805831  3375 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:26.934319  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.713s (SENT)
I20260709 13:00:26.971020  1680 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:26.888175  3403 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:26.950816  1604 rpcz_store.cc:276] 0709 13:00:25.238065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.828270 (+1590205us) service_pool.cc:224] Handling call
0709 13:00:26.916697 (+ 88427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.900357  3571 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.898957  3544 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:26.949023  1531 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:26.935334  3543 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:26.837121  3567 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.825413  3545 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:26.919243  3574 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.933923  3245 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.962572  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.963989  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:26.966024  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.969077  1607 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.777343  3463 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:26.969815  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75937.4us
I20260709 13:00:26.825038  3568 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:26.973207  1574 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.868s (SENT)
I20260709 13:00:26.955710  1527 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:26.977874  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:26.749318  3393 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.004897  1605 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.010107  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:27.010720  1574 leader_election.cc:336] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.927s (SENT)
I20260709 13:00:27.007301  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.011080  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:26.974654  3375 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:26.973555  3608 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:00:27.005358  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 127268us
I20260709 13:00:26.977903  3544 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.012521  1525 raft_consensus.cc:2368] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4.
I20260709 13:00:27.013092  1604 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:27.001381  3584 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.013856  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:27.002872  3543 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.018769  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.018764  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:26.975884  1602 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:26.976509  3585 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:26.999262  1529 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:26.793071  3586 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:26.945585  3576 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.024618  1531 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:27.030215  3182 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.008395  3568 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:27.036360  1574 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.134s (SENT)
I20260709 13:00:27.024608  3588 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.043819  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.047802  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.017418  3494 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:27.022997  3544 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.043905  1534 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:27.064359  1534 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:27.065066  1534 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.022881  3403 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:27.058887  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.037854  2255 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:27.049268  3575 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:00:27.059641  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:27.062561  3421 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.000s
I20260709 13:00:27.049777  3574 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.068498  1680 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:27.069518  1534 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.059962  3494 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.052364  3584 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.056715  3538 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.011072  3262 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.064069  3540 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:27.080022  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43730.3us
I20260709 13:00:27.074466  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:27.067783  3375 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.054996  3589 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:00:27.102640  3494 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.104910  3567 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.071774  1500 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 2 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 2. Current term is 3.
W20260709 13:00:27.123270  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51625us
I20260709 13:00:27.081614  3635 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:27.068499  3579 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.087625  3574 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.063717  3642 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:27.078362  3421 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.073180  3403 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.124199  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.101734  3540 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.074714  3420 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.145752  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:27.123701  3573 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.151954  1605 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:27.135387  3375 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.137602  3567 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.166662  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.135910  1529 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:27.145569  3494 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.153527  3540 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.087648  3568 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.192833  3568 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:27.199199  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.171015  1534 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:27.225181  1534 pending_rounds.cc:85] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 5
I20260709 13:00:27.225483  1534 pending_rounds.cc:107] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:27.225726  1534 raft_consensus.cc:2889] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.226418  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1552) took 1920 ms. Trace:
I20260709 13:00:27.175421  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.176775  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:27.228065  1606 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:27.180888  3643 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:00:27.158784  3640 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:27.185007  3232 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.243569  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.163235  3584 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:27.185166  3574 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.186337  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.187094  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.156934  3182 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.165748  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67522.5us
I20260709 13:00:27.181484  3617 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.208513  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:27.169404  3641 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:00:27.165901  3538 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:27.211409  3544 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.212071  3403 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.192384  3578 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.216938  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:27.267752  1677 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:27.136555  3598 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:27.186354  3639 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:00:27.205430  3635 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.218643  3543 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.219163  3421 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.222014  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 376) took 1125 ms. Trace:
I20260709 13:00:27.226707  1534 rpcz_store.cc:276] 0709 13:00:25.306180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.674268 (+368088us) service_pool.cc:224] Handling call
0709 13:00:25.674732 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.043819 (+1369087us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5400157fa0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:00:27.226165 (+182346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.226365 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88920960}
I20260709 13:00:27.279853  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.229677  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.157573  3576 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:27.167414  3245 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.283366  2257 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:27.284250  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:27.284487  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:27.226751  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.278939  2260 rpcz_store.cc:276] 0709 13:00:26.096846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.097030 (+   184us) service_pool.cc:224] Handling call
0709 13:00:27.221772 (+1124742us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b54005c0b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:27.221939 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4167040}
W20260709 13:00:27.285835  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 59193.8us
I20260709 13:00:27.169286  3463 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:27.245071  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1621) took 2073 ms (client timeout 1868 ms). Trace:
I20260709 13:00:27.185565  3585 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.245640  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:27.289719  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44142.8us
I20260709 13:00:27.287967  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:27.290964  2260 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:27.288173  1533 rpcz_store.cc:269] 0709 13:00:25.171631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.171744 (+   113us) service_pool.cc:224] Handling call
0709 13:00:27.244849 (+2073105us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003435d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:27.244981 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420372864}
W20260709 13:00:27.231191  3638 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:00:27.161037  3573 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:27.243153  3453 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:27.261888  1604 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:27.298171  1533 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.298866  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1578) took 1046 ms. Trace:
I20260709 13:00:27.299170  1533 rpcz_store.cc:276] 0709 13:00:26.252124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.297603 (+1045479us) service_pool.cc:224] Handling call
0709 13:00:27.298014 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.298583 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.298805 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.265419  1574 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.597s (SENT)
I20260709 13:00:27.263167  1600 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.264664  3182 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.270500  3578 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.261457  2254 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.271731  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.272204  1532 raft_consensus.cc:2368] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4.
I20260709 13:00:27.272398  3232 tablet_bootstrap.cc:492] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
W20260709 13:00:27.272703  3614 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:00:27.277915  3594 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.616s	user 0.001s	sys 0.009s
W20260709 13:00:27.271827  3577 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.005s
W20260709 13:00:27.282749  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.249284  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.282903  1534 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.285142  2259 raft_consensus.cc:2368] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:00:27.252679  3471 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:27.286535  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.294556  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.300290  1533 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:27.302186  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.302937  2258 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.303917  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.351480  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1632) took 1098 ms. Trace:
W20260709 13:00:27.352103  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48305.3us
I20260709 13:00:27.351851  1533 rpcz_store.cc:276] 0709 13:00:26.253098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.299764 (+1046666us) service_pool.cc:224] Handling call
0709 13:00:27.300052 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.351224 (+ 51172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.351422 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.352710  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.302096  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 253339us
I20260709 13:00:27.334211  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:27.353509  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67025.6us
I20260709 13:00:27.320906  2261 raft_consensus.cc:2376] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4. Re-sending same reply.
I20260709 13:00:27.285167  2257 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:27.289346  3635 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.297508  3463 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.358210  2257 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.358253  3463 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:27.338235  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.360410  2259 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:27.346324  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.341102  3543 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:27.295621  3576 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:27.355837  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.356719  3568 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.346496  3577 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.353899  3538 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.384351  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 253) took 1859 ms. Trace:
I20260709 13:00:27.361536  1533 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.385005  3617 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.385529  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1639) took 1130 ms. Trace:
I20260709 13:00:27.385879  1533 rpcz_store.cc:276] 0709 13:00:26.254881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.360531 (+1105650us) service_pool.cc:224] Handling call
0709 13:00:27.360833 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.385274 (+ 24441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.385472 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.386641  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 634) took 1042 ms. Trace:
I20260709 13:00:27.386897  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.387534  1533 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.389631  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:27.390439  2261 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:27.349591  3579 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:27.363379  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:27.348243  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 85653.3us
W20260709 13:00:27.393710  1574 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 3.287s (SENT)
I20260709 13:00:27.350090  2255 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.368165  3245 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:27.369390  3142 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.376142  3453 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:27.347160  3594 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:27.376390  3646 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:00:27.377501  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1573) took 1132 ms. Trace:
I20260709 13:00:27.376832  1534 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:27.377861  3647 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:27.378239  3420 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.360621  3232 ts_tablet_manager.cc:1403] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.936s	user 0.018s	sys 0.024s
I20260709 13:00:27.383776  3653 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:00:27.395900  2259 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:27.384801  1608 rpcz_store.cc:276] 0709 13:00:25.524532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.246382 (+721850us) service_pool.cc:224] Handling call
0709 13:00:27.383614 (+1137232us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:27.383835 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.384012 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.384036 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.384078 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:27.384107 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.384160 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.384266 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5361536}
I20260709 13:00:27.417515  1675 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:27.400104  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44363.5us
I20260709 13:00:27.412233  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.359347  3463 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:27.420622  1533 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:27.477432  3577 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:27.474277  3573 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.482723  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.483867  3655 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.468114  3568 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:27.485100  3655 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.485450  3655 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:27.466012  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60992.7us
I20260709 13:00:27.458161  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.488771  1647 leader_election.cc:400] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
W20260709 13:00:27.443295  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.488883  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.490893  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.486207  3655 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.493374  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.494099  3655 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.495630  1601 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.377485  3182 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.496519  3577 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:27.430456  3453 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.498535  3577 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:27.499238  3577 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.500206  3577 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.501569  3577 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.502424  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1623) took 1685 ms. Trace:
I20260709 13:00:27.487690  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.503424  1603 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.503015  1683 rpcz_store.cc:276] 0709 13:00:25.817502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.856289 (+ 38787us) service_pool.cc:224] Handling call
0709 13:00:25.856670 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.186640 (+329970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.502172 (+1315532us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540007e4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:27.502361 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757247744}
I20260709 13:00:27.457701  3617 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.510403  3617 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.511698  3337 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:27.515741  3632 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.714s	user 0.003s	sys 0.007s
I20260709 13:00:27.516913  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.517932  1534 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.516104  3616 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.218227   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:27.503235  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.521538  1604 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.521895  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.522607  1526 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:27.523043  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 290) took 1175 ms. Trace:
I20260709 13:00:27.523339  1526 rpcz_store.cc:276] 0709 13:00:26.348051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.493413 (+145362us) service_pool.cc:224] Handling call
0709 13:00:27.521736 (+1028323us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:27.522980 (+  1244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12015488}
I20260709 13:00:27.520713  3616 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:27.525318  3616 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.526299  3537 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.520666  3568 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:27.527923  3568 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.528834  3568 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.530048  3337 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.526467  3616 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.531316  3471 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.530900  1526 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:27.420547  3579 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.442987  3571 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:00:27.502568  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.534734  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1644) took 1273 ms. Trace:
I20260709 13:00:27.551963  1532 rpcz_store.cc:276] 0709 13:00:26.261401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.494478 (+233077us) service_pool.cc:224] Handling call
0709 13:00:27.243348 (+748870us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:27.534541 (+291193us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54003057d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:27.534672 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73298560}
I20260709 13:00:27.553141  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:27.530993  3337 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.559154  2252 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:27.553673  1532 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.561741  3621 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:27.536648  3598 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.562188  3621 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:27.562842  3598 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.533385  3544 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.563251  3621 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.551312  1600 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:27.550869  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:27.564402  3621 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.563339  3598 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.556145  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.400470  3464 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.566721  3485 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:27.539193  3651 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:00:27.533317  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1647) took 1250 ms. Trace:
W20260709 13:00:27.569017  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 156874us
W20260709 13:00:27.569344  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80549.6us
W20260709 13:00:27.600462  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 97960.4us
I20260709 13:00:27.474354  1530 rpcz_store.cc:276] 0709 13:00:26.245292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.248886 (+  3594us) service_pool.cc:224] Handling call
0709 13:00:26.249191 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.249526 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.249553 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.263705 (+ 14152us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.408940 (+145235us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:26.412571 (+  3631us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.464661 (+ 52090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.464734 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.152769 (+688035us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b1800398bc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:27.377107 (+224338us) raft_consensus.cc:1685] finished
0709 13:00:27.377200 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.377427 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1722,"prepare.queue_time_us":3402,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":58981,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":26452,"spinlock_wait_cycles":3482368,"thread_start_us":167480,"threads_started":2,"wal-append.queue_time_us":209736}
I20260709 13:00:27.570788  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:27.572460  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79901.5us
I20260709 13:00:27.575362  1608 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:27.602030  1605 raft_consensus.cc:2368] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4.
I20260709 13:00:27.599550  1526 rpcz_store.cc:276] 0709 13:00:26.282410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.524214 (+1241804us) service_pool.cc:224] Handling call
0709 13:00:27.530677 (+  6463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.533063 (+  2386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.533261 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.600543  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.603446  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.500385  3232 raft_consensus.cc:359] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:27.582828  1603 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:27.367441  1529 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:27.581264  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:27.421845  3610 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 13:00:27.586421  1528 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:27.608139  1534 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:27.585867  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:27.566727  3453 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.598877  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.602169  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:27.601334  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:27.619971  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.604398  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.604772  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.601388  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.607477  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:27.589044  3537 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:27.606420  3276 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.589406  3583 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:27.618427  1526 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:00:27.532284  3471 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.589247  3597 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.621666  2259 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.627632  1530 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:27.627890  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.618527  1534 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:00:27.622427  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:27.630986  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1648) took 1348 ms. Trace:
I20260709 13:00:27.631306  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.628659  2227 leader_election.cc:400] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4.
I20260709 13:00:27.621462  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:27.608245  3232 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:27.636137  2227 leader_election.cc:403] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.638319  2258 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:27.632164  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:27.609331  3543 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.614568  1529 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:27.613721  3598 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.634368  1526 rpcz_store.cc:276] 0709 13:00:26.282650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.617758 (+1335108us) service_pool.cc:224] Handling call
0709 13:00:27.618171 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.630720 (+ 12549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.630930 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.605676  3544 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:00:27.614387  3587 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.635150  3589 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.651242  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.538417  3579 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.630276  3182 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.680423  1532 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:27.735347  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1652) took 1451 ms. Trace:
W20260709 13:00:27.702842  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65491.5us
W20260709 13:00:27.735749  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 103651us
W20260709 13:00:27.703974  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 81278.1us
I20260709 13:00:27.628553  3573 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:27.703109  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72582.7us
I20260709 13:00:27.705150  2259 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:27.634420  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1650) took 1351 ms. Trace:
I20260709 13:00:27.737864  1534 rpcz_store.cc:276] 0709 13:00:26.283181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.617942 (+1334761us) service_pool.cc:224] Handling call
0709 13:00:27.618320 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.634138 (+ 15818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.634363 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.635274  3545 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.632954  3403 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.635555  3453 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.619334  3585 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.630631  3583 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.711599  1526 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:27.771907  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1653) took 1488 ms. Trace:
I20260709 13:00:27.772248  1526 rpcz_store.cc:276] 0709 13:00:26.283893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.711048 (+1427155us) service_pool.cc:224] Handling call
0709 13:00:27.711397 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.771619 (+ 60222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.771848 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.702782  2255 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:27.761395  3494 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.002s
W20260709 13:00:27.725059  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73897.7us
I20260709 13:00:27.783531  1604 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:27.732842  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 131584us
I20260709 13:00:27.784768  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.739126  3579 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.644119  3539 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:27.735682  1532 rpcz_store.cc:276] 0709 13:00:26.283652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.651287 (+1367635us) service_pool.cc:224] Handling call
0709 13:00:27.651584 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.735095 (+ 83511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.735293 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.762607  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:27.712667  3631 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.621448  3578 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:27.639320  3597 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.608450  3574 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:00:27.776350  1534 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:27.771780  3640 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.817135  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1654) took 1533 ms. Trace:
I20260709 13:00:27.817548  1534 rpcz_store.cc:276] 0709 13:00:26.284150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.738729 (+1454579us) service_pool.cc:224] Handling call
0709 13:00:27.776109 (+ 37380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.816747 (+ 40638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.817000 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.778162  3645 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.383s	user 0.000s	sys 0.002s
I20260709 13:00:27.778016  3453 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:27.779786  3471 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:27.765290  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1649) took 1478 ms. Trace:
I20260709 13:00:27.768527  3568 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.765133  3232 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:27.777467  3583 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.390520  2253 rpcz_store.cc:276] 0709 13:00:26.343834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.345935 (+  2101us) service_pool.cc:224] Handling call
0709 13:00:26.356717 (+ 10782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.551295 (+194578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.554568 (+  3273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:26.558502 (+  3934us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:26.562054 (+  3552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.386399 (+824345us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540039ba54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:27.386442 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.386579 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432954240}
I20260709 13:00:27.742057  3610 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.762171  3375 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:27.648839  3513 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.786165  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.739486  3575 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:27.860801  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 74698.6us
I20260709 13:00:27.861788  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:27.739071  3393 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4.
I20260709 13:00:27.739531  3571 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:27.791827  3540 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.001s
I20260709 13:00:27.793493  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:27.775841  3545 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.765196  3403 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.811064  3653 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:00:27.810906  3337 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:27.810465  3635 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.776281  3589 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.796373  3544 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.795482  3256 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:27.827207  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 89120.8us
I20260709 13:00:27.812829  3539 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.913175  3256 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.913352  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:27.914008  3661 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:00:27.913748  3256 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.915246  3610 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:27.868549  3453 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:27.869867  3660 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:27.855351  3471 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:27.814553  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52051us
I20260709 13:00:27.893262  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 289) took 1545 ms. Trace:
I20260709 13:00:27.851444  3574 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:27.942289  3663 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:00:27.872134  3403 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.894560  3577 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:27.822947  1529 rpcz_store.cc:276] 0709 13:00:26.282904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.613844 (+1330940us) service_pool.cc:224] Handling call
0709 13:00:27.614176 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.705633 (+ 91457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.761071 (+ 55438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.957950  3589 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.905298  3545 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.893857  3142 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.959595  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 291) took 1611 ms. Trace:
I20260709 13:00:27.914666  3539 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:27.867484  3659 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:27.960043  1529 rpcz_store.cc:276] 0709 13:00:26.348404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.958714 (+1610310us) service_pool.cc:224] Handling call
0709 13:00:27.959065 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.959244 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.959274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.959315 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:27.959363 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.959419 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.959533 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.863626  3420 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.946871  3471 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.940871  1534 rpcz_store.cc:276] 0709 13:00:26.347782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.855983 (+1508201us) service_pool.cc:224] Handling call
0709 13:00:27.892737 (+ 36754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.892937 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.892963 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.893003 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:27.893034 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.893086 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.893198 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.872212  3636 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:27.898339  3575 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:27.828733  3568 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.892356  3592 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:27.823908  3631 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:27.900110  3540 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.954334  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1645) took 1009 ms. Trace:
I20260709 13:00:27.956660  3256 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:27.920172  3571 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:27.996662  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 260043us
W20260709 13:00:27.957862  3665 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:27.912940  3544 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:27.939668  3586 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:00:28.021677  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:28.022698  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.024926  1529 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:28.030853  1529 pending_rounds.cc:85] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 5
I20260709 13:00:28.031294  1529 pending_rounds.cc:107] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:28.030826  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.010829  1680 rpcz_store.cc:276] 0709 13:00:26.944770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.980890 (+ 36120us) service_pool.cc:224] Handling call
0709 13:00:27.000064 (+ 19174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.080806 (+ 80742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.954089 (+873283us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b540007d5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:27.954257 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156832000}
I20260709 13:00:28.004128  3539 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.971033  3577 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:28.032536  3539 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:28.032936  3577 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.034083  3577 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.035403  3539 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.031637  1529 raft_consensus.cc:2889] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.864635  3375 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.038618  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 294) took 1632 ms. Trace:
I20260709 13:00:28.039057  1534 rpcz_store.cc:276] 0709 13:00:26.406068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.011900 (+1605832us) service_pool.cc:224] Handling call
0709 13:00:28.038087 (+ 26187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.038313 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.038343 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.038380 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:28.038409 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.038464 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.038563 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.045728  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:28.045921  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:27.936872  3635 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.079413  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:28.071012  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.046794  1675 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:28.089181  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.076038  3539 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.088743  3538 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.028527  3674 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:00:28.009527  3592 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.146104  3671 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.147776  3671 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:28.148066  3635 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.143092  3539 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.150169  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.152640  1676 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:28.148904  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:28.151868  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 331090us
W20260709 13:00:28.149648  3664 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:00:28.145226  3578 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:28.149140  3375 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:28.175525  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 284036us
I20260709 13:00:28.150671  3539 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.159238  3597 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.180904  1574 leader_election.cc:400] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4.
I20260709 13:00:28.130306  3575 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.194301  1603 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:28.171446  3471 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.200407  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:28.203367  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 290069us
I20260709 13:00:28.178944  3420 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:00:28.207449  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:28.211287  1603 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:28.211922  1603 pending_rounds.cc:85] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
I20260709 13:00:28.212244  1603 pending_rounds.cc:107] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:28.176671  3578 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.212669  1603 raft_consensus.cc:2889] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.198320  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:28.188385  3574 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:28.158941  3571 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.231040  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:28.201503  3677 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.196537  3597 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:28.202814  3256 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:00:28.148293  3671 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:28.395767  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 197549us
I20260709 13:00:28.395949  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1655) took 2111 ms. Trace:
W20260709 13:00:28.402223  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 194864us
I20260709 13:00:28.202525  3539 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.400588  1526 rpcz_store.cc:276] 0709 13:00:26.284501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.773098 (+1488597us) service_pool.cc:224] Handling call
0709 13:00:27.773491 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.773881 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.773912 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.774381 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.173676 (+399295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:28.173715 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.173797 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.395705 (+221908us) raft_consensus.cc:1685] finished
0709 13:00:28.395725 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.395885 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13707,"thread_start_us":389379,"threads_started":1,"wal-append.queue_time_us":471872}
W20260709 13:00:28.298573  3672 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:00:28.268505  3616 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.009s
I20260709 13:00:28.293094  3232 ts_tablet_manager.cc:1434] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.840s	user 0.024s	sys 0.023s
I20260709 13:00:28.413852  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.230931  3540 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.222770  3682 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.231679  3636 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.389478  3681 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.402913  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:28.415235  3656 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.948s	user 0.002s	sys 0.002s
W20260709 13:00:28.440708  3513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.019s	sys 0.030s
I20260709 13:00:28.459553  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.462762  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:28.409409  3592 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.355160  3403 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:28.440943  3232 ts_tablet_manager.cc:1467] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 1021ms
I20260709 13:00:28.450867  3453 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.473039  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 70191.5us
I20260709 13:00:28.473959  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:28.403879  3597 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.449836  3636 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:28.462312  3513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.020s	sys 0.030s
I20260709 13:00:28.440641  3142 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:00:28.439452  3256 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:28.438613  3686 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:00:28.417768  3539 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.465884  3516 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.404079  3677 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.443254  3182 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:28.467564  3420 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.498618  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:28.414801  3653 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:00:28.459957  3616 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:00:28.479625  3636 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:28.500974  3679 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:00:28.479879  3689 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.510673  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:28.501659  3543 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.001s
I20260709 13:00:28.502188  3513 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:28.479494  3453 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.527941  3697 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:28.525849  3689 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.461241  3681 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.524204  3685 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:28.530782  3693 raft_consensus.cc:2764] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:00:28.527348  3543 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.497215  3574 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:28.547170  3683 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:00:28.519682  3587 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
I20260709 13:00:28.502701  3586 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:28.509557  3420 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.543212  3513 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.543877  3681 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:28.544440  3579 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.000s
I20260709 13:00:28.539987  3597 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.508574  3516 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.556653  3576 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.556710  3691 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:00:28.540001  3696 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:28.575594  3539 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.616636  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:28.618657  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 288) took 2271 ms. Trace:
I20260709 13:00:28.618868  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1651) took 2335 ms. Trace:
I20260709 13:00:28.621940  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 295) took 2166 ms. Trace:
W20260709 13:00:28.625211  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.655519  1534 rpcz_store.cc:276] 0709 13:00:26.455779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.123364 (+1667585us) service_pool.cc:224] Handling call
0709 13:00:28.140858 (+ 17494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.141084 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:28.167993 (+ 26909us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.621036 (+453043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.621158 (+   122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:28.621268 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.621425 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.621696 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14192,"prepare.queue_time_us":27351,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":22750,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":343,"thread_start_us":452369,"threads_started":1,"wal-append.queue_time_us":363972}
I20260709 13:00:28.655268  1530 rpcz_store.cc:276] 0709 13:00:26.283416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.637001 (+1353585us) service_pool.cc:224] Handling call
0709 13:00:27.640488 (+  3487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.649202 (+  8714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.649238 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.764122 (+114884us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.032520 (+268398us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:28.407017 (+374497us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.407257 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.407340 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.618110 (+210770us) raft_consensus.cc:1685] finished
0709 13:00:28.618163 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.618664 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52186,"prepare.queue_time_us":82430,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":85,"raft.queue_time_us":12011,"raft.run_cpu_time_us":6556,"raft.run_wall_time_us":67934,"thread_start_us":596777,"threads_started":2,"wal-append.queue_time_us":406849}
I20260709 13:00:28.659329  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.659495  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:28.625722  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1645) took 2343 ms (client timeout 2604 ms). Trace:
I20260709 13:00:28.629053  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1575) took 2381 ms. Trace:
I20260709 13:00:28.630339  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:28.628069  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.635959  1679 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:28.636797  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 109891us
I20260709 13:00:28.637785  3256 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:28.668836  3256 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.530236  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:28.639914  2255 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:28.674991  3539 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.675170  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:28.676582  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1674) took 1103 ms. Trace:
I20260709 13:00:28.677126  1602 rpcz_store.cc:276] 0709 13:00:27.573049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.577201 (+  4152us) service_pool.cc:224] Handling call
0709 13:00:28.674636 (+1097435us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:28.676421 (+  1785us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16449920}
W20260709 13:00:28.581105  3583 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.002s
I20260709 13:00:28.680848  3583 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.681860  3453 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.571823  3579 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.684743  3182 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.685662  3182 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.684788  2261 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:28.690537  3681 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:28.577970  3621 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.992s	user 0.012s	sys 0.000s
I20260709 13:00:28.691486  3681 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.635958  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:28.579591  3696 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:28.650482  3420 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:28.654421  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.575501  3516 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.694633  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:28.695078  1526 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:28.687867  3256 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.696125  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:28.472958  3232 ts_tablet_manager.cc:1469] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:00:11.866786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.888343 (+ 21557us) service_pool.cc:224] Handling call
0709 13:00:13.082911 (+1194568us) ts_tablet_manager.cc:934] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:19.698095 (+6615184us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:19.799807 (+101712us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:19.820352 (+ 20545us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:20.375246 (+554894us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:20.427009 (+ 51763us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:20.432017 (+  5008us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:20.432166 (+   149us) inbound_call.cc:177] Queueing success response
0709 13:00:25.424052 (+4991886us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:27.443908 (+2019856us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:27.485466 (+ 41558us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:27.486019 (+   553us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10738,"mutex_wait_us":5908,"raft.queue_time_us":306345,"spinlock_wait_cycles":20100992,"tablet-copy.queue_time_us":983888,"tablet-download-pool.queue_time_us":13059,"tablet-download-pool.run_cpu_time_us":4677,"tablet-download-pool.run_wall_time_us":4467326,"thread_start_us":1387943,"threads_started":3}
I20260709 13:00:28.667564  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.577669  3576 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:28.663340  1528 rpcz_store.cc:269] 0709 13:00:26.281881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.555199 (+273318us) service_pool.cc:224] Handling call
0709 13:00:28.625204 (+2070005us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000b4fd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:28.625474 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330861312}
I20260709 13:00:28.699124  1680 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:28.676209  3539 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:28.576138  3677 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.713649  3681 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:28.713554  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 272) took 1142 ms. Trace:
I20260709 13:00:28.714833  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:28.716065  1530 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:28.715942  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:28.717800  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:28.718709  1676 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:28.719197  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:28.720206  3621 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:28.655148  1532 rpcz_store.cc:276] 0709 13:00:26.347504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.796794 (+1449290us) service_pool.cc:224] Handling call
0709 13:00:27.797244 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.811862 (+ 14618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.811891 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:27.817467 (+  5576us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.196397 (+378930us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:28.224858 (+ 28461us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.225104 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.225189 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.617723 (+392534us) raft_consensus.cc:1685] finished
0709 13:00:28.617801 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.618380 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16736,"prepare.queue_time_us":28849,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":24113,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":49779,"thread_start_us":336041,"threads_started":1,"wal-append.queue_time_us":486644}
I20260709 13:00:28.687865  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:28.704203  1533 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:28.684165  3583 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:28.694698  3696 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.756775  3516 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:28.757365  3516 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.757774  3516 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.758289  2256 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:28.685539  3579 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:28.760440  3256 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.760766  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:28.761643  1533 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.664762  1527 rpcz_store.cc:276] 0709 13:00:26.247107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.054019 (+806912us) service_pool.cc:224] Handling call
0709 13:00:27.072703 (+ 18684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.371825 (+299122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.371872 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.372366 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.589471 (+217105us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:27.827465 (+237994us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.863375 (+ 35910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.628114 (+764739us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540043c454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:28.628198 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.628325 (+   127us) raft_consensus.cc:1685] finished
0709 13:00:28.628488 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.628829 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":405396,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":6272,"raft.queue_time_us":5968,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":7135,"spinlock_wait_cycles":656691968,"thread_start_us":370910,"threads_started":2,"wal-append.queue_time_us":277284}
I20260709 13:00:28.697788  3182 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:28.695087  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:28.741500  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 341042us
I20260709 13:00:28.721776  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:28.715219  1600 rpcz_store.cc:276] 0709 13:00:27.571097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.576998 (+  5901us) service_pool.cc:224] Handling call
0709 13:00:27.952880 (+375882us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:27.953127 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.024324 (+ 71197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.028765 (+  4441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.045447 (+ 16682us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:28.075397 (+ 29950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.712936 (+637539us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b5400027454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:28.713019 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.713296 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166642944}
I20260709 13:00:28.753404  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.755344  3453 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.759186  3421 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:28.700028  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:28.766693  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 79118.8us
I20260709 13:00:28.765959  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:28.767118  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.768288  1534 raft_consensus.cc:2376] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4. Re-sending same reply.
I20260709 13:00:28.793678  1677 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:28.794236  1543 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e0746dbce2334050a0a5359c93c14f2c received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:28.795223  1543 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-e0746dbce2334050a0a5359c93c14f2c on tablet e0746dbce2334050a0a5359c93c14f2c with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:28.785579  1526 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:28.802807  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.804003  1534 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:28.805721  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:28.808843  1528 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
W20260709 13:00:28.814913  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 95499us
I20260709 13:00:28.824903  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:28.825835  1534 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:28.827307  3578 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:28.827502  1534 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:28.828445  3711 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:28.829054  3182 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:28.833297  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:28.814255  1532 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:28.840927  1682 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:28.837090  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1657) took 1660 ms. Trace:
I20260709 13:00:28.844066  1530 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.844092  1534 rpcz_store.cc:276] 0709 13:00:27.174175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.826670 (+1652495us) service_pool.cc:224] Handling call
0709 13:00:28.827215 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.833735 (+  6520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.834241 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.836651  3182 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:28.851352  1528 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:28.859380  3636 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:28.880560  1532 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:29.104658  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 297) took 2546 ms. Trace:
I20260709 13:00:29.105150  1528 rpcz_store.cc:276] 0709 13:00:26.558425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.832458 (+2274033us) service_pool.cc:224] Handling call
0709 13:00:28.843760 (+ 11302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.104330 (+260570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.104587 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.879518  3711 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.107107  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:29.231513  1526 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:29.190667  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84119.6us
I20260709 13:00:29.177577  1533 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:29.324515  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 476766us
I20260709 13:00:29.331106  3543 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:29.335405  1528 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:29.351501  3677 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.353901  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1584) took 1976 ms. Trace:
I20260709 13:00:29.359300  1528 rpcz_store.cc:276] 0709 13:00:27.362688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.154340 (+1791652us) service_pool.cc:224] Handling call
0709 13:00:29.309433 (+155093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.338557 (+ 29124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.338795 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:29.362655  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46819.5us
I20260709 13:00:29.361431  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:29.410374  3629 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.411037  1533 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:29.412467  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1585) took 2049 ms. Trace:
I20260709 13:00:29.412900  1533 rpcz_store.cc:276] 0709 13:00:27.362928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.324151 (+1961223us) service_pool.cc:224] Handling call
0709 13:00:29.410375 (+ 86224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.411903 (+  1528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.412361 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.413414  3393 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:29.352586  3677 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.478232  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 301) took 1888 ms. Trace:
I20260709 13:00:29.478703  1533 rpcz_store.cc:276] 0709 13:00:27.589788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.438102 (+1848314us) service_pool.cc:224] Handling call
0709 13:00:29.477499 (+ 39397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.477866 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.477893 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.477951 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.477979 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.478031 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.478149 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.332206  3543 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:29.481720  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 105110us
I20260709 13:00:29.484637  3393 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.486272  3587 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:29.488186  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1422) took 1304 ms. Trace:
I20260709 13:00:29.488842  3182 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.500067  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 299) took 1919 ms. Trace:
I20260709 13:00:29.516358  1528 rpcz_store.cc:276] 0709 13:00:27.580577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.392167 (+1811590us) service_pool.cc:224] Handling call
0709 13:00:29.465056 (+ 72889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.474832 (+  9776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.474864 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.499725 (+ 24861us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.499775 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.499846 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.499994 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.518333  3574 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.524920  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:29.568183  1600 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:29.527168  1602 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:29.569388  3711 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:29.461017  3629 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.480967  3681 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.570706  3681 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.529549  3182 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.527546  1674 rpcz_store.cc:276] 0709 13:00:28.025017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.029058 (+  4041us) service_pool.cc:224] Handling call
0709 13:00:28.128436 (+ 99378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.145174 (+ 16738us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:28.509923 (+364749us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.845914 (+335991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.123221 (+277307us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.184015 (+ 60794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.222739 (+ 38724us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.326384 (+103645us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":393407,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":47,"raft.queue_time_us":24930,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"thread_start_us":491214,"threads_started":2,"wal-append.queue_time_us":589699}
I20260709 13:00:29.541759  3719 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:29.566799  3574 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.456426  3621 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:00:29.585260  1530 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.740s	user 0.005s	sys 0.003s
I20260709 13:00:29.611963  1530 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
W20260709 13:00:29.594367  2256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.046s	sys 0.115s
I20260709 13:00:29.549050  3636 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.650352  3587 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:29.668905  3587 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.670971  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 379) took 2867 ms. Trace:
I20260709 13:00:29.671545  2254 rpcz_store.cc:276] 0709 13:00:26.803243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.803476 (+   233us) service_pool.cc:224] Handling call
0709 13:00:27.231951 (+428475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.334765 (+102814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.670438 (+2335673us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54005c0b50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:29.670742 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684228480}
W20260709 13:00:29.664108  1574 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.025s (SENT)
I20260709 13:00:29.682310  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:29.683271  3621 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:29.684710  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57575.5us
I20260709 13:00:29.684090  1528 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:29.686655  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 302) took 2073 ms. Trace:
I20260709 13:00:29.686985  1528 rpcz_store.cc:276] 0709 13:00:27.613536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.623682 (+2010146us) service_pool.cc:224] Handling call
0709 13:00:29.683710 (+ 60028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.686362 (+  2652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.686594 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:29.476197  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 237786us
I20260709 13:00:29.663802  3629 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:29.651165  2256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.046s	sys 0.116s
I20260709 13:00:29.695111  3586 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.645498  1526 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:29.671628  3587 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.704945  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1599) took 1009 ms. Trace:
I20260709 13:00:29.705294  3714 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.706171  3714 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.707193  3142 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:29.707777  3142 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:29.708413  3719 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.719497  3718 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:29.720425  3718 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.721637  3544 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:29.722656  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 242) took 1638 ms (client timeout 2042 ms). Trace:
W20260709 13:00:29.723088  1682 rpcz_store.cc:269] 0709 13:00:28.075707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.078482 (+  2775us) service_pool.cc:224] Handling call
0709 13:00:28.148736 (+ 70254us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:29.696377 (+1547641us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400107cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:29.713730 (+ 17353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146108672}
I20260709 13:00:29.723877  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:29.724416  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:29.725930  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:29.727326  1527 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:29.728049  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1590) took 1786 ms. Trace:
I20260709 13:00:29.728438  3718 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.720618  3542 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.729141  3542 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:29.713019  3516 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.004s
I20260709 13:00:29.730931  3516 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.705363  1526 rpcz_store.cc:276] 0709 13:00:28.695682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.821046 (+125364us) service_pool.cc:224] Handling call
0709 13:00:29.704875 (+883829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.755425  3142 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.731976  3673 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:29.758215  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1641) took 3502 ms (client timeout 2025 ms). Trace:
I20260709 13:00:29.730456  3542 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.768270  1528 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:29.769428  3703 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.236s	user 0.016s	sys 0.027s
W20260709 13:00:29.769821  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.714272  3586 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.714543  3681 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.712468  3719 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.808604  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 293) took 3443 ms. Trace:
I20260709 13:00:29.789098  3142 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.814124  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 648) took 1610 ms. Trace:
I20260709 13:00:29.814677  2252 rpcz_store.cc:276] 0709 13:00:28.203824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.205679 (+  1855us) service_pool.cc:224] Handling call
0709 13:00:28.256513 (+ 50834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.450523 (+194010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.458815 (+  8292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.462733 (+  3918us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:28.467408 (+  4675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.813583 (+1346175us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54008002d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:29.813657 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.813920 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422911360}
W20260709 13:00:29.771425  1525 rpcz_store.cc:269] 0709 13:00:26.255376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.324566 (+ 69190us) service_pool.cc:224] Handling call
0709 13:00:29.757719 (+3433153us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54002cc754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:29.757961 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426375040}
I20260709 13:00:29.821925  1525 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:29.822661  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1595) took 1420 ms. Trace:
I20260709 13:00:29.822989  1525 rpcz_store.cc:276] 0709 13:00:28.402435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.821051 (+1418616us) service_pool.cc:224] Handling call
0709 13:00:29.821490 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.822318 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.822578 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.771318  3673 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:29.793619  3542 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.712224  3576 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.794656  3586 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.728454  1527 rpcz_store.cc:276] 0709 13:00:27.941778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.694337 (+1752559us) service_pool.cc:224] Handling call
0709 13:00:29.726876 (+ 32539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.727799 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.727992 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.764745  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:29.809562  1529 rpcz_store.cc:276] 0709 13:00:26.359150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.961194 (+1602044us) service_pool.cc:224] Handling call
0709 13:00:27.961523 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.036507 (+ 74984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.802287 (+1765780us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b540008d9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:29.802603 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144959872}
W20260709 13:00:29.834453  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.836289  3276 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:29.847591  3594 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:29.854400  3721 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:00:29.858289  3673 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:29.905473  3568 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:29.906661  3673 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.908587  3453 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.909205  3453 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.859491  3256 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.861465  3677 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.862279  3543 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:29.917686  1525 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:29.843163  1498 connection.cc:256] RPC call timeout handler was delayed by -1.4110857580000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:00:29.868450  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1577) took 3619 ms. Trace:
I20260709 13:00:29.871843  3710 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.872635  3578 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:29.900585  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 241) took 1825 ms (client timeout 1767 ms). Trace:
I20260709 13:00:29.869586  3705 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:29.901587  3276 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:29.871198  3698 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.344s	user 0.019s	sys 0.022s
I20260709 13:00:29.865173  3714 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:29.951568  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 323382us
I20260709 13:00:29.918840  1531 rpcz_store.cc:276] 0709 13:00:26.249940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.378920 (+1128980us) service_pool.cc:224] Handling call
0709 13:00:27.379321 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.379665 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.379695 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.380114 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.628150 (+248036us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:27.829332 (+201182us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.617280 (+787948us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800398da0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aac733 00007f7e63b31dbf 00007f7e63b3083e
0709 13:00:29.867692 (+1250412us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54001584a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aac733 00007f7e63b31dbf 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c
0709 13:00:29.867757 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.867911 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.867984 (+    73us) raft_consensus.cc:1685] finished
0709 13:00:29.867999 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.868219 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10802,"prepare.queue_time_us":395460,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":2016,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":7922,"spinlock_wait_cycles":71839872,"thread_start_us":364153,"threads_started":2,"wal-append.queue_time_us":403036,"wal-append.run_cpu_time_us":2807,"wal-append.run_wall_time_us":1404952}
I20260709 13:00:29.953958  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:29.955714  3276 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:29.957072  3578 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.957875  3617 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:29.923810  3705 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:29.959434  3705 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:29.960693  3705 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.967880  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1415) took 1948 ms. Trace:
I20260709 13:00:29.926139  3675 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.921445  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1664) took 1463 ms. Trace:
W20260709 13:00:29.948011  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.971280  1525 rpcz_store.cc:276] 0709 13:00:28.457671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.823792 (+1366121us) service_pool.cc:224] Handling call
0709 13:00:29.824251 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.918305 (+ 94054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.921366 (+  3061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.919960  3710 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:29.959918  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1591) took 1764 ms. Trace:
W20260709 13:00:29.920490  1680 rpcz_store.cc:269] 0709 13:00:28.075403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.078398 (+  2995us) service_pool.cc:224] Handling call
0709 13:00:29.900361 (+1821963us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:29.900509 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398964096}
I20260709 13:00:29.972884  1528 rpcz_store.cc:276] 0709 13:00:28.195103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.704699 (+1509596us) service_pool.cc:224] Handling call
0709 13:00:29.762225 (+ 57526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.776817 (+ 14592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.959691 (+182874us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54002cc750. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:29.959840 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131114368}
I20260709 13:00:29.893368  3464 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:29.980039  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 254422us
I20260709 13:00:29.985829  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:29.986717  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.028s
I20260709 13:00:29.986090  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 303) took 2372 ms. Trace:
I20260709 13:00:29.987942  1530 rpcz_store.cc:276] 0709 13:00:27.613839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.689707 (+2075868us) service_pool.cc:224] Handling call
0709 13:00:29.804178 (+114471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.985693 (+181515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.985729 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.985788 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.985824 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.985892 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.986030 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:29.988456  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.028s
W20260709 13:00:29.996358  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.002476  3464 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.003530  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.004168  1607 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:30.006371  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 248) took 1296 ms. Trace:
I20260709 13:00:29.952140  3594 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:29.968456  1678 rpcz_store.cc:276] 0709 13:00:28.018887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.020039 (+  1152us) service_pool.cc:224] Handling call
0709 13:00:28.020425 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.028529 (+  8104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.028559 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.038286 (+  9727us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.447713 (+409427us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:28.447758 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.447844 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.870110 (+1422266us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:29.967307 (+ 97197us) raft_consensus.cc:1685] finished
0709 13:00:29.967335 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.967679 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101413,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":7435,"spinlock_wait_cycles":6943872,"thread_start_us":307999,"threads_started":1,"wal-append.queue_time_us":377099}
I20260709 13:00:29.968850  3597 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:30.019873  3584 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.029747  3584 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.031394  3686 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:30.031459  1608 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:30.006806  1676 rpcz_store.cc:276] 0709 13:00:28.709699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.719762 (+ 10063us) service_pool.cc:224] Handling call
0709 13:00:28.720291 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:29.220690 (+500399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.220725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:29.325696 (+104971us) log.cc:844] Serialized 52 byte log entry
0709 13:00:29.515331 (+189635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.517863 (+  2532us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.518043 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.518125 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.004720 (+486595us) raft_consensus.cc:1685] finished
0709 13:00:30.004737 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.006300 (+  1563us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829,"prepare.queue_time_us":4922,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":497804,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":306,"thread_start_us":159752,"threads_started":1,"wal-append.queue_time_us":672130}
I20260709 13:00:29.996558  3276 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:29.995515  3617 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:30.006727  3543 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.006502  3714 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:29.994360  3677 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:30.037505  1529 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:30.205984  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1665) took 1747 ms. Trace:
I20260709 13:00:30.206353  1529 rpcz_store.cc:276] 0709 13:00:28.458220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.913820 (+1455600us) service_pool.cc:224] Handling call
0709 13:00:30.000364 (+ 86544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.205658 (+205294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.205922 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.023972  3256 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.207583  3256 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.170117  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:30.119410  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.010s	sys 0.018s
W20260709 13:00:30.037331  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57526.5us
W20260709 13:00:30.210143  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.024s	sys 0.018s
I20260709 13:00:30.141510  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.133347  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.026643  3471 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:30.213323  1574 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.019s
W20260709 13:00:30.200412  2227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.512s (SENT) [suppressed 23 similar messages]
W20260709 13:00:30.068917  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.024s
I20260709 13:00:30.031935  3686 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:30.070887  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1677) took 2496 ms. Trace:
W20260709 13:00:30.095356  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.014s	sys 0.021s
W20260709 13:00:30.095607  3589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.829s	user 0.023s	sys 0.034s
W20260709 13:00:30.215224  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.022s	sys 0.031s
W20260709 13:00:30.218019  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.065s	sys 0.068s
W20260709 13:00:30.247061  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.065s	sys 0.071s
I20260709 13:00:30.131374  3576 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.212255  1603 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:30.033645  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:30.204589  3485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.011s	sys 0.016s
I20260709 13:00:30.096704  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:30.176118  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.175562  1600 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:30.127573  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54371us
W20260709 13:00:30.214855  1574 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.017s	sys 0.020s
W20260709 13:00:30.268812  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 583395us
W20260709 13:00:30.069777  3722 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:30.068804  3393 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:30.284700  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:30.285808  2257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 385) took 1762 ms (client timeout 1953 ms). Trace:
W20260709 13:00:30.286253  2257 rpcz_store.cc:269] 0709 13:00:28.523137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.525997 (+  2860us) service_pool.cc:224] Handling call
0709 13:00:30.255653 (+1729656us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:30.285715 (+ 30062us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219897088}
I20260709 13:00:30.175175  3337 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.097412  3464 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.263315  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:30.246194  3589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.044s	user 0.025s	sys 0.042s
I20260709 13:00:30.150686  3584 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.178292  3578 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.096172  3574 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.204239  3610 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.247737  1605 rpcz_store.cc:276] 0709 13:00:27.574588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.603566 (+ 28978us) service_pool.cc:224] Handling call
0709 13:00:29.986878 (+2383312us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:30.033635 (+ 46757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.070279 (+ 36644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.070307 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.070401 (+    94us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.070457 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.070512 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.070676 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5596544}
I20260709 13:00:30.150753  3681 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:30.190274  3568 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.204507  3653 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:00:30.276301  1606 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:30.266355  3485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.012s	sys 0.016s
I20260709 13:00:30.166479  3276 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.071501  3594 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:30.246371  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.022s	sys 0.026s
W20260709 13:00:30.408015  3738 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:00:30.373503  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 298815us
I20260709 13:00:30.212891  3710 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.269003  3453 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.316520  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 651) took 1560 ms. Trace:
I20260709 13:00:30.249475  3731 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:30.426499  1609 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:30.305256  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:30.393194  3728 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:30.242560  3544 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.410235  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:30.413244  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.403880  3577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.327s	user 0.027s	sys 0.108s
I20260709 13:00:30.393491  3393 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.401093  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:30.412606  3586 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.013s
I20260709 13:00:30.121018  3617 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.419441  3537 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.427150  3729 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:30.427314  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.428081  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.427870  3568 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.428578  3681 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:30.429575  3653 consensus_queue.cc:1243] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:30.429991  3578 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.430266  3737 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:30.430821  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 245) took 1804 ms. Trace:
W20260709 13:00:30.433468  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.577983  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.434487  3276 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:30.440614  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.442523  3594 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:30.443190  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 432373us
I20260709 13:00:30.386740  3576 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.444273  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.444875  3686 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.413094  3471 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.451036  3610 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:30.421078  3182 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.008s
W20260709 13:00:30.453055  3542 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:00:30.452963  3256 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.592404  3686 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:30.458846  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.593484  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.459491  3689 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:30.485249  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.018s	sys 0.012s
I20260709 13:00:30.592952  2252 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 1 LEARNER]: Advancing to term 2
W20260709 13:00:30.595700  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.019s	sys 0.012s
I20260709 13:00:30.596594  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1582) took 3234 ms. Trace:
W20260709 13:00:30.489725  3577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.608s	user 0.028s	sys 0.109s
I20260709 13:00:30.480544  1602 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:30.512672  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.506403  3710 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.532578  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.535712  3568 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.536677  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.608696  1528 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:30.608970  2260 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:30.609126  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.537086  3262 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.610419  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.610824  1678 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:30.537578  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:30.538957  3597 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.539544  3537 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.540136  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.540766  3728 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.541466  3453 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.479329  3337 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.542659  1529 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:30.544292  3617 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.517961  3584 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:30.513163  3586 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.623876  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.624352  2253 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:30.626024  3586 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.626165  3537 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.627149  3613 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:30.627534  3539 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.549631  3729 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:30.550105  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 295312us
I20260709 13:00:30.550493  3393 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.551362  3544 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.552232  3631 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.552927  3671 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.554829  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 386) took 2957 ms. Trace:
I20260709 13:00:30.564524  3543 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.565836  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 383) took 2043 ms. Trace:
I20260709 13:00:30.567821  3717 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.568297  3705 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:30.570168  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:30.570091  3403 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.577195  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:30.642491  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72430.8us
I20260709 13:00:30.642416  1603 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.642769  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.643354  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:30.642865  3710 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.648902  3710 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.649344  3710 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.649690  3728 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.623904  1600 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:30.651858  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.652716  1682 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.653092  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.653991  1675 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.651922  3393 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:30.657714  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.658042  3653 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.635712  3597 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.658692  3653 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.660492  3542 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:30.610797  3262 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.660969  1607 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:30.661397  1607 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:30.661829  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.662256  1607 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.663218  1607 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.663256  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.652252  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.661173  3542 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.666752  3403 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:30.667825  3516 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:30.668493  3542 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:30.581772  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.549263  3735 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:00:30.577059  1679 rpcz_store.cc:276] 0709 13:00:28.626789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.698834 (+ 72045us) service_pool.cc:224] Handling call
0709 13:00:28.699411 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.700059 (+   648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.700097 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.723417 (+ 23320us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.988685 (+265268us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.173343 (+184658us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.338749 (+165406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.338816 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.430560 (+1091744us) raft_consensus.cc:1685] finished
0709 13:00:30.430597 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.430749 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251174,"prepare.queue_time_us":182492,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":92,"raft.queue_time_us":172900,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":16766,"thread_start_us":154617,"threads_started":1,"wal-append.queue_time_us":924474}
I20260709 13:00:30.584149  1606 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:30.584532  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.596941  1532 rpcz_store.cc:276] 0709 13:00:27.362112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.872573 (+1510461us) service_pool.cc:224] Handling call
0709 13:00:28.873086 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.880266 (+  7180us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:29.590515 (+710249us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.596212 (+1005697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.596272 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:30.596352 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.596412 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.596537 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1410,"thread_start_us":894367,"threads_started":1,"wal-append.queue_time_us":936953}
I20260709 13:00:30.592904  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.602046  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:30.613677  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1581) took 3436 ms. Trace:
I20260709 13:00:30.531705  3731 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.595180  3681 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:30.513664  3485 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.688620  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.689375  1676 raft_consensus.cc:2368] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4.
I20260709 13:00:30.653008  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.690806  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.618871  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1589) took 3016 ms. Trace:
I20260709 13:00:30.624596  1605 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:30.627681  3613 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.633291  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:30.634209  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.633388  2261 rpcz_store.cc:276] 0709 13:00:27.597572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.597721 (+   149us) service_pool.cc:224] Handling call
0709 13:00:27.598125 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.688855 (+1090730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.554522 (+1865667us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400660154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:30.554767 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497979264}
I20260709 13:00:30.635767  2258 rpcz_store.cc:276] 0709 13:00:28.522557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.522803 (+   246us) service_pool.cc:224] Handling call
0709 13:00:30.565529 (+2042726us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54007602d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:30.565685 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3396135168}
I20260709 13:00:30.638651  3584 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:30.597020  3578 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.648754  3717 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.669831  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:30.657151  1677 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:30.671145  1683 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:30.703321  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70096.2us
I20260709 13:00:30.642283  3544 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.706069  3393 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:30.672459  1603 raft_consensus.cc:2410] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:30.706720  3393 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:30.707595  3717 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:30.581028  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 256907us
I20260709 13:00:30.675015  1682 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:30.708091  3256 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.663993  3710 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.482925  2256 rpcz_store.cc:276] 0709 13:00:28.755713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.807331 (+ 51618us) service_pool.cc:224] Handling call
0709 13:00:28.807852 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.832968 (+ 25116us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:29.765829 (+932861us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.247221 (+481392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.249606 (+  2385us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.260131 (+ 10525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.266246 (+  6115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.308211 (+ 41965us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1182447,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":26354,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6906,"thread_start_us":1179909,"threads_started":2,"wal-append.queue_time_us":615773}
I20260709 13:00:30.677093  3653 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.708648  3256 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.678922  3610 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.655893  3576 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.641232  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:30.660979  3597 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.682986  1534 rpcz_store.cc:276] 0709 13:00:27.176869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.102725 (+1925856us) service_pool.cc:224] Handling call
0709 13:00:29.919182 (+816457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.997706 (+ 78524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.997735 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.024179 (+ 26444us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.423036 (+398857us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:30.612821 (+189785us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.613363 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.613436 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.613475 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:30.613487 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.613619 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54519,"prepare.queue_time_us":258077,"raft.queue_time_us":57175,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10704,"thread_start_us":420564,"threads_started":2,"wal-append.queue_time_us":472012}
I20260709 13:00:30.630122  3689 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:30.686509  2259 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:30.686522  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.687865  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.722522  3710 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.723081  2254 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:30.688019  3262 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.688727  3485 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.691068  1600 raft_consensus.cc:2410] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:30.610419  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.725338  1602 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:30.725039  3584 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.690349  1601 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:30.692341  1681 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:30.691386  1533 rpcz_store.cc:276] 0709 13:00:27.602838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.479758 (+1876920us) service_pool.cc:224] Handling call
0709 13:00:29.480190 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.545159 (+ 64969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.545190 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.545717 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.212148 (+666431us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.212188 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.212255 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.618703 (+406448us) raft_consensus.cc:1685] finished
0709 13:00:30.618723 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.618824 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11926,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":665974,"threads_started":1,"wal-append.queue_time_us":681496}
I20260709 13:00:30.698091  1675 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:30.642966  3729 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.655963  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.705062  1678 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:30.707855  3393 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.707703  1603 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:30.728057  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.711656  1609 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:30.714030  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 78278.5us
W20260709 13:00:30.634739  3673 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.017s
I20260709 13:00:30.720269  1679 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:30.709311  3653 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.721149  3598 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.721638  3689 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.734786  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.733605  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.728484  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.639623  3543 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.735460  3403 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:30.744005  1677 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:30.744580  2258 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:30.744695  1674 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:30.726815  3337 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.745774  3576 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.745787  3403 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:30.746345  3576 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.746734  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:30.704525  3705 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.750293  3705 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.734141  1605 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:30.753288  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:30.754398  3598 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.733088  1601 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:30.735468  3653 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.757012  1601 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.758126  1601 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.758883  3653 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.759749  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:30.708093  3245 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.760793  3245 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.761567  3403 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.761977  3403 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:30.762341  3403 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.719611  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:30.763917  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:30.762930  3245 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.771091  1609 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:30.770998  2261 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:30.744215  3689 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.770990  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.773116  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:30.726413  3485 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.769677  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.743856  3613 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:30.775218  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.770040  3598 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:30.779824  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69544.5us
I20260709 13:00:30.785144  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:30.787211  3730 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:00:30.785087  3575 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:30.788327  3337 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.789100  3727 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:30.789248  3337 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.790397  3537 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.790884  3537 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:30.791282  3537 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.788228  3575 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.792412  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.794034  3575 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:30.794256  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 127367us
I20260709 13:00:30.795164  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.795463  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1666) took 2337 ms. Trace:
I20260709 13:00:30.778098  3729 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:30.797498  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.789724  3727 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:30.795903  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:30.796762  3543 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:30.804998  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.809661  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.809986  3727 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.810629  1600 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:30.783022  3245 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.811976  3245 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.812517  3245 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.797431  3729 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.816437  3731 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:30.816787  3729 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.811561  3727 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.818773  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.819700  1675 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:30.820343  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57501.7us
I20260709 13:00:30.836200  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.837618  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.809945  1602 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:30.842093  1607 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:30.836200  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:30.850270  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54362.6us
I20260709 13:00:30.822121  3692 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.827345  3689 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.855381  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.856628  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.858419  1675 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:30.826121  3575 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:30.858345  1533 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:00:30.868014  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:30.853845  3598 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.877323  1532 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:30.880489  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.883720  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.884337  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.887552  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.888032  1528 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:00:30.888664  3685 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:30.889588  3685 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:30.889954  3685 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:30.891157  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.891026  3685 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.893198  2259 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:00:30.896579  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.877729  3692 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.872327  3673 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:30.874053  3393 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.899804  3393 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.900182  3393 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:30.900421  3720 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.423s	user 0.003s	sys 0.003s
W20260709 13:00:30.902683  3753 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:30.903417  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.903900  3616 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:30.904373  3616 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:30.905259  3616 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:30.906343  3616 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.908128  2258 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:30.912284  3598 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.912854  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.914024  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.914585  2261 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:30.915792  3598 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:30.872133  3337 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:30.917575  1678 raft_consensus.cc:2410] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:30.922303  3403 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.925181  1532 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:30.925834  1526 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:30.897282  2256 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:30.929621  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.930171  1601 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:30.916042  3640 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.933089  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.932843  3640 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.934264  2261 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:30.930517  1601 pending_rounds.cc:85] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
W20260709 13:00:30.935853  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51093.9us
I20260709 13:00:30.934335  1682 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:30.947223  3692 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:30.948550  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69629.1us
I20260709 13:00:30.958354  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.959339  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.944234  1601 pending_rounds.cc:107] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:30.959620  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.961606  1601 raft_consensus.cc:2889] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.962044  1601 pending_rounds.cc:107] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:30.962114  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:30.929685  3685 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.960004  1606 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:30.956921  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.965956  1526 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:30.966063  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.963147  1601 raft_consensus.cc:2889] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.957360  2257 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:30.969372  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.970259  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.971145  1681 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:30.972147  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.973531  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.974560  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.975831  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.976759  1683 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:30.977363  3537 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.978052  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.979912  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.977568  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:30.981312  1683 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.980612  1602 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:30.980779  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:30.984392  1682 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:30.984786  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:30.967840  3403 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:30.989745  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.989880  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:30.990316  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.992266  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.992784  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.993556  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:30.878746  3575 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:30.995456  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.999188  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:30.993505  1532 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
W20260709 13:00:31.000419  3718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:31.001565  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.002210  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 274) took 3423 ms. Trace:
I20260709 13:00:31.001008  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:30.998473  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.002599  1601 rpcz_store.cc:276] 0709 13:00:27.571650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.571763 (+   113us) service_pool.cc:224] Handling call
0709 13:00:30.282549 (+2710786us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:30.453492 (+170943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.690136 (+236644us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540017bc20. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:00:30.994747 (+304611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.994960 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307872384}
I20260709 13:00:30.979786  3537 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:31.009196  1574 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.235s (SENT)
I20260709 13:00:30.795858  1527 rpcz_store.cc:276] 0709 13:00:28.458894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.921027 (+1462133us) service_pool.cc:224] Handling call
0709 13:00:30.027100 (+106073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.149721 (+122621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.167451 (+ 17730us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.268399 (+100948us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.615419 (+347020us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:30.617099 (+  1680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.620676 (+  3577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.795212 (+174536us) raft_consensus.cc:1685] finished
0709 13:00:30.795239 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.795400 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15687,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":18787,"thread_start_us":147661,"threads_started":1,"wal-append.queue_time_us":261762}
I20260709 13:00:31.015537  1681 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:30.998119  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.000995  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 649) took 2796 ms. Trace:
I20260709 13:00:31.011577  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.029371  2255 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:31.030311  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.030967  2255 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:31.031901  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:31.049238  3687 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:00:31.025326  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.052189  1604 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:31.053231  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.054023  1604 raft_consensus.cc:2410] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:31.054726  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.055835  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.025820  1608 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:31.057257  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.058264  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.058678  1683 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:31.059634  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.035501  3256 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.061431  3731 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:31.028023  2253 rpcz_store.cc:276] 0709 13:00:28.204201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.205418 (+  1217us) service_pool.cc:224] Handling call
0709 13:00:30.566736 (+2361318us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:30.567029 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.624788 (+ 57759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.000747 (+375959us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b54004eaa54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:31.000935 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192197888}
I20260709 13:00:31.004453  3245 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.065780  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.066385  3245 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.066795  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.067267  1603 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.067402  1609 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:31.067844  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.068670  3545 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.069324  3545 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.069947  3578 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.028738  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.070937  1605 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:31.072559  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.037424  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.040279  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.049307  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.024583  3692 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:31.058904  1608 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.074209  3692 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:31.074633  3692 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:31.075839  3516 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.042876  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.076231  3516 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.043030  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.077172  1680 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:31.043514  3543 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.078365  3543 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:31.078698  3543 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:31.079598  3543 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.083132  3543 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.044216  3337 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.044749  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.044894  3690 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:31.045944  3764 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:00:31.018957  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.046909  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.047735  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.048507  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.048715  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.069902  3545 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.069557  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.106061  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.073573  1526 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:31.106433  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.076661  3516 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.119797  1679 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.121133  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.122244  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:31.123459  1498 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87db66ba9ff145009d8e513e5d0ef1e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:31.124706  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.044162  3576 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:31.125015  3584 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:31.068235  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.125852  3537 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:31.036677  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.081705  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.076619  1677 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:31.126228  3537 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:31.127630  3537 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.129297  3537 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.106204  3393 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.085917  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.133432  1528 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:31.133752  1533 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:30.967343  3757 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:00:31.091249  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.146346  1680 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:31.133136  1531 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.130192  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:31.153044  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.104790  1682 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:31.106505  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.162058  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.107965  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.108215  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:31.107980  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.108492  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.163352  1607 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:31.109102  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60679us
I20260709 13:00:31.109299  1605 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:31.164062  1605 pending_rounds.cc:85] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 2
I20260709 13:00:31.162424  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:31.109797  3568 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.114039  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.114578  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:31.114748  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 108357us
I20260709 13:00:31.115770  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.116812  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.117288  1674 raft_consensus.cc:2410] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:31.117848  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.118964  3729 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.119614  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.035440  3575 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.075562  3692 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.106091  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.126179  1609 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:31.106616  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.140724  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.144646  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:31.190230  1677 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:31.100042  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.155052  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.156407  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:31.158269  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.125703  3617 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.164364  1605 pending_rounds.cc:107] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:31.191206  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.164795  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.167307  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.191696  1605 raft_consensus.cc:2889] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:31.171209  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.192199  1526 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:31.172716  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.157465  3616 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:31.177784  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.178073  2259 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:31.195386  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 95484.9us
I20260709 13:00:31.157194  3696 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:31.182338  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.190461  1683 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:31.196342  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.113713  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:31.176273  3757 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:31.168920  3256 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.175132  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:31.126163  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:31.196898  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.199921  1531 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.194973  1676 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:31.165072  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.200743  1682 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.201119  1529 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:31.178876  3568 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:31.205318  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:31.205543  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.182574  2252 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:31.207607  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.205816  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.208580  1529 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.206164  1683 raft_consensus.cc:2376] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5. Re-sending same reply.
W20260709 13:00:31.209172  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50988.1us
I20260709 13:00:31.207863  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.209733  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.189467  2254 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:31.211706  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.212378  1531 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 2.
I20260709 13:00:31.212929  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.213469  1605 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
W20260709 13:00:31.221822  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66986.9us
I20260709 13:00:31.222692  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.197299  3616 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.225912  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.226563  1683 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:31.198701  3757 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.223169  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.215948  1677 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:31.222620  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.202102  3576 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.224769  1609 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.221392  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.198367  3584 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.223220  1608 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.204769  3256 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:31.201853  3544 consensus_queue.cc:1175] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 13:00:31.228204  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.204784  3594 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.229336  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.230439  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.231338  2257 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:31.207320  1602 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:31.214625  3403 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.235572  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.221087  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.203135  3696 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.238508  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.239131  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.253553  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:31.254014  1529 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.243713  1682 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:31.244364  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.207011  3485 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:31.245247  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.258986  1682 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:31.259433  2258 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.237071  3616 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.261197  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.240113  3757 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.248193  1534 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:31.216814  3692 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.249142  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.250208  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.269385  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.241254  3576 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:31.257031  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.251493  2252 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.259186  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.207125  3756 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.246384  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.244488  3631 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.264689  3731 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:00:31.276806  3594 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.278177  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.278792  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.279228  3256 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.260030  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.250109  3686 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:31.267508  3717 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:31.275372  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:31.263865  3767 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:31.266041  1525 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:31.280642  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.281483  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.282155  1609 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:31.282347  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.282656  3729 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:31.275647  3766 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:00:31.283720  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.269583  3568 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.277047  3756 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.285640  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.274169  3576 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.287566  3756 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.273850  3543 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.205026  3575 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:00:31.289980  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.293633  3696 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.264712  1674 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:31.285005  3686 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.295615  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.280709  1528 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:31.296948  3686 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.297220  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.298802  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.299947  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.300526  1609 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.300856  1527 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:31.301435  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.302166  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.302577  1609 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:31.303035  3403 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.303500  3403 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.256151  1607 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:31.303753  3616 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.304638  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.305029  1607 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.305243  1527 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:31.305802  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.306056  3616 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.302008  1606 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:31.306500  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.306844  1606 pending_rounds.cc:85] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 2
I20260709 13:00:31.307102  1606 pending_rounds.cc:107] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:31.307394  1606 raft_consensus.cc:2889] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.307694  1527 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:31.271433  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.309121  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.311766  1607 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:31.272989  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.274371  1603 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.274554  1681 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:31.275595  1605 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.262420  3485 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.275556  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:31.276562  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.260483  3653 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:31.280440  3717 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:31.287084  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.303856  3403 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.307019  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.272025  1676 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:31.313781  3696 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.270186  1677 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:31.245357  3545 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:31.314196  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.314481  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:31.295689  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.344422  1528 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.292125  1529 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:31.302523  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.346100  1527 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:00:31.347532  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.304015  1609 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:31.210808  3689 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:00:31.323906  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50986.4us
W20260709 13:00:31.310410  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 299) took 12063 ms (client timeout 15000 ms). Trace:
I20260709 13:00:31.319648  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.334837  1607 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:31.354481  1607 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:31.350457  3774 ts_tablet_manager.cc:933] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:31.352917  1678 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:31.358355  1534 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:31.358902  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.363189  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.334262  3485 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.338464  3717 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:31.364118  3616 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.420950  3616 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:31.422031  3616 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.424465  3777 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.363332  3757 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.364988  1529 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:00:31.425482  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62365.6us
I20260709 13:00:31.341230  3653 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.364274  1607 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.430913  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:31.394460  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 98829.6us
I20260709 13:00:31.359990  3516 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.392750  1532 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:31.391908  1531 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:31.343142  3696 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.338260  3575 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.437222  1607 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.436602  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.432552  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.417464  1528 raft_consensus.cc:2410] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:31.434796  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.352454  3545 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.440713  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.436586  1608 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:31.445858  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.391453  3276 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.353060  1600 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:31.366271  3673 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.433743  3568 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.454867  3545 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.455387  3545 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.456985  3770 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 13:00:31.448127  3777 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.458982  3777 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:31.459338  3777 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:31.459894  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 353861us
I20260709 13:00:31.462705  3516 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.463462  3256 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.463943  3256 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:31.464370  3256 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.438367  3696 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.474251  1526 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.481848  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.455739  3545 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.484943  1605 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.445214  3543 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.493927  3543 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.483249  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:31.495049  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54439.5us
I20260709 13:00:31.455824  3576 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.495858  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.498703  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.450210  3686 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.495740  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.500599  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.474469  3729 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.503021  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.476653  3568 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.504580  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.508594  1530 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:31.490034  3578 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.517027  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.498610  3543 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.496488  3673 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:31.574412  3673 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.514858  3678 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:31.576614  3774 tablet_copy_client.cc:323] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:00:31.501272  3276 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:31.566073  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.503104  3686 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.353922  1432 rpcz_store.cc:269] 0709 13:00:19.308460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.308857 (+   397us) service_pool.cc:224] Handling call
0709 13:00:31.310144 (+12001287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:26.138831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:26.157816 (+ 18985us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:26.157863 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:00:26.157879 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:26.163228 (+  5349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:26.163300 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:26.163332 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:26.164411 (+  1079us) tablet.cc:701] Row locks acquired
0709 13:00:26.164429 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:26.164579 (+   150us) write_op.cc:270] Start()
0709 13:00:26.164694 (+   115us) write_op.cc:276] Timestamp: P: 1783602026164531 usec, L: 0
0709 13:00:26.164714 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:26.165534 (+   820us) log.cc:844] Serialized 5968 byte log entry
0709 13:00:26.571234 (+405700us) op_driver.cc:464] REPLICATION: finished
0709 13:00:26.810671 (+239437us) write_op.cc:301] APPLY: starting
0709 13:00:26.810756 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:26.811043 (+   287us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:26.818745 (+  7702us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:26.823647 (+  4902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:26.823904 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:00:26.823951 (+    47us) write_op.cc:312] APPLY: finished
0709 13:00:26.824292 (+   341us) log.cc:844] Serialized 107 byte log entry
0709 13:00:26.887198 (+ 62906us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:26.919556 (+ 32358us) write_op.cc:454] Released schema lock
0709 13:00:26.946745 (+ 27189us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:26.978272 (+ 31527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:27.000701 (+ 22429us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4467,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":239191,"apply.run_cpu_time_us":4490,"apply.run_wall_time_us":158508,"num_ops":15,"prepare.queue_time_us":348930,"prepare.run_cpu_time_us":22036,"prepare.run_wall_time_us":124785,"raft.queue_time_us":267940,"raft.run_cpu_time_us":33884,"raft.run_wall_time_us":108243,"replication_time_us":406359,"spinlock_wait_cycles":31488,"thread_start_us":634779,"threads_started":4,"wal-append.queue_time_us":121674,"wal-append.run_cpu_time_us":41494,"wal-append.run_wall_time_us":1731231}]]}
I20260709 13:00:31.515198  3337 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.501101  3757 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.517951  3539 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.494011  3717 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.579751  1530 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:31.511549  3516 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.507534  3594 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:00:31.490303  3584 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:00:31.512010  3537 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.507992  3690 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:31.513299  3568 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.592792  1607 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:31.586421  3729 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:31.606190  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.590468  3686 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.589457  3337 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.604987  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 106371us
I20260709 13:00:31.611640  1607 pending_rounds.cc:85] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
I20260709 13:00:31.585924  3276 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:31.614115  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.589058  3731 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:00:31.617688  1607 pending_rounds.cc:107] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:31.621516  1607 raft_consensus.cc:2889] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.593971  3578 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:31.618134  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.599418  3516 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:31.623442  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:31.624024  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.620563  3631 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:00:31.625046  3775 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:31.611765  3690 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.639804  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.622433  3337 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.631425  3516 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.644876  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.653965  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:31.645923  3779 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:00:31.639370  3690 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.623221  3276 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.663041  3729 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.663527  3729 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:31.663938  3729 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.631922  3717 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.664382  3617 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.666777  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.667662  3756 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.668054  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.669232  3653 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.669472  3710 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.670022  3710 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:31.670444  3710 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.675130  3730 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:31.631614  3578 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:31.676276  3730 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:31.677138  3578 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.677567  3262 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:31.662041  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.678331  3262 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:31.634718  3537 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:31.695570  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.696954  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:31.698438  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 181480us
I20260709 13:00:31.699380  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:31.660426  3757 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.661382  3678 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:31.714329  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.623308  3782 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:00:31.708071  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.708241  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.668072  3756 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:31.695437  3617 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:31.708659  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 192460us
I20260709 13:00:31.725571  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.726845  3791 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.727535  3791 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:31.728714  3791 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.729647  3616 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.732077  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:31.701712  3539 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.702459  3598 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:31.696019  3545 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:31.750777  3763 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.766s	user 0.000s	sys 0.005s
I20260709 13:00:31.752465  3545 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:31.747490  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.669250  3256 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.758257  3485 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.758839  3256 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.715312  3678 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:31.760938  3678 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.762113  3678 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.772588  3576 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:31.792675  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45253us
I20260709 13:00:31.793625  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.795025  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.723809  3756 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.799769  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.808645  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76642.1us
I20260709 13:00:31.810518  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:31.811429  1606 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:31.737351  3731 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.725495  3640 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.816690  1606 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:31.811928  3598 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:31.731920  3777 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.825284  3598 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.826476  3777 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:31.827117  3777 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.827232  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.827509  3777 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.827896  3777 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.828555  3545 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:31.829561  3789 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.830098  3789 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.830449  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.831485  3681 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.813010  3485 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.830487  3789 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.837277  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:31.839772  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.840555  1600 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.842464  3784 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:00:31.840553  3681 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:31.797215  3575 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.853749  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:31.854622  1608 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:31.850551  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.816787  3731 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.828693  3576 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.869231  1608 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:31.869876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:31.874866  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:31.876638  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.876648  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.877357  3797 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.878230  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.878034  3797 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.879006  1529 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:31.880460  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.880558  3797 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.877444  1526 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:31.881114  1529 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:31.882522  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.884138  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.884944  1529 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:31.851274  3782 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:31.887768  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:31.889540  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 175314us
I20260709 13:00:31.739483  3262 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.856195  3575 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.871934  3731 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.906447  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.907891  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:31.908826  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.891546  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:31.885762  1679 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.909484  1531 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.891510  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:31.848766  3729 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:31.915161  3729 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:31.891489  3782 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.916718  1525 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:31.873198  3576 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:31.909427  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:31.924628  1527 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:31.866441  3276 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:31.916203  3782 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.905486  3575 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:31.939393  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48944.3us
W20260709 13:00:31.926920  3692 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.004s
I20260709 13:00:31.889627  3681 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:31.922950  3576 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.970595  3276 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:31.974700  1534 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.931449  3262 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.993850  1531 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:31.916528  3797 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:31.915521  3805 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:00:31.938957  3245 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:31.941373  3757 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.013439  3594 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.001214  3403 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.650s	user 0.004s	sys 0.008s
I20260709 13:00:31.990010  3692 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:31.983925  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.030282  3594 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:32.037864  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 180139us
W20260709 13:00:32.045634  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.030144  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 122321us
W20260709 13:00:32.040899  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61165.7us
I20260709 13:00:32.046772  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:32.047734  1528 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:32.047856  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:32.048694  1609 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:32.053090  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.026774  3805 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.996897  3545 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:00:32.050484  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:32.060029  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:32.060776  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 200545us
I20260709 13:00:32.037415  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.069120  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:32.069026  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.016836  3690 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.051173  3717 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.067685  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:32.044227  3594 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:32.065697  3696 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.002s
I20260709 13:00:32.079591  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.029138  3245 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.084983  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:32.085321  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:32.040376  3403 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.069299  3640 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.049968  3686 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.101122  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.100525  3808 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:32.103628  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:32.108942  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58570.4us
I20260709 13:00:32.045711  3789 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.056541  3543 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.103223   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:32.088405  3586 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.111857  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.111986  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.166150  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:32.166982  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55106.7us
I20260709 13:00:32.091248  3790 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.071801  3616 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:32.114785  3705 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.115864  1525 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:32.117705  3686 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.175539  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:32.118111  3795 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.180559  3795 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.181028  3795 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.175319  3537 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.185124  3705 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.185375  1430 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.118898  3757 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.099928  3568 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.109550  3808 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:32.122419  3393 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.122844  3403 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.096513  3687 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.107729  3710 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.129134  3731 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.131337  3777 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.082680  3729 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:32.132637  2254 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:32.101404  3516 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.173017  1600 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:32.137079  3718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:32.140837  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:32.146561  2259 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.147581  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.190042  3791 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:32.170540  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:32.172362  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60553.4us
I20260709 13:00:32.178725  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.179689  3245 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.188392  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.098439  3717 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.187381  3685 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:32.215438  1680 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:32.171175  3616 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:32.175390  3809 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:32.248760  1682 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:32.248462  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77970us
I20260709 13:00:32.221300  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:32.102914  3696 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.192967  3594 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:00:32.253654  3696 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.254274  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.255010  1674 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:32.255137  3543 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.256399  3539 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.256904  3777 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.136097  1601 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:32.175894  3673 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.234779  1607 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:32.259495  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 120105us
I20260709 13:00:32.260922  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.263482  3516 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.077483  3276 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.264300  3544 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.264900  3544 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.266258  3789 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.267020  3544 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.248262  2252 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.268182  3717 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.268640  3718 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.237401  3812 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:32.269758  3812 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.270479  3537 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:32.270906  3568 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.271899  3812 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.271739  3276 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.273149  3808 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.274116  3731 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.274482  3808 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.277659  3690 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.278203  3710 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.279297  3795 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.280239  1608 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.231329  3729 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.282109  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.282766  3705 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.285362  3575 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.287604  3575 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.255970  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.289288  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:32.290117  3337 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
W20260709 13:00:32.290350  3768 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:32.290547  3337 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.291988  3613 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:32.245704  3403 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.211922  1430 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 4 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:32.293355  3816 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:00:32.187330  3734 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:32.212435  3586 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:32.294936  3734 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:32.295415  3734 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.295584  3586 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.292615  3613 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:32.195417  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.282799  1680 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:32.281972  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.237629  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.292552  1679 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:32.238586  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:32.239885  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51637.4us
I20260709 13:00:32.293828  1430 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 2, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.299916  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.240831  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.190011  3757 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.300998  1683 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:32.238008  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.301472  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.216341  3687 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:32.246753  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:32.229784  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.247859  3616 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.290005  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.216820  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.241986  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:32.309471  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46790.6us
I20260709 13:00:32.309226  1676 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:32.310521  1677 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:32.311307  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.309626  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:32.300904  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 79668.5us
W20260709 13:00:32.311915  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62053.3us
W20260709 13:00:32.314077  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67416us
I20260709 13:00:32.314446  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.315398  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.316185  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:32.316530  3696 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.317052  1601 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:32.316808  3537 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.318691  1680 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:32.248535  3791 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.320389  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.324505  1681 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.320943  3617 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.292492  3727 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:32.330747  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.321555  1430 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 5, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.322446  3791 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.309165  3757 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.285980  3576 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.274060  3276 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.366087  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.325121  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.335021  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.336529  3813 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.337172  3575 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.338521  3673 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.339753  3393 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:32.340178  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:32.313342  3543 raft_consensus.cc:2764] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:32.340435  3685 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:32.400840  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 110473us
I20260709 13:00:32.344264  3829 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:32.348829  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.314087  1607 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:32.320811  3796 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:32.324136  3821 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:32.360780  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.369903  3801 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:32.405908  1677 raft_consensus.cc:2376] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3. Re-sending same reply.
I20260709 13:00:32.406028  3801 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.371857  3786 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.372927  3256 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.314157  3687 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.371455  1430 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:32.377288  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44031.2us
I20260709 13:00:32.331403  2256 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.324795  3777 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:00:32.341544  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:32.352986  3710 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:32.409271  3786 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.422051  1674 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:32.400283  3790 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:00:32.420701  3756 consensus_meta.cc:287] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.006s
I20260709 13:00:32.400058  3617 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:32.432472  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90979.7us
I20260709 13:00:32.454264  1604 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:32.423233  3689 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.460214  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 111449us
W20260709 13:00:32.455057  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50815us
W20260709 13:00:32.460752  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94702.4us
I20260709 13:00:32.428548  1430 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.467474  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:32.460214  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 135166us
I20260709 13:00:32.468721  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:32.460822  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 120712us
I20260709 13:00:32.463305  1675 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.472889  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.474095  2253 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:32.429302  3815 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:32.427837  3710 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:32.466549  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:32.449360  3631 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:32.555043  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70019.8us
I20260709 13:00:32.555639  1683 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 13:00:32.556154  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:32.505951  1605 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
W20260709 13:00:32.556772  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71242.2us
I20260709 13:00:32.490238  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.486555  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.553114  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.561738  1678 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:32.456445  3245 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:32.567998  3816 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:00:32.477185  3545 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.569067  3545 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:32.570524  3782 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.005s
I20260709 13:00:32.453950  3575 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.572165  3575 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:32.572968  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 96531.3us
I20260709 13:00:32.407960  3613 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.573294  3575 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.554208  3705 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:32.482959  3815 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:32.592919  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.573987  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.457440  3617 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:32.601339  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.563337  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.565645  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.602226  1608 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:32.484081  3731 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.585371  1606 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.484392  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.480301  3796 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.456393  3276 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.464102  3790 consensus_queue.cc:1243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:32.596889  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:32.615154  1607 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:32.586090  1680 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:32.582904  3797 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.480990  3777 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.481550  3791 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:00:32.584780  1681 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:32.612617  1677 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:32.611984  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.457139  3756 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.554190  3337 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.600116  1430 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:00:32.597939  3393 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.616568  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:32.618491  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.619386  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.630605  1607 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:32.483994  3689 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.565441  3710 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.571123  3782 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.626062  1605 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:00:32.626261  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60664.3us
I20260709 13:00:32.641515  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.643502  1607 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:32.613224  3256 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.641747  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.642210  1430 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.640810  1674 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:32.670825  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 204349us
I20260709 13:00:32.668673  1574 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:32.663894  1677 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:32.671626  1574 leader_election.cc:403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.630048  3727 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:32.664902  1609 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.674387  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:32.678802  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.679557  1531 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:32.677507  1430 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.618530  3276 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.653903  3797 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:32.705705  1530 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:32.711266  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.712139  1683 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:32.644523  3393 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.716341  3727 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:32.719326  1543 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 87db66ba9ff145009d8e513e5d0ef1e4 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:00:32.719445  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:32.716341  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.682458  3576 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.453950  3584 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:32.725072  3403 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.734104  3727 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.735564  1543 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 87db66ba9ff145009d8e513e5d0ef1e4 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-87db66ba9ff145009d8e513e5d0ef1e4
I20260709 13:00:32.736511  3689 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:32.720184  3705 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:32.740852  3826 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:00:32.745124  3756 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.714066  3796 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.746093  3796 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.748741  3786 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.748543  1430 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:32.729996  3815 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.750499  3815 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.750295  1430 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.751914  3797 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.752745  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:32.753794  2261 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:32.754030  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.754848  1674 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:32.725400  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46665.7us
I20260709 13:00:32.726153  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:32.758065  1683 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.683928  3801 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.684865  3717 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:32.761372  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.730414  1527 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:32.763100  3276 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.759704  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:32.761400  3705 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:32.760056  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01534d11942740ccb67a981fcde65180"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:32.766863  3734 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.768224  2260 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:32.769222  3687 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.675686  3617 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.758471  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.720443  3729 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:32.785660  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:32.786288  1430 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.792965  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.796929  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:32.778957  2252 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.510s	user 0.016s	sys 0.000s
I20260709 13:00:32.795809  1430 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.817226  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.796514  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:32.739988  3616 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:32.820187  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:32.838148  1607 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.766803  1674 raft_consensus.cc:606] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:32.820242  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:32.839138  1604 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 2.
I20260709 13:00:32.779480  3796 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:32.695015  3730 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:32.783957  3777 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:32.845813  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49375.6us
I20260709 13:00:32.848843  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.815908  3256 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.819566  2252 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:32.819566  3808 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.006s
I20260709 13:00:32.858443  1608 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.816255  3798 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.845036  3617 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.833391  1430 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:32.879422  1430 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 2 to 3, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.877702  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:32.804838  3576 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:32.994344  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:33.086592  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 237869us
I20260709 13:00:33.087527  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:32.889430  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 434457us
I20260709 13:00:32.929762  2261 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:33.064685  3840 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:33.096300  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:32.850488  3786 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.856760  3796 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.089485  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 622064us
I20260709 13:00:32.851164  3705 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.897255  1683 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:32.925086  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1453) took 1078 ms. Trace:
I20260709 13:00:32.858623  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.098788  1499 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:33.104655  1499 leader_election.cc:403] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.100660  1682 rpcz_store.cc:276] 0709 13:00:31.847057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.848086 (+  1029us) service_pool.cc:224] Handling call
0709 13:00:31.867094 (+ 19008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.249082 (+381988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.924770 (+675688us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b540031bad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:32.925008 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877331328}
W20260709 13:00:33.092959  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.106914  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 112670us
I20260709 13:00:32.874555  3696 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:33.097267  2256 consensus_meta.cc:287] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.000s
I20260709 13:00:33.109161  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.110169  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.112793  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:32.927284  3717 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.114207  1525 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:33.094477  3805 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.963907  3687 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.116835  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.114208  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.119597  1525 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:33.115125  3839 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.104857  3798 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.123121  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:32.856509  3730 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:32.990054  3616 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.109416  3631 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.103977  3756 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.120471  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.134052  1525 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.124995  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.125165  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:33.115168  3837 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:00:33.134817  1530 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.113306  2255 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.110248  3734 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.130331  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.130366  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.132134  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.138700  1532 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:33.135921  1533 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.150669  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.116603  2256 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:33.087131  3777 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.205303  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 670) took 1051 ms. Trace:
I20260709 13:00:33.132550  3729 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:33.123407  3805 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.125488  3798 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.121140  3594 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:00:33.122756  3786 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:00:33.232580  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.153985  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:33.233789  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 103405us
I20260709 13:00:33.187928  1674 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:33.186981  3276 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:33.216243  3827 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:00:33.154975  3756 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:33.310403  3805 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:33.310083  3756 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.291190  3845 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.311352  3844 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:00:33.311518  3845 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:33.187952  3705 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:33.243412  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.103677  3796 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.313437  3705 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:33.136816  3832 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 13:00:33.227275  3710 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.005s
I20260709 13:00:33.152220  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.214849  3631 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.248289  1533 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:33.257877  3729 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:33.249079  3757 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.848s	user 0.013s	sys 0.007s
I20260709 13:00:33.293129  1530 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:33.299521  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1624) took 1411 ms. Trace:
I20260709 13:00:33.237963  3692 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.334390  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.268957  3798 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.315299  1609 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:33.339790  1526 rpcz_store.cc:276] 0709 13:00:31.888163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.888420 (+   257us) service_pool.cc:224] Handling call
0709 13:00:31.891028 (+  2608us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:31.916727 (+ 25699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.916759 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:31.928420 (+ 11661us) log.cc:844] Serialized 78 byte log entry
0709 13:00:32.186467 (+258047us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b18003cf400. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:32.420799 (+234332us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.463659 (+ 42860us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.777793 (+314134us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003cf400. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:00:33.119624 (+341831us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.299131 (+179507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.299222 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.299273 (+    51us) raft_consensus.cc:1685] finished
0709 13:00:33.299284 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.299452 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66656,"prepare.queue_time_us":45938,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":5568,"raft.queue_time_us":569608,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":30776,"spinlock_wait_cycles":93034240,"thread_start_us":718826,"threads_started":3,"wal-append.queue_time_us":627007}
I20260709 13:00:33.253779  2256 rpcz_store.cc:276] 0709 13:00:32.145705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.169438 (+ 23733us) service_pool.cc:224] Handling call
0709 13:00:33.196641 (+1027203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.356271  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.360925  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.339141  3729 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.315284  3804 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:33.315054  3796 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.391614  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.355019  3692 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.343241  3867 raft_consensus.cc:2764] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:33.343358  3276 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:33.355821  3790 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.402091  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.402835  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.339594  3687 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:33.396755  3838 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:00:33.408658  1534 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:33.406997  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.416584  1526 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.344425  3631 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.350809  3757 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.397441  3804 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:33.424149  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1731) took 1125 ms. Trace:
I20260709 13:00:33.424485  1532 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:33.424853  3845 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.425271  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.427299  3757 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.428402  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.429203  1674 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:33.418574  3687 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.433422  3687 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.433197  3847 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:33.435220  3847 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.435702  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.436506  1534 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:33.437543  3846 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:33.343998  3710 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:33.442368  1600 rpcz_store.cc:276] 0709 13:00:32.298523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.308659 (+ 10136us) service_pool.cc:224] Handling call
0709 13:00:32.379446 (+ 70787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.430016 (+ 50570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.433276 (+  3260us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.613739 (+180463us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.798643 (+184904us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:32.798706 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.798801 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.423924 (+625123us) raft_consensus.cc:1685] finished
0709 13:00:33.423949 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.424084 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3403,"raft.queue_time_us":2855,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3248,"thread_start_us":168860,"threads_started":1,"wal-append.queue_time_us":431980}
I20260709 13:00:33.425705  3692 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.448987  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.415951  3790 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.450186  3245 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:33.451473  3804 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:33.426700  3852 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:00:33.473626  1526 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
W20260709 13:00:33.487037  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.448776  3730 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:33.435251  3617 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.002s
I20260709 13:00:33.480587  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.481163  3710 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:33.482393  3256 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 13:00:33.485160  3687 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.484771  1525 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:33.475890  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.487911  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:33.501233  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.501950  1534 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:33.502058  1526 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:33.501359  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:33.488660  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.505568  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:33.505828  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.412550  3276 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.478328  3245 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.506381  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:33.508854  1682 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:33.510087  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:33.488956  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:33.517091  3681 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.517871  3681 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.506821  1681 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:00:33.482546  3815 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.002s
I20260709 13:00:33.518219  3681 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.527817  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.472625  3798 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.531975  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:33.477380  3846 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.492002  2255 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:33.538538  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.496989  3804 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:33.530555  3853 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:33.540652  1602 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:33.541232  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1733) took 1238 ms. Trace:
I20260709 13:00:33.541560  1602 rpcz_store.cc:276] 0709 13:00:32.302651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.302858 (+   207us) service_pool.cc:224] Handling call
0709 13:00:33.480466 (+1177608us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:33.541165 (+ 60699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56944512}
I20260709 13:00:33.542737  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:33.542897  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.528970  3860 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.546059  3860 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:33.546314  3855 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:00:33.546674  3860 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:33.548727  3790 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.499250  3256 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.552770  3256 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.553120  3256 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:33.553936  3256 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.554952  1529 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 13:00:33.499574  3687 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:33.556277  1529 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:33.558933  3782 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.559645  3687 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.566073  3245 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.560422  3757 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.561595  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 268) took 1072 ms. Trace:
I20260709 13:00:33.569275  1680 rpcz_store.cc:276] 0709 13:00:32.488983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.489921 (+   938us) service_pool.cc:224] Handling call
0709 13:00:33.561447 (+1071526us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54000eced4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:33.561538 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64688896}
I20260709 13:00:33.571646  1529 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:33.563303  1600 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:33.575990  3687 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.581073  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 672) took 1434 ms. Trace:
I20260709 13:00:33.581933  3245 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.582206  3687 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.538347  3859 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.586134  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.587778  3631 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.530882  3796 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.588414  3631 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:33.588726  3796 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:33.589607  3796 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.590416  3690 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.590794  3690 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:33.591614  3690 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.600986  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1455) took 1521 ms. Trace:
I20260709 13:00:33.541682  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.652529  1608 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:33.581490  2260 rpcz_store.cc:276] 0709 13:00:32.147139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.147685 (+   546us) service_pool.cc:224] Handling call
0709 13:00:33.580890 (+1433205us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54005131d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:33.581018 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360762240}
I20260709 13:00:33.589479  3631 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.654279  1679 rpcz_store.cc:276] 0709 13:00:32.079481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.079947 (+   466us) service_pool.cc:224] Handling call
0709 13:00:32.080652 (+   705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.308833 (+228181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.600094 (+1291261us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540007cbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:33.600885 (+   791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486744832}
I20260709 13:00:33.655416  1498 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:33.658454  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.659283  1680 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:33.491302  3847 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.663596  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:33.660545  1681 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:33.664441  1683 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:33.665899  1681 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:00:33.666817  1681 pending_rounds.cc:85] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 5
I20260709 13:00:33.669456  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.669754  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.670516  1608 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:33.656930  3631 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:33.672820  1683 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:33.673237  3631 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.674422  3631 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.674801  3847 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.666353  3756 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:33.668825  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:33.670754  1681 pending_rounds.cc:107] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:00:33.677101  1681 raft_consensus.cc:2889] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.675984  3756 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:33.678352  3843 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 13:00:33.678489  1679 raft_consensus.cc:606] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:33.677240  3584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56394 (request call id 12) took 20159 ms. Trace:
W20260709 13:00:33.680325  3856 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:00:33.681385  1608 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:33.681819  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.682443  1680 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:33.678865  1679 raft_consensus.cc:614] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:33.683439  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:33.686882  1608 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:33.688396  1676 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:33.690351  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.691028  1526 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:33.692469  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.692648  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.693778  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.657209  3598 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.694448  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:33.700855  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:33.698390  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.700181  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:33.701556  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.704831  2254 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:00:33.705454  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.706043  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:33.706920  3543 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.707365  1609 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:33.707837  3782 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:33.704605  3865 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:33.679224  3584 rpcz_store.cc:276] 0709 13:00:13.517977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.519535 (+  1558us) service_pool.cc:224] Handling call
0709 13:00:13.581525 (+ 61990us) log.cc:844] Serialized 506 byte log entry
0709 13:00:16.440446 (+2858921us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:17.871556 (+1431110us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800323740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63a8ab0b 00007f7e63b0fb63 00007f7e63b37752 00007f7e68af7d29
0709 13:00:33.677107 (+15805551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3852380,"raft.queue_time_us":3901130,"raft.run_cpu_time_us":1987,"raft.run_wall_time_us":18760,"spinlock_wait_cycles":238637056,"thread_start_us":153796,"threads_started":1,"wal-append.queue_time_us":382870,"wal-append.run_cpu_time_us":42661,"wal-append.run_wall_time_us":3398202}
I20260709 13:00:33.709256  1530 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:33.709030  3782 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.710640  3782 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:33.711670  1530 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:33.713451  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.713500  1533 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:33.705986  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.715224  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:33.715998  1675 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:33.721388  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:33.722290  1526 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:33.725425  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:33.689850  3839 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.556s	user 0.003s	sys 0.006s
I20260709 13:00:33.733170  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.734457  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:33.736371  3797 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.706910  3804 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.740460  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:33.711592  3782 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.722776  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.742671  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.697340  3756 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.752985  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:33.721139  3829 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.756757  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.758443  1530 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:33.738306  3696 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.730046  3575 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.760886  2260 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:33.738026  3692 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.714566  3617 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:00:33.749460  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.696564  3729 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:33.762567  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 347646us
I20260709 13:00:33.745177  3797 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.777544  3862 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.749550  3815 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:33.767964  3829 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.787804  3846 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.788460  2258 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.740093  3839 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:33.774398  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.790027  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.790622  2259 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:33.791572  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.782724  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:33.796965  3869 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:00:33.798079  3835 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:33.799647  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a266117eb57049ceb80c4acd77766559"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:32902
I20260709 13:00:33.800223  1675 raft_consensus.cc:606] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:33.800570  1675 raft_consensus.cc:614] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:33.808614  3825 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.809126  3825 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:33.809624  3825 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.814745  3681 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.754659  3727 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:00:33.818666  3727 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.819038  3727 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:33.774878  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.760187  3594 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.723222  3598 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.771482  3777 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:33.785863  3862 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.771595  3262 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:00:33.778067  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.830593  1528 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:33.832726  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:33.850342  2261 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:33.834443  1606 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:33.836608  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:33.837574  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:33.840144  1607 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:33.764321  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.841331  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1737) took 1281 ms. Trace:
I20260709 13:00:33.822160  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:33.853964  1527 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.749364  3730 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:00:33.842824  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60212.6us
I20260709 13:00:33.844792  1602 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.842973  1573 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.855384  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.853715  1605 rpcz_store.cc:276] 0709 13:00:32.560218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.560805 (+   587us) service_pool.cc:224] Handling call
0709 13:00:32.561111 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.651693 (+ 90582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.841082 (+1189389us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:33.841264 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144998272}
W20260709 13:00:33.851521  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 306056us
I20260709 13:00:33.855679  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:33.775815  3276 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.773244  3696 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.859776  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.860913  3696 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:33.861282  2256 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:33.863869  3756 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:33.864405  3598 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.762099  3685 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:00:33.779702  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:33.788178  3829 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.800246  3868 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.841132  3594 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.866930  1600 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:33.819880  3727 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.866926  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:33.865350  3685 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:33.884191  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.843371  3617 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:00:33.867861  3839 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.866448  3877 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.881608  3868 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.881872  3594 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.909209  3276 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:33.885726  3685 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:33.907356  3798 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.885807  3876 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:33.954010  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:33.976351  3685 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.981055  3756 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:33.981667  3756 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.982916  1527 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:33.984829  3729 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.985185  3862 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.951964  3813 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:33.986063  3813 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:33.986923  3813 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:33.881271  3705 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:00:33.950491  3718 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:33.991146  3718 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.950891  3681 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:33.992238  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:33.993088  2253 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:33.993415  3718 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:33.993621  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 410) took 1216 ms. Trace:
I20260709 13:00:33.994421  3876 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.994642  3545 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.994903  3876 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.001856  3594 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:33.917233  3868 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.003886  3849 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:34.004487  3849 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:33.984043  3756 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:33.994134  2253 rpcz_store.cc:276] 0709 13:00:32.777089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.794503 (+ 17414us) service_pool.cc:224] Handling call
0709 13:00:33.992118 (+1197615us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:33.993561 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32387328}
I20260709 13:00:34.006785  3849 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:34.008783  3485 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:34.009243  3485 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:34.010125  3485 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.010546  3756 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.984081  3825 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.012140  3786 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.012614  3786 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:34.014343  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60509us
I20260709 13:00:34.015312  2259 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:34.013760  3825 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:34.032023  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 248425us
I20260709 13:00:34.029619  3485 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.029079  3850 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:34.042755  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 282046us
I20260709 13:00:34.036904  3804 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:34.045161  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:34.046073  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:34.013546  3786 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:34.030750  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 289156us
I20260709 13:00:34.011297  3756 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.053328   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:34.055255  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:34.064941  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:34.067672  2260 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:34.067536  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.068411  1530 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:34.039026  3789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.000s	sys 0.027s
I20260709 13:00:34.046947  3850 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.045444  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:34.073931  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:34.074716  2260 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:34.070441   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:34.075325  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:34.059680  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:34.056880  3825 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:34.069126  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:34.082103  2257 raft_consensus.cc:2376] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6. Re-sending same reply.
I20260709 13:00:34.076615  3850 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.084635  3876 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.086863  3876 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:34.087755  3757 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.088243  3757 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.088660  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:34.090636  1530 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:34.091660  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.096985  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.100474  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.101078  1534 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.104751  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:34.058072  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:34.106511  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:34.069849  3786 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.105892  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.113055  1525 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:34.075965  3789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.001s	sys 0.028s
I20260709 13:00:34.122671  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.122975  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.124440  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.125658  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.126484  1604 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:34.127975  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.129127  1605 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:34.098511  3782 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:34.108064  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50061.1us
I20260709 13:00:34.110772  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:34.111775  1530 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:34.132596  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:34.141975  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:34.142603  1605 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:00:34.144440  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 84820.2us
I20260709 13:00:34.081599  3692 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.139819  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:34.146350  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:34.164541  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.111644  3681 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.114957  3616 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.079174  3797 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:00:34.176436  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 111563us
I20260709 13:00:34.180182  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:34.181409  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:34.182927  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:34.136245  3796 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:34.191208  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:34.191821  1605 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:34.187705  1525 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:34.145820  3829 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.195623  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:34.202031  1534 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:34.116729  3543 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:00:34.174595  3696 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:34.175208  3883 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:34.206825  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60571.6us
I20260709 13:00:34.207151  1534 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:34.146335  3718 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:00:34.217447  1525 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:34.206205  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47384.6us
I20260709 13:00:34.184589  3849 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.175410  3731 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:34.177124  3878 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:34.241070  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 103736us
I20260709 13:00:34.190478  3876 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:34.238319  1530 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.208811  3616 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:34.212774  3696 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.238924  1525 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:34.192618  3862 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.202950  3692 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:34.213819  3879 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:00:34.244030  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:34.205224  3796 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.237903  3543 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:34.261701  3696 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.178964  3804 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.216370  3815 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:00:34.271780  3543 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.271994  3616 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.273046  3543 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.275455  3868 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.241149  3594 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:34.243480  3878 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:34.272032  3887 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:00:34.264783  3876 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.278980  3718 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.317391  3876 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.313022  3878 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.330133  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:34.332439  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:34.333580  3594 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.309314  3756 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:34.311617  3851 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.339996  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 96005.9us
I20260709 13:00:34.350980  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:34.354497  3898 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:00:34.354339  3892 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.002s
I20260709 13:00:34.322685  3730 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:00:34.335507  3718 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:34.356602  3851 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.377918  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1649) took 1099 ms. Trace:
I20260709 13:00:34.318753  3886 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:34.385036  3584 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:34.387662  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 255307us
I20260709 13:00:34.323261  3901 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:34.388526  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:34.389468  3757 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.391700  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 313) took 1602 ms. Trace:
W20260709 13:00:34.392787  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 60521.8us
W20260709 13:00:34.410490  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 139784us
I20260709 13:00:34.396739  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1640) took 1279 ms. Trace:
I20260709 13:00:34.316331  3797 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:34.410737  1603 rpcz_store.cc:276] 0709 13:00:32.789632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.789815 (+   183us) service_pool.cc:224] Handling call
0709 13:00:32.819683 (+ 29868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.819918 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:33.043078 (+223160us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.094894 (+1051816us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b48000cda58. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:00:34.390548 (+295654us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b18001d58a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf 00007f7e63b4b038
0709 13:00:34.390864 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.391199 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.391346 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.391385 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:34.391429 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.391497 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.391633 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26819,"prepare.queue_time_us":2803058,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":222,"raft.queue_time_us":31125,"raft.run_cpu_time_us":2819,"raft.run_wall_time_us":940955,"spinlock_wait_cycles":119046144,"thread_start_us":318354,"threads_started":3,"wal-append.queue_time_us":247438}
I20260709 13:00:34.411432  1529 rpcz_store.cc:276] 0709 13:00:33.118723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.577289 (+458566us) service_pool.cc:224] Handling call
0709 13:00:33.577611 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:33.578052 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.578081 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:33.578655 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 13:00:33.870740 (+292085us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:34.058682 (+187942us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.063069 (+  4387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.063142 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.324387 (+261245us) raft_consensus.cc:1685] finished
0709 13:00:34.324409 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.396640 (+ 72231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46156,"prepare.queue_time_us":242058,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":13196,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":1276,"thread_start_us":469433,"threads_started":2,"wal-append.queue_time_us":457048}
I20260709 13:00:34.315932  3904 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:00:34.404060  1532 rpcz_store.cc:276] 0709 13:00:33.278265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.360600 (+ 82335us) service_pool.cc:224] Handling call
0709 13:00:34.377704 (+1017104us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b54002ce054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:34.377845 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142450048}
I20260709 13:00:34.406329  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:34.334092  3831 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.393035  3906 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:00:34.449540  1683 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:00:34.419366  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.419459  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:34.401614  3796 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:34.406502  3829 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:34.438270  3903 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.444036  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.446245  1682 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:34.443148  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.406622  3584 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:34.451195  1604 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:34.415185  3756 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.458369  1675 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:34.413394  3901 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:34.472245  3854 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.922s	user 0.000s	sys 0.004s
I20260709 13:00:34.468786  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.475632  1676 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:34.448220  3797 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.445541  3831 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:34.480672  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.481433  1676 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:34.448525  3804 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:34.455416  3731 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.455542  3801 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.487466  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.512151  1676 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:34.518561  3801 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.509475  3860 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.530632  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1635) took 1416 ms. Trace:
I20260709 13:00:34.530895  1678 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.528419  3891 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:34.548763  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.549569  1527 rpcz_store.cc:276] 0709 13:00:33.114111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.418443 (+304332us) service_pool.cc:224] Handling call
0709 13:00:34.529344 (+1110901us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540042dbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:34.530565 (+  1221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984563584}
I20260709 13:00:34.528934  3831 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.422734  3907 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:00:34.464166  3910 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:34.484797  3796 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.534312  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.533245  1681 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:34.477025  3901 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.490850  3616 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:34.562549  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:34.566190  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.566038  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.568073  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:34.473850  3696 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.474468  3756 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.574848  1676 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:34.578822  1609 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.563000  3692 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:34.579828  3891 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.581288  3692 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.531251  3890 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:34.584257  3890 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:34.584522  3857 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.226s	user 0.006s	sys 0.000s
I20260709 13:00:34.585114  3890 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.586598  3890 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.586920  3757 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:34.526643  3868 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:34.576086  3907 consensus_queue.cc:1243] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:34.558625  3883 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.595429  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.598129  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.557089  3860 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.605842  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.590322  3797 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:34.616191  3851 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:34.593113  3910 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:34.617632  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.608470  3801 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:34.608094  3829 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.554482  3543 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.588706  3904 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.615504  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:34.519997  3731 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:34.617977  3910 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.616267  3797 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:34.594807  3485 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.001s
I20260709 13:00:34.624212  1609 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.638129  3543 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:34.583446  3616 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.614105  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:34.626238  3696 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:34.626894  3883 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.629796  3876 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.630970  3731 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:34.631489  1681 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.519023  3804 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:34.636337  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:34.562191  3584 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:34.573673  3796 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:34.910259  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1462) took 2584 ms. Trace:
W20260709 13:00:34.986491  1480 auto_rebalancer.cc:893] Removing replace marker failed: Replica b88b12b461734b3aa6a3da4f5c22c79b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:00:35.010622  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.120s
W20260709 13:00:35.011170  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.021s	sys 0.120s
I20260709 13:00:35.008100  1601 rpcz_store.cc:276] 0709 13:00:32.326197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.327611 (+  1414us) service_pool.cc:224] Handling call
0709 13:00:32.327928 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.683321 (+1355393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.683353 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.683394 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:33.683428 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.909899 (+1226471us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540029bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:34.909998 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.910177 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116594944}
W20260709 13:00:34.969851  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.705436  3782 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.002s
W20260709 13:00:35.025322  1480 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:35.025458  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.017s
W20260709 13:00:35.040925  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.020s	sys 0.018s
I20260709 13:00:35.037328  1676 raft_consensus.cc:2368] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4.
I20260709 13:00:35.023329  3616 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.057247  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:35.057981  1676 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:35.056887  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.013s	sys 0.102s
W20260709 13:00:35.059113  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.102s
I20260709 13:00:34.639328  3756 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:35.059371  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 595329us
I20260709 13:00:34.701267  3904 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.083215  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:35.040799  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:34.815073  3777 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.091549  1677 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:34.719257  3543 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:35.009974  3797 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:34.721503  3851 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:35.040743  3868 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.105266  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.017s	sys 0.010s
W20260709 13:00:35.105790  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.018s	sys 0.010s
W20260709 13:00:35.107439  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.024s	sys 0.012s
I20260709 13:00:34.987020  3911 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.442s
I20260709 13:00:35.085536  3584 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.107334  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:35.115090  1677 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:35.109177  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.024s	sys 0.012s
I20260709 13:00:35.118501  1681 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:35.097796  3782 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.087368  1674 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:35.106266  3543 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.160684  3782 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.162173  3543 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.152228  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.154649  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:35.162904  3782 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.163055  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.163465  1677 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:35.164251  3911 consensus_queue.cc:1243] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:35.165225  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 415) took 1120 ms. Trace:
I20260709 13:00:35.165741  2253 rpcz_store.cc:276] 0709 13:00:34.044335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.047080 (+  2745us) service_pool.cc:224] Handling call
0709 13:00:35.154445 (+1107365us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:35.165148 (+ 10703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15698816}
I20260709 13:00:35.167038  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.167961  1605 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:35.168249  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.155579  3804 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:35.173308  3915 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
I20260709 13:00:35.173542  1677 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:35.175179  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:35.112128  3797 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:00:35.159797  3890 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.573s	user 0.001s	sys 0.010s
I20260709 13:00:35.097622  3696 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:00:35.104787  3850 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.022s	user 0.012s	sys 0.000s
I20260709 13:00:35.109124  3851 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.180420  1677 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:35.180862  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.009s	sys 0.025s
W20260709 13:00:35.184288  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.009s	sys 0.025s
I20260709 13:00:35.182384  1683 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:35.112897  3891 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.178499  3782 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:35.120078  3918 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:35.187788  1680 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:35.098451  3777 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.191468   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:35.184741  3786 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.053s	user 0.006s	sys 0.006s
I20260709 13:00:35.109581  3868 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:35.184974  3878 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.854s	user 0.011s	sys 0.000s
I20260709 13:00:35.098659  3904 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.202203  1678 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 13:00:35.195879  3782 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.176016  3896 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:35.204754  3876 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.206190  3687 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.186668  3756 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.467630  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1759) took 1043 ms. Trace:
I20260709 13:00:35.184464  3801 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:35.197346  3892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.005s	sys 0.022s
W20260709 13:00:35.222698  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.006s	sys 0.044s
I20260709 13:00:35.196511  3860 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:35.225455  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.014s	sys 0.017s
I20260709 13:00:35.186713  3850 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.215526  3912 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.217167  3786 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.197026  3918 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.218619  3878 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.466022  3718 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:35.472716  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 424498us
W20260709 13:00:35.232110  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.473544  1600 rpcz_store.cc:276] 0709 13:00:34.423875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.424928 (+  1053us) service_pool.cc:224] Handling call
0709 13:00:34.425271 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.425584 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.425611 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.440407 (+ 14796us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.106369 (+665962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:35.106452 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.106568 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.299553 (+192985us) raft_consensus.cc:1685] finished
0709 13:00:35.299580 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.467552 (+167972us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32016,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9565,"thread_start_us":620044,"threads_started":1,"wal-append.queue_time_us":832505}
W20260709 13:00:35.478806  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.007s	sys 0.044s
I20260709 13:00:35.263376  3883 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:35.513255  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.034s
W20260709 13:00:35.513695  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.015s	sys 0.034s
I20260709 13:00:35.213299  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:35.482664  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.014s	sys 0.017s
W20260709 13:00:35.350924  3894 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.110s	user 0.000s	sys 0.016s
I20260709 13:00:35.517333  3718 raft_consensus.cc:1064] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
W20260709 13:00:35.237416  3875 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.369s	user 0.004s	sys 0.010s
W20260709 13:00:35.400460  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.009s	sys 0.032s
I20260709 13:00:35.475100  3687 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.475859  3925 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.327370  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.379s (SENT) [suppressed 29 similar messages]
I20260709 13:00:35.239674  1674 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:35.304463  3796 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:35.478349  3892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.005s	sys 0.022s
I20260709 13:00:35.505576  1676 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:35.358254  3921 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.508456  3777 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:35.510507  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.479656  3798 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.478910  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.499583  3256 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.516956  3539 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:35.554668  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.512264  3851 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.477360  3756 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.516870  3795 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:35.539155  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.009s	sys 0.037s
I20260709 13:00:35.567101  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.593297  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:35.593961  1676 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.482012  3801 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.506150  3912 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.552534  3904 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:35.506557  3786 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.605019  1499 leader_election.cc:400] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4.
I20260709 13:00:35.609315  1499 leader_election.cc:403] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:00:35.612006  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.599721  1682 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.612795  1682 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:35.606118  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1761) took 1037 ms. Trace:
I20260709 13:00:35.615837  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:35.565958  3796 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.563597  3868 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.618140  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:35.516081  3876 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:35.614840  1604 rpcz_store.cc:276] 0709 13:00:34.568981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.569126 (+   145us) service_pool.cc:224] Handling call
0709 13:00:34.569468 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.569838 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.569863 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.570361 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.516755 (+946394us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:35.516798 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.516873 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.605883 (+ 89010us) raft_consensus.cc:1685] finished
0709 13:00:35.605905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.606050 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19963,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":7212,"spinlock_wait_cycles":1527168,"thread_start_us":925175,"threads_started":1,"wal-append.queue_time_us":925226}
I20260709 13:00:35.562471  3925 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.599506  3795 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:35.608352  3920 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 13:00:35.591132  3539 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.594866  3851 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.615696  1682 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.565789  3921 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.598867  3930 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.650857  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:35.657634  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:35.675420  1600 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:35.597886  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.641955  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.616783  3859 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:35.660506  3931 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4.
I20260709 13:00:35.663230  1676 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:35.568560  3798 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:35.669114  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 341766us
I20260709 13:00:35.672479  1604 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.692001  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.622907  3796 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.676978  1682 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.678310  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.699563  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.699971  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.678459  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:35.703393  1573 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.692s (SENT)
I20260709 13:00:35.704041  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:35.679560  1605 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:35.685398  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:35.679734  1603 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:35.682065  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:35.661106  3876 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:35.676456  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 463318us
I20260709 13:00:35.715221  1606 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:35.676618  3393 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:35.666657  3795 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.721311  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:35.688028  3911 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.718317  1682 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:35.718739  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:35.720216  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 282) took 1277 ms. Trace:
I20260709 13:00:35.730602  1679 rpcz_store.cc:276] 0709 13:00:34.443008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.443597 (+   589us) service_pool.cc:224] Handling call
0709 13:00:34.443943 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.450040 (+  6097us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:34.450077 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.450595 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.041457 (+590862us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:35.041504 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.041586 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.720022 (+678436us) raft_consensus.cc:1685] finished
0709 13:00:35.720042 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.720159 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10341,"raft.queue_time_us":6704,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7670,"thread_start_us":590519,"threads_started":1,"wal-append.queue_time_us":760652}
I20260709 13:00:35.724625  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:35.676117  3851 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.723040  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:35.725992  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:35.728361  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:35.737198  1527 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:35.694454  3939 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.728463  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:35.699225  3731 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:00:35.706176  3896 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.704015  3931 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.736279  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:35.744462  1529 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:35.696892  3543 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:35.741830  1532 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:35.679389  3930 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.692389  3859 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.757421  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:35.735216  3942 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.728294  3782 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.762234  1533 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:35.726142  3910 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:35.743238  3850 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.747025  3393 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:35.744907  3756 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.744179  3931 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:35.756930  3939 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.755004  3795 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.739612  3911 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:35.761475  3918 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.816735  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:35.817795  3756 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.758491  3834 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:35.767762  3943 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:35.825701  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 101144us
I20260709 13:00:35.822201  1527 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:35.833818  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.791029  3782 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:35.745842  3896 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.820669  3393 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:35.774578  3945 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:35.838635  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 115662us
W20260709 13:00:35.822808  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 119428us
I20260709 13:00:35.812808  3946 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:35.838455  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:35.847944  1681 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:35.814142  3931 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.848217  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:35.827034  3795 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:35.865154  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1470) took 1256 ms. Trace:
W20260709 13:00:35.910774  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60296.9us
I20260709 13:00:35.825938  3786 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.910943  1683 rpcz_store.cc:276] 0709 13:00:34.609229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.186041 (+576812us) service_pool.cc:224] Handling call
0709 13:00:35.191990 (+  5949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.496780 (+304790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.496830 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.496876 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:35.496911 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.864917 (+368006us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001d9054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:35.864960 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.865094 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700337920}
I20260709 13:00:35.821420  3940 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.833719  3801 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:35.822542  3756 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:35.837268  3813 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:36.047115  1573 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.828s (SENT)
I20260709 13:00:35.823624  3912 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:36.046438  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 134741us
I20260709 13:00:35.836404  3782 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:35.770358  3718 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.773566  3942 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:35.850395  3946 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.848076  3796 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:35.913959  3883 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.915182  3918 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:36.060444  1573 leader_election.cc:336] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.970s (SENT)
W20260709 13:00:36.063850  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.823400  3939 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.056726  3731 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.073613  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:36.075094  3256 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
W20260709 13:00:36.056182  3575 consensus_queue.cc:1175] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "428f0180c2cd487c8b48e91f14dff65d" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:36.061755  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.080572  3393 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.064862  3782 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.068994  3946 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.060073  3756 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:36.085641  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 339) took 3124 ms (client timeout 2379 ms). Trace:
I20260709 13:00:36.059239  3815 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:36.103861  1528 rpcz_store.cc:269] 0709 13:00:32.961696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.100677 (+138981us) service_pool.cc:224] Handling call
0709 13:00:36.085445 (+2984768us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b540042d6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:36.085564 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546655616}
I20260709 13:00:36.061237  3786 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:36.065514  3912 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.099469  3936 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:00:36.064862  3539 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.099586  1608 raft_consensus.cc:2410] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:35.846390  3943 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.095278  3883 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.098102  3731 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.108285  3730 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.100144  3952 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:36.098177  3934 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
I20260709 13:00:36.068465  3945 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:36.062403  3795 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:36.071070  3940 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.093894  3925 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:36.116035  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 376045us
I20260709 13:00:36.102916  3949 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:36.112985  3941 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:00:36.128592  3923 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.098301  3951 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:36.159425  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:36.141487  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80826.7us
W20260709 13:00:36.145125  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 419200us
I20260709 13:00:36.144114  3955 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.150300  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 676) took 2428 ms (client timeout 2986 ms). Trace:
W20260709 13:00:36.174712  2258 rpcz_store.cc:269] 0709 13:00:33.722317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.722540 (+   223us) service_pool.cc:224] Handling call
0709 13:00:36.150100 (+2427560us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54004c4854. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:36.150216 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97849216}
I20260709 13:00:36.153084  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1472) took 1543 ms. Trace:
I20260709 13:00:36.176067  1680 rpcz_store.cc:276] 0709 13:00:34.609825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.615226 (+  5401us) service_pool.cc:224] Handling call
0709 13:00:36.152933 (+1537707us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54000ed3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:36.153027 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286590848}
I20260709 13:00:36.127306  3798 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.141573  3539 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.185060  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.114460  3815 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.114845  3786 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.190011  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.192090  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:36.193749  1532 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5. Re-sending same reply.
I20260709 13:00:36.195083  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.196395  3911 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:36.141004  3921 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.197211  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.197747  3921 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.198320  3921 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.198884  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.199271  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.200058  2255 raft_consensus.cc:2368] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4.
I20260709 13:00:36.200279  3961 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:36.142827  3730 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.202829  3730 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.202494  3795 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.145859  3945 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.204748  3798 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:36.204985  3954 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:36.205813  3959 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:36.206420  3883 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.117537  3912 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.208395  1605 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:36.208900  2258 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.210356  1601 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:36.207203  3930 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.220772  3930 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.148589  3859 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.224493  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:36.154838  3801 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.227459  2258 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:36.237268  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:36.238498  1601 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:36.240600  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.237267  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:36.241888  1647 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.734s (SENT)
I20260709 13:00:36.240551  3798 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:00:36.328265  3801 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:36.329166  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 87316.6us
I20260709 13:00:36.225739  3815 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:36.335697  1647 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.778s (SENT)
I20260709 13:00:36.336387  1603 raft_consensus.cc:2410] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:36.337067  1605 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:36.207576  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.187911  3539 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.143136  3952 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:36.283540  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.337680  1680 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:36.340037  1606 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:36.226251  3961 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:00:36.355011  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:36.355017  1533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.015s
W20260709 13:00:36.356372  1533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.007s	sys 0.015s
I20260709 13:00:36.356040  1683 raft_consensus.cc:2410] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:36.356860  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 288) took 1153 ms. Trace:
W20260709 13:00:36.282799  3956 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:00:36.358644  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.187034  3951 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.225968  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.357246  1678 rpcz_store.cc:276] 0709 13:00:35.203439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.474182 (+270743us) service_pool.cc:224] Handling call
0709 13:00:35.474586 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.475005 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.475034 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.475555 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.650406 (+174851us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:35.650448 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.650517 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.356632 (+706115us) raft_consensus.cc:1685] finished
0709 13:00:36.356651 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.356800 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":174417,"threads_started":1,"wal-append.queue_time_us":223310}
I20260709 13:00:36.365103  1604 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:36.374313  1603 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:36.376853  1604 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.241456  3925 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.241495  3930 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:36.378374  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.378932  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.381405  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.383764  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 146575us
I20260709 13:00:36.384536  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:36.386143  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.020s
I20260709 13:00:36.362694  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:36.386827  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.020s
I20260709 13:00:36.192633  3955 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.397024  3955 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.397800  3955 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.398387  3955 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.190070  3923 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.402945  1603 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.362214  3964 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.382174  2256 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:36.408761  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.406131  3850 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.148828  3940 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.420190  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.410184  3964 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.386690  3930 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.388774  3796 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:36.445530  3974 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:36.417373  3901 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.829s	user 0.007s	sys 0.007s
I20260709 13:00:36.415294  3938 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:36.454391  3972 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:00:36.454530  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.386456  3925 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.443324  3256 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.463336  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.509186  1603 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:36.456352  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.450618  3796 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:36.452798  3943 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.459533  3850 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:36.459530  3939 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.525869  3969 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:00:36.528774  3963 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:00:36.517993  3584 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.397s	user 0.010s	sys 0.003s
I20260709 13:00:36.517884  3256 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:36.535692  2260 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:36.529663  3963 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:36.539088  3963 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:36.539402  3256 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.540474  3921 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.539819  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1480) took 2418 ms. Trace:
I20260709 13:00:36.546126  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.519783  3731 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:36.461042  3901 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.549319  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.550091  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.541496  3883 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.517150  3976 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.529951  3967 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.543634  1602 rpcz_store.cc:276] 0709 13:00:34.121596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.126793 (+  5197us) service_pool.cc:224] Handling call
0709 13:00:34.127161 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.127562 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:34.415235 (+287673us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.819665 (+1404430us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b1800459940. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:00:36.214157 (+394492us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.239531 (+ 25374us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.239694 (+   163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:36.239734 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.239803 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.531514 (+291711us) raft_consensus.cc:1685] finished
0709 13:00:36.539626 (+  8112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.539768 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282913,"prepare.queue_time_us":302924,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2797,"raft.queue_time_us":53869,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":24198,"spinlock_wait_cycles":9823616,"thread_start_us":383397,"threads_started":2,"wal-append.queue_time_us":1663167}
I20260709 13:00:36.566854  3973 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:36.531112  3925 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.529738  3955 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.580535  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.583911  1602 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:36.542944  3904 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.537544  3786 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.572871  1603 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:36.572803  2260 raft_consensus.cc:2376] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4. Re-sending same reply.
I20260709 13:00:36.579192  3883 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.590143  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.591200  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.591676  2260 raft_consensus.cc:2376] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5. Re-sending same reply.
I20260709 13:00:36.591687  3883 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:36.566118  3945 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.542330  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.593618  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.594110  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.594686  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.595337  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.595717  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.548115  3912 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.596300  2260 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:36.592983  3904 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.597400  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.599486  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.575248  3685 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.577091  3692 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:36.604027  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1471) took 1994 ms. Trace:
I20260709 13:00:36.577724  3850 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.604550  1677 rpcz_store.cc:276] 0709 13:00:34.609538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.186987 (+577449us) service_pool.cc:224] Handling call
0709 13:00:35.202595 (+ 15608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.227414 (+ 24819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.227453 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.229001 (+  1548us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.651550 (+422549us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:35.651602 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.603655 (+952053us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54000ec9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:36.603701 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.603746 (+    45us) raft_consensus.cc:1685] finished
0709 13:00:36.603759 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.603969 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4186,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3720,"spinlock_wait_cycles":44739328,"thread_start_us":411571,"threads_started":1,"wal-append.queue_time_us":562068}
I20260709 13:00:36.606670  3886 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:36.577505  3964 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.578462  3801 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.573067  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.500905  3974 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.588408  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:36.600627  3970 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:00:36.600935  3687 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.527207  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.439368  3962 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:00:36.588748  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:36.611529  3756 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:00:36.616889  3756 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:36.617230  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 199709us
I20260709 13:00:36.619365  3756 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.620240  1602 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:36.626199  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.652033  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.570154  3796 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.613602  2260 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:36.607050  3886 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:36.643301  3931 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:00:36.570529  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.508112  3938 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.591857  3782 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.580948  3976 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:36.648044  3946 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.000s
I20260709 13:00:36.589522  3940 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.586401  3973 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.607580  3951 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.539914  3963 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.656425  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.638427  3692 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.653000  3801 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.650622  3952 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.657452  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.679561  1530 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:36.661026  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.640486  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.662017  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.682983  1528 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:36.682204  1602 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:36.684154  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:36.683154  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.660739  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:36.588371  3967 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.663172  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.659926  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 417) took 2902 ms. Trace:
I20260709 13:00:36.669823  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.650250  3964 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.657492  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 216540us
I20260709 13:00:36.676844  3796 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.658165  3945 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.685945  1527 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:36.663825  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.701189  1526 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:36.701843  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.702587  1676 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:36.702927  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:36.704404  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.705515  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.684870  1530 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:36.688244  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:36.674124  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.706679  2260 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:36.706792  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.707732  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.678265  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.708681  1530 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:36.696148  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.708956  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.697618  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.709717  2260 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:36.697595  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:36.698484  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 509521us
I20260709 13:00:36.676415  3692 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.698158  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.710706  3692 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.711149  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.710481  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:36.711407  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.709438  1678 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:36.709054  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.712908  3829 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.713831  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.711935  2260 raft_consensus.cc:2376] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4. Re-sending same reply.
I20260709 13:00:36.714512  3829 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.714900  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.715642  3829 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.716715  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.716100  1602 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.717517  3900 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.718008  3900 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:36.710695  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:36.718874  3900 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.720745  1498 leader_election.cc:400] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4.
I20260709 13:00:36.721596  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.721413  3983 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.723014  3983 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.725564  3983 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.725895  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.730005  3829 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.731150  1530 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:36.731874  1602 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:36.735080  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:36.735952  3575 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.736600  3575 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:36.737517  3575 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.742314  1534 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:36.742772  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.743465  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.745110  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:36.749210  1530 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:36.752768  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.753403  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.664040  3921 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:36.754325  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.755867  1679 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:36.670506  3946 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.664094  3931 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:36.757292  1526 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:36.758178  3931 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.759011  1529 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:36.688758  3962 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.761420  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.762702  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.763357  1679 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:36.764192  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.764889  1679 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:36.693598  3963 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.765448  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.698782  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.743620  3685 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.784988  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.795768  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.758657  3951 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:36.787760  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:36.761631  3955 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.762218  1527 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:36.801595  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.802596  1679 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:36.765512  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.793577  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:36.796813  2256 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:36.759004  3865 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.758242  3946 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.761956  3962 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.755386  3393 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:36.683516  3801 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:36.803357  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3259722369999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:00:36.807256  1604 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.800431  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:36.819588  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.819944  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1864722369999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 13:00:36.786422  3921 consensus_queue.cc:1243] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:36.820895  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.786648  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:36.820214  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1829349920000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:00:36.821810  1527 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:00:36.823081  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:36.703214  3964 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.829804  3964 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.831007  3991 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:36.831707  3991 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:36.794721  3685 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:36.824797  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1774722369999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 13:00:36.798432  3901 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.799714  3949 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.834242  2261 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:00:36.809638  3985 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:00:36.759259  3945 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:36.797683  3951 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:36.837849  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:36.836850  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:36.821221  3978 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:00:36.800029  2253 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:36.816596  3962 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.851609  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.822685  3955 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:36.841883  3685 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.866882  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.897029  1525 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:36.897089  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:36.898027  1602 raft_consensus.cc:606] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Received request to transfer leadership
I20260709 13:00:36.897957  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.868615  3992 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:36.883469  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 336850us
W20260709 13:00:36.905082  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.859511  3951 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.900746  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.908432  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.901532  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:36.910127  1527 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:36.910562  1677 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:36.911471  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:36.913134  3984 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:36.845538  3976 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:36.905905  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.850018  3928 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.906221  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.909200  1602 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:36.917618  3731 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.918195  3813 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.921784  3911 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.935523  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 353) took 1109 ms. Trace:
I20260709 13:00:36.904495  2257 raft_consensus.cc:2410] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:36.930686  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.932279  1604 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:36.897076  3982 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.934132  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.854456  3949 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.946593  3718 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.947132  3718 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:36.947194  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.947988  3718 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.949608  3940 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.951444  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:36.953285  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:36.956825  3971 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.954012  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.957414  3971 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.958194  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.958931  1604 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:36.935981  1533 rpcz_store.cc:276] 0709 13:00:35.826473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.826612 (+   139us) service_pool.cc:224] Handling call
0709 13:00:35.845470 (+ 18858us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:36.362232 (+516762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.362283 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:36.382331 (+ 20048us) log.cc:844] Serialized 52 byte log entry
0709 13:00:36.652562 (+270231us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:36.670528 (+ 17966us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.924589 (+254061us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18002eed00. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf 00007f7e63b4b038
0709 13:00:36.924812 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.931512 (+  6700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.931590 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.935282 (+  3692us) raft_consensus.cc:1685] finished
0709 13:00:36.935302 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.935462 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250076,"prepare.queue_time_us":282545,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":39,"raft.queue_time_us":264879,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3974,"spinlock_wait_cycles":8522240,"thread_start_us":723292,"threads_started":2,"wal-append.queue_time_us":381098}
I20260709 13:00:36.959765  3971 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.936214  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:36.907095  3584 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.962128  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:36.908373  3782 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:36.965214  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:36.965755  3967 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.914948  3952 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.963728  3911 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.969583  3940 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.935128  3731 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:36.955605  3813 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.990531  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.971872  3988 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:00:36.869222  3901 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:00:36.979362  1533 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:37.002458  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84262.4us
I20260709 13:00:36.926985  3992 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:36.970433  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.988543  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.998263  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.005978  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:36.930991  3991 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.966714  3584 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.976815  3756 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:37.011588  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:36.970237  3989 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:36.920084  3886 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.018841  1602 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:37.015096  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:37.004274  3256 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.999617  3940 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:37.027837  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.997961  3974 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.977948  3685 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.016557  3756 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:37.014627  3584 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.042070  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.045608  1609 raft_consensus.cc:2410] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:37.018042  3912 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:37.007339  3883 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:37.025063  3256 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.029253  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:36.989061  3971 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:37.028728  3940 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.025476  3952 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.028935  3989 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:36.934973  3928 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.046388  3756 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.027098  3973 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.064401  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.007601  3955 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:36.689771  2252 rpcz_store.cc:276] 0709 13:00:33.757422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.759144 (+  1722us) service_pool.cc:224] Handling call
0709 13:00:33.839532 (+ 80388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.892773 (+ 53241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.908541 (+ 15768us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.944800 (+ 36259us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.065755 (+120955us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:34.189071 (+123316us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.404740 (+215669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.350246 (+945506us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:36.643849 (+1293603us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540027d3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:36.649442 (+  5593us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.650965 (+  1523us) raft_consensus.cc:1685] finished
0709 13:00:36.651871 (+   906us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.658853 (+  6982us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13235,"prepare.queue_time_us":167777,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":88817,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":18485,"spinlock_wait_cycles":64712960,"thread_start_us":404139,"threads_started":3,"wal-append.queue_time_us":214301,"wal-append.run_cpu_time_us":33991,"wal-append.run_wall_time_us":2569277}
I20260709 13:00:37.070278  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:37.070999  2252 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:37.052460  3883 consensus_queue.cc:1243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:37.051359  3256 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.075839  3968 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:37.062057  3989 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.080495  3727 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.080618  3899 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.081197  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:37.080116  3949 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:37.088755  3998 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:37.089555  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:37.099910  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.100834  3813 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.055249  3692 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.089637  3911 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.082638  3801 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.094076  3968 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.090472  3731 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:37.125444  2257 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.135571  3951 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:37.114809  3995 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:00:37.124933  1533 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:37.149724  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.157639  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.154484  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.161052  1681 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:37.161988  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.156596  1683 raft_consensus.cc:2368] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6.
I20260709 13:00:37.156512  3909 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.125651  4005 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:37.157609  3692 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:37.077221  3962 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.164507  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:37.168443  1677 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.167488  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.170395  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.123443  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:37.173264  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:37.185388  1678 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.159288  3883 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:37.179559  2257 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:37.181716  3951 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.126585  3878 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.182790  2255 raft_consensus.cc:2410] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:37.144135  3968 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.166339  3731 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.189918  1676 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:37.191928  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.187083  3909 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.199443  3910 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:37.200959  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.093851  3992 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.206720  1679 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:37.206879  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.207916  1675 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:37.209051  1675 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:37.209910  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:37.205585  1677 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:37.206979  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:37.212579  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.213724  1677 raft_consensus.cc:2410] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:37.203773  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.218484  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:37.222082  1678 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:37.219187  3962 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:37.194437  3685 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:37.206413  3796 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.002s
I20260709 13:00:37.182816  3256 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.240798  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.244062  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.245687  2254 raft_consensus.cc:2410] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:37.249156  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 308031us
I20260709 13:00:37.251437  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.251940  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.252251  1529 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:37.252722  1528 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:37.254242  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.216960  3910 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:37.256426  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.220772  3731 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.264571  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.264649  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.265868  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:37.266592  1609 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.268461  1526 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:37.262130  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:37.268378  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.271577  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.271935  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:37.273994  1534 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:37.276834  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.277611  1675 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:37.278829  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.280653  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.281276  1534 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:37.281621  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.282598  1528 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.284108  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.284724  1533 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:37.292003  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.292354  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.293051  1533 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:37.294828  1679 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:37.295300  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.290632  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:37.296870  1528 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:37.302879  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:37.305023  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.306735  1533 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:37.284099  2255 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:37.309598  1675 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:37.319344  1679 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:37.293478  3910 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.329804  3909 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:36.928287   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.341120  1677 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:37.322968  2252 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:37.358273  4001 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:37.349517  3756 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.351073  3910 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.365502  3731 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:37.367856  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1780) took 1010 ms. Trace:
I20260709 13:00:37.345824  3940 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.362345  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:37.368248  1600 rpcz_store.cc:276] 0709 13:00:36.357810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.357931 (+   121us) service_pool.cc:224] Handling call
0709 13:00:36.358252 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.358602 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:36.498694 (+140092us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.928689 (+429995us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.931791 (+  3102us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.931967 (+   176us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:36.932002 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.932069 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.367637 (+435568us) raft_consensus.cc:1685] finished
0709 13:00:37.367657 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.367798 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29031,"prepare.queue_time_us":249844,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":3889,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4759,"spinlock_wait_cycles":21120,"thread_start_us":511020,"threads_started":2,"wal-append.queue_time_us":685697}
I20260709 13:00:37.371922  3256 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.371413  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.372632  1600 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:37.373070  3756 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.374054  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.374459  3584 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.374845  3940 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.376693  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:37.377417  3962 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.378014  3962 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.378446  3962 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.377367  1600 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.379309  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:37.379644  1609 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:37.407588  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.366966  3968 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.409183  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.370553  3831 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.414505  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:37.416199  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:37.422549  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:37.424028  1609 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.422569  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.416497  3731 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.425936  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 332) took 4721 ms. Trace:
I20260709 13:00:37.411221  3804 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:37.427417  1531 rpcz_store.cc:276] 0709 13:00:32.705078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.705446 (+   368us) service_pool.cc:224] Handling call
0709 13:00:32.705809 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.706038 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:32.726364 (+ 20326us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.097062 (+2370698us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b18000ef0e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:00:35.771617 (+674555us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.425478 (+1653861us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b18000ef0e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:00:37.425582 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.425629 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:37.425673 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.425747 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.425871 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93170,"prepare.queue_time_us":180012,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":354802,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":6047,"spinlock_wait_cycles":142125056,"thread_start_us":716455,"threads_started":4,"wal-append.queue_time_us":3099300,"wal-append.run_cpu_time_us":2487,"wal-append.run_wall_time_us":1250572}
I20260709 13:00:37.420223  1600 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:37.432682  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.434163  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.434846  1600 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:37.435804  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.420956  3797 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:37.436602  4007 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.431754  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.439987  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:37.440991  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:37.441061  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.436986  3797 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:37.422209  3544 raft_consensus.cc:2764] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:37.413376  3584 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.426635  3790 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.447474  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:37.451462  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:37.426884  3692 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.454151  3979 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.459103  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:37.456328  3946 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.427922  3928 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.428071  3804 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:37.455809  3989 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.460813  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:37.462436  1609 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:37.463236  3692 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:37.481357  3692 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:37.482409  3692 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.483374  3804 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.489607  3946 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:37.490513  3946 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.459595  3731 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:37.489470  3804 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.492697  3731 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:37.450969  3951 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.494058  3951 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.494318  3989 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.494757  3896 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.476369  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:37.480657  3973 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.484547  3979 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:37.472136  3584 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.464744  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:37.474751  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:37.494678  3797 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.505973  4007 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.506574  4007 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:37.508538  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 43863.2us
I20260709 13:00:37.509253  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:37.489477  3968 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.507444  4007 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.501016  3951 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.500901  3973 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:37.517890  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.508167  3584 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.510710  3868 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.511497  3801 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.516100  3964 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.519594  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:37.530798  3539 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.523794  3731 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.538715  3876 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.531733  3868 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.520123  3973 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.553701  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:37.555294  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:37.527662  3801 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:37.520969  3584 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.537715  3544 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.514055  3979 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:37.563570  3962 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.576105  3989 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.575840  3544 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.584385  1527 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:37.590799  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1485) took 1975 ms. Trace:
I20260709 13:00:37.558931  3974 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.595254  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:37.601845  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.042s	sys 0.072s
I20260709 13:00:37.551035  1600 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.607337  1607 rpcz_store.cc:276] 0709 13:00:35.615712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.615866 (+   154us) service_pool.cc:224] Handling call
0709 13:00:35.616154 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.723630 (+107476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.723662 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.723703 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:35.723733 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.590475 (+1866742us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540012fcd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:37.590528 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.590722 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246710528}
W20260709 13:00:37.609560  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.043s	sys 0.072s
I20260709 13:00:37.610666  1607 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:37.558246  3876 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.613008  1531 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
W20260709 13:00:37.585378  3921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.033s
I20260709 13:00:37.608939  3786 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.623399  3921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.014s	sys 0.033s
W20260709 13:00:37.637627  3901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.004s	sys 0.032s
W20260709 13:00:37.625121  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.031s
W20260709 13:00:37.642638  3901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.004s	sys 0.032s
I20260709 13:00:37.681450  3801 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.682313  3901 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:37.684809  3904 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:37.650331  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.032s
I20260709 13:00:37.609063  3989 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.706631  3790 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.690727  3904 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:37.649044  3786 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:37.736171  3851 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.725773  3904 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:38.021198  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.009s	sys 0.028s
W20260709 13:00:38.003925  1678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.020s	sys 0.033s
W20260709 13:00:38.156071  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.012s	sys 0.028s
W20260709 13:00:38.156479  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 1.1514e+06us
W20260709 13:00:38.157539  1678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.030s	sys 0.043s
I20260709 13:00:38.157644  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:38.123394  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.111183  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.013s	sys 0.021s
W20260709 13:00:38.102074  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.800405  1574 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.034s	sys 0.043s
W20260709 13:00:38.162986  1574 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.046s	sys 0.073s
W20260709 13:00:38.163295  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 1.13807e+06us
W20260709 13:00:37.885795  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.038s	sys 0.033s
W20260709 13:00:38.165411  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.040s	sys 0.038s
W20260709 13:00:38.160959  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.014s	sys 0.021s
W20260709 13:00:38.171554  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 1.15612e+06us
W20260709 13:00:38.196470  1573 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.091s (SENT)
I20260709 13:00:38.164525  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:37.875684  3992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.015s
W20260709 13:00:38.111456  3829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.018s	sys 0.015s
W20260709 13:00:38.154259  3804 consensus_meta.cc:287] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.000s
W20260709 13:00:38.131722  3797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.003s	sys 0.017s
W20260709 13:00:38.269317  3797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.003s	sys 0.018s
I20260709 13:00:37.842379  3831 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:38.111069  3964 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 13:00:38.269923  1543 tablet_copy_source_session.cc:215] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:38.270207  3964 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.273080  3786 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.963768  3539 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.290603  3539 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:38.291303  3973 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.001s
I20260709 13:00:38.291774  3964 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.269836  3831 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.292299  3964 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.212951  3851 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.293294  3851 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:37.878607  3868 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:38.211699  3992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.018s	sys 0.019s
W20260709 13:00:38.223117  2254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 679) took 4471 ms (client timeout 1964 ms). Trace:
W20260709 13:00:38.228055  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 1729) took 1531 ms (client timeout 1958 ms). Trace:
W20260709 13:00:38.295181  1683 rpcz_store.cc:269] 0709 13:00:36.696629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.696785 (+   156us) service_pool.cc:224] Handling call
0709 13:00:38.227736 (+1530951us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540031bad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.227955 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949841664}
W20260709 13:00:38.217103  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 52621.4us
I20260709 13:00:38.234222  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.158861  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:38.241778  4010 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.262297  3942 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.264876  3969 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:38.107498  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.274168  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 1747) took 1462 ms (client timeout 1538 ms). Trace:
W20260709 13:00:38.313548  1676 rpcz_store.cc:269] 0709 13:00:36.812151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.820199 (+  8048us) service_pool.cc:224] Handling call
0709 13:00:38.273943 (+1453744us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400328cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.274098 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838409088}
I20260709 13:00:38.275956  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.217020  3989 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:38.281200  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1727) took 1625 ms (client timeout 1663 ms). Trace:
W20260709 13:00:38.315454  1525 rpcz_store.cc:269] 0709 13:00:36.656015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.656121 (+   106us) service_pool.cc:224] Handling call
0709 13:00:38.280967 (+1624846us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.281114 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510782848}
I20260709 13:00:38.282889  3911 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:38.321269  3911 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:38.322256  3911 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.323275  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1779) took 1965 ms. Trace:
I20260709 13:00:38.323803  3911 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.335071  3886 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:38.337497  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 416) took 4292 ms (client timeout 1632 ms). Trace:
W20260709 13:00:38.338009  2261 rpcz_store.cc:269] 0709 13:00:34.044704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.044833 (+   129us) service_pool.cc:224] Handling call
0709 13:00:38.337253 (+4292420us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b54007602d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.337407 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5987821824}
I20260709 13:00:38.341352  3851 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.302460  3868 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.344620  3868 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.314512  3969 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.348973  3969 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.350473  1603 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:00:38.350929  1603 pending_rounds.cc:85] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:00:38.351156  1603 pending_rounds.cc:107] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:00:38.351394  1603 raft_consensus.cc:2889] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.314853  2253 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:38.353535  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 432) took 1416 ms. Trace:
I20260709 13:00:38.354004  2253 rpcz_store.cc:276] 0709 13:00:36.937239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.117889 (+180650us) service_pool.cc:224] Handling call
0709 13:00:38.233995 (+1116106us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:38.353462 (+119467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22596352}
I20260709 13:00:38.291738  3973 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.356976  3923 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.323750  1601 rpcz_store.cc:276] 0709 13:00:36.357522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.357908 (+   386us) service_pool.cc:224] Handling call
0709 13:00:36.358252 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.521225 (+162973us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:36.659746 (+138521us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.791693 (+131947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.791757 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:36.791808 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.323017 (+1531209us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001bbcd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:38.323060 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.323208 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387,"prepare.queue_time_us":87821,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":2858,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":18069,"spinlock_wait_cycles":374306560,"thread_start_us":268055,"threads_started":2,"wal-append.queue_time_us":168601,"wal-append.run_cpu_time_us":937,"wal-append.run_wall_time_us":1001809}
I20260709 13:00:38.073527  4013 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.293689  3831 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:37.830036  3544 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:37.885524  3945 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.300984  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:38.358297  3904 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:38.289566  3829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.019s	sys 0.015s
W20260709 13:00:38.304948  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 146139us
I20260709 13:00:38.370822  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:38.307722  1680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.022s	sys 0.021s
W20260709 13:00:38.294956  3584 consensus_meta.cc:287] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.711s	user 0.004s	sys 0.007s
I20260709 13:00:38.057732  3951 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:38.296988  2254 rpcz_store.cc:269] 0709 13:00:33.751641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.752899 (+  1258us) service_pool.cc:224] Handling call
0709 13:00:38.222756 (+4469857us) spinlock_profiling.cc:243] Waited 3.36 s on lock 0x7b54003a1e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.222979 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7734650240}
I20260709 13:00:38.313231  3782 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.314751  2259 raft_consensus.cc:2376] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7. Re-sending same reply.
W20260709 13:00:38.387707  2259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 422) took 2229 ms (client timeout 2733 ms). Trace:
I20260709 13:00:38.325207  1543 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:56406 (request call id 331) took 5647 ms. Trace:
I20260709 13:00:38.292902  3539 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:37.971091  3962 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:38.348681  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1474) took 4635 ms (client timeout 1986 ms). Trace:
I20260709 13:00:38.353772  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 338) took 1985 ms. Trace:
I20260709 13:00:38.393338  1603 rpcz_store.cc:276] 0709 13:00:36.368015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.592751 (+224736us) service_pool.cc:224] Handling call
0709 13:00:38.350052 (+1757301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.351826 (+  1774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.353539 (+  1713us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54004547d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.353700 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4040634112}
W20260709 13:00:38.367890  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66980.4us
I20260709 13:00:37.799356  3777 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:38.362263  3575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.008s	sys 0.034s
I20260709 13:00:38.358455  3991 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:38.372040  1680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.022s	sys 0.021s
I20260709 13:00:38.356964  3973 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.368624  3923 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.377084  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1777) took 2023 ms. Trace:
W20260709 13:00:38.378396  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 425) took 2196 ms (client timeout 2240 ms). Trace:
W20260709 13:00:38.409315  2258 rpcz_store.cc:269] 0709 13:00:36.182014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.184760 (+  2746us) service_pool.cc:224] Handling call
0709 13:00:38.378227 (+2193467us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54005ddc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.378340 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52928896}
I20260709 13:00:38.381217  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:38.384164  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.417769  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.418470  1604 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:38.419333  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.384933  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.362540  3964 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.420225  1602 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:38.388146  2259 rpcz_store.cc:269] 0709 13:00:36.158409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.187267 (+ 28858us) service_pool.cc:224] Handling call
0709 13:00:38.275774 (+2088507us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:38.387631 (+111857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32496896}
W20260709 13:00:38.423172  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.422906  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:38.395198  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:38.392532  1608 rpcz_store.cc:269] 0709 13:00:33.712973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.713146 (+   173us) service_pool.cc:224] Handling call
0709 13:00:38.348368 (+4635222us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.348579 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5485549824}
I20260709 13:00:38.425884  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.426883  1608 raft_consensus.cc:2410] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:38.397370  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.368212  4013 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:38.398774  3575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.009s	sys 0.035s
I20260709 13:00:38.377766  3584 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.390516  3904 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.433897  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:38.441438  1608 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.450423  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:38.387364  3782 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:38.398232  3777 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:38.400050  3795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.018s	sys 0.045s
I20260709 13:00:38.407680  1606 rpcz_store.cc:276] 0709 13:00:36.353510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.353655 (+   145us) service_pool.cc:224] Handling call
0709 13:00:36.354012 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.452974 (+ 98962us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:36.653729 (+200755us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.785101 (+131372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.785156 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:36.785200 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.376769 (+1591569us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54004371d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:38.376826 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.377010 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155892,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":17453,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":17345,"spinlock_wait_cycles":227031808,"thread_start_us":266735,"threads_started":2,"wal-append.queue_time_us":173545,"wal-append.run_cpu_time_us":1090,"wal-append.run_wall_time_us":1001044}
I20260709 13:00:38.461027  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:38.469444  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:38.449782  3860 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.449506  3544 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.481253  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.490190  1606 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:38.485514  1607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.014s	sys 0.016s
I20260709 13:00:38.456580  3782 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:38.491739  1607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.015s	sys 0.016s
W20260709 13:00:38.468297  3795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.019s	sys 0.046s
I20260709 13:00:38.514870  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:38.459667  4011 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.494545  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.498721  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1676) took 1661 ms. Trace:
I20260709 13:00:38.531840  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:38.532682  1606 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:38.532255  1527 rpcz_store.cc:276] 0709 13:00:36.837488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.911126 (+ 73638us) service_pool.cc:224] Handling call
0709 13:00:38.498486 (+1587360us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b540008e3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:38.498648 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545031552}
W20260709 13:00:38.460299  3692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.022s	sys 0.041s
I20260709 13:00:38.514358  1601 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.538962  1606 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.474897  3905 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:38.541013  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46486.3us
I20260709 13:00:38.452642  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:38.515901  1608 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:38.517652  3731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.000s	sys 0.037s
W20260709 13:00:38.520704  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.054s	sys 0.069s
I20260709 13:00:38.488132  3860 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.529976  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1505) took 1274 ms. Trace:
W20260709 13:00:38.534706  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.008s	sys 0.021s
W20260709 13:00:38.552757  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.008s	sys 0.021s
W20260709 13:00:38.556128  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 939755us
W20260709 13:00:38.544922  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.054s	sys 0.069s
I20260709 13:00:38.558777  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:38.521440  3955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.036s	sys 0.137s
I20260709 13:00:38.560839  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:38.562050  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:38.390482  1543 rpcz_store.cc:276] 0709 13:00:32.683767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.687445 (+  3678us) service_pool.cc:224] Handling call
0709 13:00:34.389132 (+1701687us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b3b3f7 00007f7e68ad1036 00007f7e68adaa3e 00007f7e6039e27b 00007f7e68ada9ba 00007f7e68ad5acc 00007f7e68ad0c7b 00007f7e68ac58d1 00007f7e67b794b4 00007f7e67b79442
0709 13:00:38.269765 (+3880633us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e68ad11bb 00007f7e68adaa3e 00007f7e6039e27b 00007f7e68ada9ba 00007f7e68ad5acc 00007f7e68ad0c7b 00007f7e68ac58d1 00007f7e67b794b4 00007f7e67b79442
0709 13:00:38.325132 (+ 55367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7461743744}
I20260709 13:00:38.548619  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.549165  1678 rpcz_store.cc:276] 0709 13:00:37.255455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.255571 (+   116us) service_pool.cc:224] Handling call
0709 13:00:37.255864 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.256055 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:38.158039 (+901984us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.529577 (+371538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.529639 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:38.529687 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.529760 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.529905 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":1257476,"threads_started":2}
W20260709 13:00:38.535099  3813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.033s	sys 0.054s
W20260709 13:00:38.577812  3813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.033s	sys 0.055s
W20260709 13:00:38.573484  3955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.036s	sys 0.138s
I20260709 13:00:38.580490  3777 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.582100  3777 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.577805  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:38.563148  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:38.587839  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.020s	sys 0.010s
I20260709 13:00:38.576826  1683 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:38.536677  3801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.006s	sys 0.017s
I20260709 13:00:38.573817  1603 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:00:38.532533  3962 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.597545  1675 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:38.472604  3979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.008s	sys 0.014s
I20260709 13:00:38.470651  3968 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:00:38.609607  4007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.000s	sys 0.030s
I20260709 13:00:38.583335  1679 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:38.540580  3986 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:38.548290  3731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.000s	sys 0.037s
W20260709 13:00:38.613030  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 160491us
W20260709 13:00:38.703145  3979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.009s	sys 0.014s
W20260709 13:00:38.545353  3692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.022s	sys 0.042s
W20260709 13:00:38.615629  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.021s	sys 0.010s
W20260709 13:00:38.704643  4007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.000s	sys 0.031s
W20260709 13:00:38.615835  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.025s
W20260709 13:00:38.749893  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.000s	sys 0.025s
I20260709 13:00:38.659494  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:38.618768  3801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.007s	sys 0.017s
I20260709 13:00:38.610248  3983 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.611819  3911 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.610402  3829 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:38.663952  3951 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.541930  4011 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.661360  4016 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.692798  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.573544  3860 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.663328  3904 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:38.666712  3690 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.664354  3938 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.741130  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:38.696269  4032 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:00:38.546936  3905 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.755965  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.756837  1608 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:38.760219  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 100826us
I20260709 13:00:38.764812  3545 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.788463  3545 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:38.788846  3545 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:38.789002  4026 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:00:38.790659  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49627.9us
I20260709 13:00:38.761734  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 292) took 1489 ms. Trace:
I20260709 13:00:38.762744  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.794710  1601 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:38.743000  3964 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:38.776150  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1803) took 1369 ms. Trace:
W20260709 13:00:38.780690  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.016s
I20260709 13:00:38.780613  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:38.787995  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:38.796120  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.001s	sys 0.017s
I20260709 13:00:38.798468  1603 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:38.793607  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 324295us
I20260709 13:00:38.795184  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:38.760500  3911 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:38.786032  3705 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.795660  1607 rpcz_store.cc:276] 0709 13:00:37.406672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.616921 (+210249us) service_pool.cc:224] Handling call
0709 13:00:37.617434 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.617836 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:38.496843 (+879007us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.775738 (+278895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.775792 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:38.775840 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.775948 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.776083 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7549,"prepare.queue_time_us":1044955,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"thread_start_us":1149416,"threads_started":2}
I20260709 13:00:38.794337  1680 rpcz_store.cc:276] 0709 13:00:37.272714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.272849 (+   135us) service_pool.cc:224] Handling call
0709 13:00:37.273175 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.273411 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:38.399783 (+1126372us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.761185 (+361402us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.761402 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.761444 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.761486 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.761550 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.761662 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1305650,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":825,"spinlock_wait_cycles":5918592,"thread_start_us":1482060,"threads_started":2}
I20260709 13:00:38.801914  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:38.800594  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.791392  4029 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:38.790870  3905 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.801226  3692 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:38.807039  4020 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:00:38.765347  3829 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.801267  3911 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.817449  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.818535  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:38.818739  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.821658  1677 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:00:38.821821  2261 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:38.806792  3972 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:38.795679  3901 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.829166  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:38.830075  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:38.785894  3904 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.784034  4016 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.797907  3731 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:00:38.793567  4013 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:38.804543  3544 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:00:38.806381  3983 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:00:38.826680  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.827869  4010 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.824620  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.801254  3964 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.854171  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.855815  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.828859  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.856423  3964 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:38.837643  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.836759  4028 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.857589  2261 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:00:38.838516  4017 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:00:38.819829  3883 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:38.845562  2258 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:38.840502  4035 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:00:38.861807  3829 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:38.870746  3969 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.005s
I20260709 13:00:38.871246  3969 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:38.862233  2255 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.863819  4016 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:38.866966  4034 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:38.875322  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.873489  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:38.876446  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:38.870960  3545 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.876756  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:38.878291  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.878476  3782 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.835007  3972 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.882126  3972 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:38.875583  3815 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.883189  4011 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:38.887496  3815 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.891250  3860 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.895222  3584 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.892587  3900 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.896390  3900 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.897667  3969 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.872264  3911 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:38.892863  3905 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:38.899344  3900 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:38.895085  3886 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 13:00:38.903507  3835 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.904810  3835 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:38.905536  4024 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.239s	user 0.000s	sys 0.003s
I20260709 13:00:38.907226  3860 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.908092  3905 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:38.949082  1428 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.954612  1428 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 1 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:00:38.775540  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.014s
W20260709 13:00:38.957525  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.018s
W20260709 13:00:38.959687  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.964816  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 311) took 12164 ms (client timeout 15000 ms). Trace:
I20260709 13:00:38.971405  1428 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 3 to 4, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 4 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.974270  1428 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.975253  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:38.965420  1430 rpcz_store.cc:269] 0709 13:00:26.800760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.800934 (+   174us) service_pool.cc:224] Handling call
0709 13:00:38.964558 (+12163624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:33.771432 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:33.858664 (+ 87232us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:33.858728 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:00:33.858746 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:33.860167 (+  1421us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:33.860251 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:33.860281 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:00:33.861642 (+  1361us) tablet.cc:701] Row locks acquired
0709 13:00:33.861706 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:00:33.861913 (+   207us) write_op.cc:270] Start()
0709 13:00:33.862073 (+   160us) write_op.cc:276] Timestamp: P: 1783602033861839 usec, L: 0
0709 13:00:33.862095 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:33.862910 (+   815us) log.cc:844] Serialized 6372 byte log entry
0709 13:00:35.466907 (+1603997us) op_driver.cc:464] REPLICATION: finished
0709 13:00:35.692542 (+225635us) write_op.cc:301] APPLY: starting
0709 13:00:35.707449 (+ 14907us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:35.733990 (+ 26541us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:35.771017 (+ 37027us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:36.109905 (+338888us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:36.110316 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:00:36.110365 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:36.110851 (+   486us) log.cc:844] Serialized 113 byte log entry
0709 13:00:36.129147 (+ 18296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.145066 (+ 15919us) write_op.cc:454] Released schema lock
0709 13:00:36.161742 (+ 16676us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:36.282263 (+120521us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.332674 (+ 50411us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10693,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":197849,"apply.run_cpu_time_us":6608,"apply.run_wall_time_us":540168,"num_ops":16,"prepare.queue_time_us":380743,"prepare.run_cpu_time_us":16873,"prepare.run_wall_time_us":301155,"raft.queue_time_us":939693,"raft.run_cpu_time_us":27436,"raft.run_wall_time_us":100504,"replication_time_us":1604593,"thread_start_us":1408695,"threads_started":4,"wal-append.queue_time_us":314755,"wal-append.run_cpu_time_us":34254,"wal-append.run_wall_time_us":3008386}]]}
I20260709 13:00:38.986894  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:38.989236  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.019886  1526 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:39.020627  1674 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:38.990795  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:38.991179  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1663) took 2326 ms. Trace:
I20260709 13:00:38.993762  1534 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:38.994552  1528 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:38.995745  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.021622  1530 rpcz_store.cc:276] 0709 13:00:36.664514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.755933 (+ 91419us) service_pool.cc:224] Handling call
0709 13:00:36.756189 (+   256us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:36.792266 (+ 36077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.792322 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:36.798437 (+  6115us) log.cc:844] Serialized 52 byte log entry
0709 13:00:36.961675 (+163238us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:38.165820 (+1204145us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.990568 (+824748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.990713 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.990784 (+    71us) raft_consensus.cc:1685] finished
0709 13:00:38.990795 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.990985 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202539,"prepare.queue_time_us":42570,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":117,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":11931,"thread_start_us":1918829,"threads_started":3,"wal-append.queue_time_us":929095,"wal-append.run_cpu_time_us":2292,"wal-append.run_wall_time_us":1019568}
I20260709 13:00:39.024206  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:38.997169  1533 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:39.026079  2253 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.029410  2257 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:39.010793  1604 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:39.010802  1602 raft_consensus.cc:2368] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
W20260709 13:00:38.833460  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.012475  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1781) took 2652 ms. Trace:
I20260709 13:00:39.014465  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:39.016238  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.016521  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 341) took 2053 ms. Trace:
I20260709 13:00:38.829851  1679 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:38.988047  1428 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:39.052414  1609 rpcz_store.cc:276] 0709 13:00:36.963120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.475378 (+512258us) service_pool.cc:224] Handling call
0709 13:00:37.510925 (+ 35547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.520509 (+  9584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.520598 (+    89us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:37.521594 (+   996us) log.cc:844] Serialized 52 byte log entry
0709 13:00:38.013791 (+492197us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.616161 (+602370us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.701095 (+ 84934us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.752380 (+ 51285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.752472 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.887671 (+135199us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18003b9bc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:39.015906 (+128235us) raft_consensus.cc:1685] finished
0709 13:00:39.015955 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.016235 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133933,"prepare.queue_time_us":732466,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2389,"raft.queue_time_us":178589,"raft.run_cpu_time_us":727,"raft.run_wall_time_us":17565,"spinlock_wait_cycles":9502464,"thread_start_us":948955,"threads_started":2,"wal-append.queue_time_us":1347410}
I20260709 13:00:39.055888  3860 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.024041  1532 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:00:39.022818  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.057169  3973 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.057541  1608 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:39.058957  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.059741  1608 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:39.025907  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.056849  3860 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.056962  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:39.046868  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.011s
I20260709 13:00:39.059930  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.063787  2259 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:39.065124  2260 raft_consensus.cc:2410] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:39.066226  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.012s
I20260709 13:00:39.067082  3876 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:39.068090  3876 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.069983  1607 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:39.059625  3967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.012s	sys 0.012s
I20260709 13:00:39.072263  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:39.047029  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 225635us
I20260709 13:00:39.078615  2252 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:39.067282  3964 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.084436  3835 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.085536  3979 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:39.086108  3979 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.086529  3979 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.088418  2255 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:39.065064  3584 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.108930  3584 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.111549  3584 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:39.090700  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 266301us
I20260709 13:00:39.113066  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:39.113615  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.114087  1608 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.117398  3905 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.093091  1609 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.093050  2258 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:39.093802  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:39.082561  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57106.9us
I20260709 13:00:39.126003  1603 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:39.051923  1605 rpcz_store.cc:276] 0709 13:00:36.360140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.366813 (+  6673us) service_pool.cc:224] Handling call
0709 13:00:36.367160 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:36.389144 (+ 21984us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:36.389173 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:36.406035 (+ 16862us) log.cc:844] Serialized 52 byte log entry
0709 13:00:38.405275 (+1999240us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800293500. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:38.784545 (+379270us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:38.784605 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.784788 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.011522 (+226734us) raft_consensus.cc:1685] finished
0709 13:00:39.011569 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.012150 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54430,"raft.queue_time_us":34770,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":36660,"spinlock_wait_cycles":3597696,"thread_start_us":378975,"threads_started":1,"wal-append.queue_time_us":2440366}
I20260709 13:00:39.095999  2261 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:39.059302  3904 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:39.056252  1428 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:39.102726  3782 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:39.104383  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.105808  3860 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.153875  1428 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.157660  1428 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.111706  3911 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:39.081912  2252 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:39.092344  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.143518  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.144259  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.144821  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.148072  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.143563  3545 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.145920  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:39.149298  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1485) took 3307 ms (client timeout 1816 ms). Trace:
I20260709 13:00:39.144265  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.152323  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.106786  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.160660  3731 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.161336  3904 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:39.162972  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 691) took 2766 ms (client timeout 3253 ms). Trace:
I20260709 13:00:39.140555  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.190526  2256 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:39.197902  2256 pending_rounds.cc:85] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 6
I20260709 13:00:39.198091  3584 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.198508  3584 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.198833  3584 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.200177  3904 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.192122  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:39.192579  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48501us
I20260709 13:00:39.193478  4062 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.203001  1676 raft_consensus.cc:2410] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:39.190555  2259 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
W20260709 13:00:39.196568  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48805us
I20260709 13:00:39.205484  1609 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:39.197459  2260 rpcz_store.cc:269] 0709 13:00:36.396410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.715442 (+319032us) service_pool.cc:224] Handling call
0709 13:00:39.162677 (+2447235us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54001ecb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:39.162884 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5323816704}
I20260709 13:00:39.208539  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:39.204238  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 112163us
I20260709 13:00:39.210062  3860 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.210937  4063 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.210935  3860 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.217914  2253 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:39.219194  3860 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.202929  2256 pending_rounds.cc:107] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:39.210263  1428 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:39.163684  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 621976us
W20260709 13:00:39.189798  1674 rpcz_store.cc:269] 0709 13:00:35.842172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.844864 (+  2692us) service_pool.cc:224] Handling call
0709 13:00:39.149037 (+3304173us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b54001090d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:39.149205 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6710148352}
I20260709 13:00:39.221725  2256 raft_consensus.cc:2889] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.195500  2252 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.225188  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.225566  4036 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.226963  4030 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.227416  4030 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.227785  4030 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.228118  4028 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.229156  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87db66ba9ff145009d8e513e5d0ef1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:39.231948  3905 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:39.232686  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.236536  3690 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.236112  3731 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.236999  3690 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.240573  3690 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.242121  3731 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.238104  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 424) took 2955 ms. Trace:
I20260709 13:00:39.238288  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.239537  3815 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:39.246697  3815 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:39.236246  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
W20260709 13:00:39.219184  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 519542us
I20260709 13:00:39.243673  2256 rpcz_store.cc:276] 0709 13:00:36.283152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.818372 (+535220us) service_pool.cc:224] Handling call
0709 13:00:39.162901 (+2344529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.236562 (+ 73661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.237844 (+  1282us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54001ecb50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:39.238018 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5390884736}
I20260709 13:00:39.249567  1605 raft_consensus.cc:606] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.250010  1605 raft_consensus.cc:614] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:39.244755  3860 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.250912  3860 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.256171  1675 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:39.248389  3815 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:39.248637  3876 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:39.262295  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.263532  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b26794ff1394cec94107fd122031015"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:39.263926  3815 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.268379  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.260957  2252 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.273618  1605 raft_consensus.cc:606] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.280256  4063 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.282542  3829 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.283910  3905 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:39.285435  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 158746us
I20260709 13:00:39.288177  1605 raft_consensus.cc:614] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:39.288051  4063 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.296372  4063 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.296905  1609 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:39.297726  3904 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:39.285224  3835 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:39.298442  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.299118  1674 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.296406  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.302462  1607 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:39.304826  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.308079  3886 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:39.308455  1603 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:39.308717  3886 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:39.310055  3886 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.311314  4013 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:39.311751  3886 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.312081  4013 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:39.313594  4013 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.313810  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:39.315408  1600 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:39.318392  1601 raft_consensus.cc:606] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.322428  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:39.331681  4036 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.332490  4036 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.333124  4013 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.331319  3835 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:39.334971  4036 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.336658  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.340015  3876 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.340603  3876 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.341077  3876 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.341941  4030 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.344656  1674 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:39.340065  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:39.355619  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.356379  1676 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.372661  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.377872  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.379426  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.380270  3584 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:39.386559  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.386286  4030 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.387539  3964 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.391042  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.391714  1607 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.350211  3979 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.393464  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.388083  3904 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.395350  3904 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.398062  1601 raft_consensus.cc:606] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.398589  1601 raft_consensus.cc:614] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:39.401654  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.387356  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.389218  3544 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:39.407904  3860 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.387841  4036 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.408828  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.409332  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.410125  1532 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:39.413976  3904 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.415654  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.418931  4062 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.421777  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.423295  4030 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.423734  4030 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.424410  4028 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:39.424134  4030 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:39.409005  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64431.6us
I20260709 13:00:39.435220  1676 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:39.441300  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.442804  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.445645  4036 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.446153  4036 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.446303  3774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 411) took 8208 ms. Trace:
I20260709 13:00:39.446614  4036 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.446996  3774 rpcz_store.cc:276] 0709 13:00:31.244797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.279107 (+ 34310us) service_pool.cc:224] Handling call
0709 13:00:31.381935 (+102828us) ts_tablet_manager.cc:934] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:39.227197 (+7845262us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:39.357965 (+130768us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:39.358091 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:39.444886 (+ 86795us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:39.445434 (+   548us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:39.445941 (+   507us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:39.446167 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":76709,"tablet-copy.queue_time_us":70565,"thread_start_us":157807,"threads_started":2}
I20260709 13:00:39.437101  4028 raft_consensus.cc:2764] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:39.452579  1603 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:39.451918  3584 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.452826  3774 tablet_copy_client.cc:806] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:39.429929  3979 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.442942  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.453118  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:39.456899  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 116969us
I20260709 13:00:39.462182  1679 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:39.463524  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.465581  3835 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.467723  2227 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.469607  1607 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:39.471125  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.468889  3835 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.471565  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:39.472270  3835 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.472733  3835 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.474001  4028 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:39.474550  4028 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:39.476969  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.415380  4063 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:39.481644  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.431733  3690 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.486552  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.475625  4028 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.484020  3774 tablet_copy_client.cc:670] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:39.494469  1532 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:39.494614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.498545  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.458102  4062 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:39.492548  3979 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:39.506160  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53166.1us
I20260709 13:00:39.506480  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.506987  1676 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.510191  3584 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.522500  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.525331  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.527670  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.529675  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.530381  1680 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.529709  1677 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.533722  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:39.536913  4068 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:39.542430  3801 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.542979  3905 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:39.543430  3905 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:39.544633  3905 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.546075  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:39.546562  3905 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.547281  3835 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.549909  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.550274  3835 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.551302  1683 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:39.543205  3801 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.556915  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.557641  1607 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
W20260709 13:00:39.558073  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.560431  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.561900  3801 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.563429  1677 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:39.565605  1679 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:39.567056  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.571664  4063 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.570461  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.574746  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:39.574856  1608 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.576719  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.577523  3964 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.577877  3964 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.578052  1675 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:39.579119  3964 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.579154  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.573670  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.583257  1682 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:00:39.584511  3801 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.583679  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:39.556952  4067 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:00:39.590587  3584 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.603363  1608 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:39.604187  3801 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:39.606410  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.611207  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.618430  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.608435  3545 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:39.622258  3545 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:39.622985  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.619596  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.624267  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.625607  1675 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:39.629908  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 69982.6us
I20260709 13:00:39.630398  1675 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.634299  1681 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:39.635960  1681 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:39.637832  3690 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.640344  1573 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.641587  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.642403  1601 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:39.642325  3851 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:39.642905  3851 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.643280  3851 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.604918  3801 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.636905  4036 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:39.621259  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2456475149999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:00:39.657514  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2456475149999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:00:39.658598  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1538475149999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:00:39.659008  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1520475149999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:00:39.659329  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1502475149999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:00:39.659809  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0296475150000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:00:39.623297  3545 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:39.668599  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53272.3us
I20260709 13:00:39.669786  3801 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.670674  3801 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:39.671270  3801 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:39.671622  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.670934  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.674841  3967 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:39.677030  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.677767  1601 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:39.657809  1679 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:39.675592  4030 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.612993  3964 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.689483  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.690207  2256 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:39.691336  3964 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.693117  3876 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.675823  3967 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.686146  3801 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.706204  2256 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.706909  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.707777  2261 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:39.708297  2254 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:39.708526  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.708631  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.709399  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.706257  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.710268  3955 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:39.709776  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.669122  3973 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:39.712926  3973 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.717386  2256 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEARNER]: Advancing to term 3
I20260709 13:00:39.720754  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.722222  2259 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:39.722645  2254 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:39.709745  1607 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:39.711032  3955 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:39.716010  3973 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.692093  3964 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:39.727113  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:39.744498  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59164.9us
I20260709 13:00:39.731930  2256 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:00:39.745456  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58036.7us
I20260709 13:00:39.745779  1674 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:39.738920  3979 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.749233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.767150  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.768707  1600 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:39.745653  4071 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:39.743681  4049 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:39.742143  3964 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:39.775781  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:39.777078  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 105585us
I20260709 13:00:39.741801  4030 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.749219  3876 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.781446  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:39.792913  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.794770  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.797051  2256 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:39.745613  3938 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:39.801506  1607 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:39.800165  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 129304us
I20260709 13:00:39.781235  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.803620  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:39.799311  3860 raft_consensus.cc:2764] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:39.813213  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.731992  3955 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.809681  3705 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.823091  3705 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.823494  3705 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.811823  2252 raft_consensus.cc:2376] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5. Re-sending same reply.
I20260709 13:00:39.819118  3851 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.810585  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.821126  3964 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.826422  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.811609  3876 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.836166  2256 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.837345  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.838653  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.838842  3851 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:39.839313  2255 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.844074  4077 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:39.849459  4077 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:39.850234  4077 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.835054  4036 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.860667  2253 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:39.861120  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.844900  3964 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.836474  3938 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:39.862757  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 209560us
I20260709 13:00:39.825232  3979 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:39.871569  2256 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:39.871819  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68259.4us
W20260709 13:00:39.875646  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70405.4us
I20260709 13:00:39.878160  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.879164  2258 raft_consensus.cc:2376] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7. Re-sending same reply.
I20260709 13:00:39.880177  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.881000  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.881889  2252 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:39.882835  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:39.883764  2252 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:39.885365  1601 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:39.887137  4030 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:39.889322  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 89274.2us
I20260709 13:00:39.890260  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.891464  3860 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.893092  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.889542  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:39.895107  1676 raft_consensus.cc:1217] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:00:39.895323  1530 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.895771  1678 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.880493  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.896706  3979 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.895625  1676 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:39.898164  2257 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:39.898545  2257 pending_rounds.cc:85] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 5
I20260709 13:00:39.898797  2257 pending_rounds.cc:107] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:39.899048  2257 raft_consensus.cc:2889] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.863668  3938 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:39.895992  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:00:39.900712  3876 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:39.902544  1674 raft_consensus.cc:606] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:39.902812  3876 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:39.903875  3876 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:39.904235  3851 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:39.905303  3876 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.907244  4078 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:39.897135  3979 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.907966  4078 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:39.908629  3979 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.911286  4078 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:39.912962  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.913609  1676 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:39.913690  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:39.915132  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:39.915725  1534 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.916105  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:39.900213  2258 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:39.917290  4036 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:39.902190  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:39.918516  3905 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.918900  3905 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.919126  1674 raft_consensus.cc:614] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:39.919294  3905 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.902211  3938 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.920871  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:39.922483  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:39.923240  4049 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.923624  4049 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.923939  4049 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.917762  4036 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:39.925603  4036 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.925065  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.928959  1674 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:39.917613  4078 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.929912  4078 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.930015  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:39.930402  4078 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.930717  1676 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:39.932840  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.923831  3860 raft_consensus.cc:2764] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:39.933663  1674 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:39.933985  3860 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:39.934621  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:39.935978  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.936514  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.937198  1678 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.895690  1500 leader_election.cc:400] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:00:39.886780  4077 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:39.955848  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63949.2us
I20260709 13:00:39.957340  1600 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:39.939435  1608 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:39.960299  1534 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:39.961709  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:39.964907  2256 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:39.964076  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:39.973397  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:00:39.972862  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:39.975724  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.976334  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.980871  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:39.981654  1603 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.982038  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:39.933187  2255 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:39.989274  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:39.991987  1674 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.987228  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:39.963140  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:39.994709  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 99094.7us
I20260709 13:00:40.021102  1676 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
W20260709 13:00:40.025709  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50388.9us
W20260709 13:00:40.031746  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.036257  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49127.3us
W20260709 13:00:40.038880  4086 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:40.040046  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:40.039935  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.042356  1600 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:40.042786  1600 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:39.990592  4030 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.042781  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:39.963868  4063 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:00:40.048475  3584 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.049188  3584 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:40.049554  3705 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:40.047297  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 82849.5us
I20260709 13:00:40.052444  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.052917  3860 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.051913  3584 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:40.053061  1534 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:40.053939  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.054418  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.055075  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.046717  1533 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:40.055382  3851 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:40.055837  2254 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:40.056939  3851 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.058022  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.058660  1529 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.059070   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:40.060794  4077 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:40.061645   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:40.063019  3938 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:40.065198  4063 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:40.065574  4063 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:40.066540  4063 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.067945  4063 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.036861  2253 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.069074  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.069809  1606 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 2.
I20260709 13:00:40.070591  3973 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.981554  3801 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:00:40.073513  4030 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:40.074862  1534 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:40.053646  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.075871  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.078747  3860 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:40.078970  1605 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.080252  1526 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:40.081190  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.081851  1526 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:40.081979  1529 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:40.082583  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.082943  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.083621  1529 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:40.084554  1531 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:40.085143  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.085639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.086254  3705 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.086787  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.087013  3705 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.087450  3860 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.087991  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.086767  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.092074  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.093022  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.093737  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.112649  1609 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.074484  4030 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.097295  1602 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:40.097965  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.043821  3955 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:40.100353  1607 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:40.102315  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.055013  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.115849  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.108907  1528 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:40.083657  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.105677  1600 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.052126  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.114289  1606 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.116140  1604 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.118656  1525 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.120790  4028 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.120975  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:40.109232  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69389.5us
I20260709 13:00:40.121459  4028 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.121876  4028 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.124125  3962 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.129523  4028 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.131505  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.131898  1526 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:40.133044  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.133724  1526 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:40.134573  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.135284  1526 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:40.119357  4077 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.135938  4077 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:40.136327  4077 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.138065  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.138926  1532 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.140379  3801 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.144403  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.145047  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.145744  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.146528  1605 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.147432  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.148006  1605 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.154251  4049 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.169190  1604 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:40.169685  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:00:40.156417  1600 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.162106  1527 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:40.168081  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:39.993767  3905 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.172202  1526 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.181984  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.172430  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:40.185627  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59994.7us
I20260709 13:00:40.192559  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.193470  1525 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:40.194576  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:40.195879  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82221us
I20260709 13:00:40.196673  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:40.198455  1674 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:40.205858  1603 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:00:40.208571  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.185191  3955 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:40.213452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.218698  1603 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:40.114781  4036 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.222185  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.222942  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:40.222633  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:40.227474  1604 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.193392  4049 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:40.228735  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.232784  4036 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.234741  1531 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:40.168215  3973 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:00:40.236874  3955 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:40.207481  3801 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:40.282171  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.281320  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.284188  3876 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.287380  3876 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:40.207625  3967 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:00:40.198273  3584 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:00:40.288450  3876 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:40.289573  4028 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.289955  3876 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.290356  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:40.253055  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66243.5us
I20260709 13:00:40.291343  1525 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:40.292750  1525 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:00:40.294056  1525 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:40.298686  1532 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:40.223893  3835 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:40.304587  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 250236us
I20260709 13:00:40.305979  1526 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:40.306565  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:40.305531  1605 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:00:40.309458  4089 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:40.310971  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:40.310729  3979 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.311535  1527 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:40.312949  3979 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.313766  1527 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:40.314200  3851 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.314833  3851 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:40.319941  1525 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:40.277349  3911 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.229756  2253 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:40.249698  3905 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:40.324890  1528 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:40.326254  1605 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 3
I20260709 13:00:40.341230  1605 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:00:40.338045  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.342521  1525 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:40.329857  1529 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:00:40.252504  4062 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.356395  1605 raft_consensus.cc:2917] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:00:40.248198  4077 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.378158  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.355163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.381528  1607 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.379194  1605 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:40.315822  3851 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.297890  3545 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:40.320712  4036 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:40.354797  3876 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:40.380484  4062 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.390909  4062 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:40.395738  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 195176us
W20260709 13:00:40.415400  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 439978us
W20260709 13:00:40.416659  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.418102  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.418812  1525 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.396016  3973 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:40.396119  3876 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:40.428921  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 173982us
W20260709 13:00:40.430462  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 202381us
I20260709 13:00:40.434427  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.450778  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:40.443426  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.454404  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:40.459345  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.422708  3973 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:40.462483  1525 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:40.463186  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.473430  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50676.6us
W20260709 13:00:40.481154  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 249024us
I20260709 13:00:40.490518  3938 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:40.490833  2256 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:40.493206  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:40.491364  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:40.493912  1601 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.492481  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.464671  3905 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:40.464917  3584 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:40.508944  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66654.1us
I20260709 13:00:40.509945  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:40.511572  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.512436  1529 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.512660  4091 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.514817  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:40.515079  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:40.498015  3860 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.516350  3860 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:40.516763  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:40.517053  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:40.519205  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:40.520609  3876 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:40.521309  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:40.522143  1682 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:40.480765  3774 tablet_copy_client.cc:538] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.498881  2260 raft_consensus.cc:2368] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
W20260709 13:00:40.499678  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.500012  4082 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:40.502321  4078 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:00:40.449975  3815 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:40.506136  3911 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.515550  1675 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.524379  1608 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:40.529867  2258 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 2. Current term is 3. Ops: [2.4-2.4]
W20260709 13:00:40.500620  4085 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:40.539323  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:40.548957  2256 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:40.539901  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:40.543030  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.546645  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:40.550800  1682 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:40.551482  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52131.8us
I20260709 13:00:40.516762  3860 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.555493  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:40.503265  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:40.536666  3964 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:40.586397  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.597007  1681 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:40.549279  3911 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:40.606495  1529 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:40.589689  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.556113  4082 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:40.558210  3905 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:40.583210  3938 raft_consensus.cc:2764] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:00:40.611858  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74453.7us
I20260709 13:00:40.500160  3973 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.591346  4077 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.542054  4078 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:40.640939  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 128609us
I20260709 13:00:40.642555  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:40.609570  3911 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.601965  3964 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:40.650285  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.651562  1679 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:40.611160  4030 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:40.657429  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 115161us
I20260709 13:00:40.618500  3973 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.661367  1531 raft_consensus.cc:2368] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5.
I20260709 13:00:40.670043  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:40.671619  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 82026.4us
I20260709 13:00:40.672528  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.673789  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.674921  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.616498  4063 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:00:40.688292  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.688526  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88336.7us
I20260709 13:00:40.658300  4077 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.657526  4030 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:40.681708  3938 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:40.734371  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 91882.2us
I20260709 13:00:40.740751  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:40.737533  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48072.7us
W20260709 13:00:40.753387  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 78538.4us
I20260709 13:00:40.754498  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.687711  3905 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:40.760721  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 144425us
I20260709 13:00:40.768517  4122 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.769486  4122 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.748422  4077 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.772011  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.750494  4094 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.780134  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61087.3us
W20260709 13:00:40.781693  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 123274us
I20260709 13:00:40.782688  2227 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.770339  3979 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.779074  4102 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:40.774698  4115 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.730369  4082 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.799052  4078 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:40.799741  3962 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:40.800263  4112 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:40.800802  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:40.796293  4097 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:00:40.805491  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.806547  4127 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.807179  4119 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:40.808269  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:40.809093  3835 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.811661  1601 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:40.782820  4094 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:40.796662  4106 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:00:40.885455  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80038.7us
I20260709 13:00:40.846835  1675 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:40.851125  4062 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.764768  3964 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:40.855996  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:40.794665  4102 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:40.747285  4030 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:40.905653  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 97473.9us
I20260709 13:00:40.907761  2260 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:40.909101  3962 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:40.920404  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.910282  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.858456  3938 raft_consensus.cc:2764] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:40.910432  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 109752us
W20260709 13:00:40.912353  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 208390us
W20260709 13:00:40.908126  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 125517us
W20260709 13:00:40.910885  4087 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.571s	user 0.000s	sys 0.006s
I20260709 13:00:40.929975  1675 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.911499  4102 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.925875  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:40.972430  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:41.002271  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77552.8us
I20260709 13:00:41.004886  1601 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:41.000968  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61748.8us
I20260709 13:00:40.884690  4115 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 13:00:41.009734  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 98166us
W20260709 13:00:41.012106  4093 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.511s	user 0.000s	sys 0.003s
I20260709 13:00:40.926553  4117 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:41.009199  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:41.018445  1608 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.018608  4129 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:41.019011  4129 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.019325  4129 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.922374  4119 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:41.020637  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:41.021369  1606 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:41.021188  4119 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.014103  1527 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:41.013316  1498 leader_election.cc:400] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:41.025218  1498 leader_election.cc:403] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.026065  4078 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:41.028625  4126 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:41.029475  4105 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:41.031243  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:41.006497  3962 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.032155  1532 raft_consensus.cc:2410] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:41.017877  4018 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:41.033193  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:41.019171  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:41.032557  3962 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.035270  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:40.941087  4030 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.016028  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.033603  4018 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:41.045488  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 135283us
W20260709 13:00:41.048149  4111 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 13:00:41.049938  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.050331  3774 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:00:41.050753  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.051589  2257 raft_consensus.cc:2376] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6. Re-sending same reply.
I20260709 13:00:41.052708  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.053196  3860 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.053944  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:41.054664  2256 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:41.055471  3860 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:41.055930  3851 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:41.060527  4129 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.048246  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:41.055493  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.031379  4062 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:41.061457  4109 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.421s	user 0.006s	sys 0.000s
I20260709 13:00:41.072346  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:41.071305  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55362.4us
I20260709 13:00:41.075197  2258 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:41.047111  3938 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:41.043330  3973 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.115039  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1696) took 1022 ms. Trace:
W20260709 13:00:41.201043  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.111603  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 97466.1us
W20260709 13:00:41.130299  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.066926  3860 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:41.126164  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48231.6us
W20260709 13:00:41.077603  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 139204us
W20260709 13:00:41.244683  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 488266us
I20260709 13:00:41.036376  4131 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:41.092453  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46195.9us
W20260709 13:00:41.142153  4120 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:00:41.255019  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 193847us
I20260709 13:00:41.250171  1526 rpcz_store.cc:276] 0709 13:00:40.092956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.306792 (+213836us) service_pool.cc:224] Handling call
0709 13:00:40.307185 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:40.353283 (+ 46098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.353322 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:40.390523 (+ 37201us) log.cc:844] Serialized 52 byte log entry
0709 13:00:40.545887 (+155364us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:40.599926 (+ 54039us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.789876 (+189950us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.790302 (+   426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.790404 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.114762 (+324358us) raft_consensus.cc:1685] finished
0709 13:00:41.114783 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.114955 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72108,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":6108,"raft.queue_time_us":41708,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":25538,"spinlock_wait_cycles":60482304,"thread_start_us":333503,"threads_started":2,"wal-append.queue_time_us":262099}
I20260709 13:00:41.142047  4124 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.141827  4118 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:41.255787  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:41.171087  4087 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:00:41.189327  4100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.004s	sys 0.020s
W20260709 13:00:41.122614  4125 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:00:41.234661  2255 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:41.263288  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.171057  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.080874  4119 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:41.245172  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 119793us
I20260709 13:00:41.114461  4094 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:41.254354  3860 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:41.317927  4119 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:41.281493  4131 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:41.318610  3860 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.319800  3860 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.319630  4119 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.321341  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:41.324039  3584 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:41.325071  3584 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:41.288792  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:41.294412  4129 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:41.294771  4136 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:00:41.295774  4099 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.296209  4124 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:41.296386  4144 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:00:41.297094  4149 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.300844  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:41.272346  4062 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:41.333314  2258 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 3: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:41.332980  4062 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.337384  4062 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.332710  4149 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.330605  4099 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.331390  4124 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.333681  3964 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:41.341945  3964 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.344774  3964 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:41.330076  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52784.4us
I20260709 13:00:41.347810  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:41.290916  4100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.008s	sys 0.022s
I20260709 13:00:41.365850  4151 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:00:41.330271  4136 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:41.349502  3955 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.330263  3860 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:41.341291  4099 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.362418  4129 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.375897  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 710) took 1539 ms. Trace:
I20260709 13:00:41.363725  4115 consensus_queue.cc:1243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:41.326598  3584 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.368896  4136 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:41.374994  3860 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:41.403028  3860 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.403384  4136 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.380931  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 380) took 1518 ms. Trace:
I20260709 13:00:41.400158  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:41.375689  4018 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:41.410149  3911 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.003s
I20260709 13:00:41.377933  2261 rpcz_store.cc:276] 0709 13:00:39.834593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.834970 (+   377us) service_pool.cc:224] Handling call
0709 13:00:39.840722 (+  5752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.841137 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.841168 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.841614 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.196829 (+355215us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:40.557479 (+360650us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.367209 (+809730us) spinlock_profiling.cc:243] Waited 929 us on lock 0x7b180041bba0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aac733 00007f7e63b31dbf 00007f7e63b3083e
0709 13:00:41.373118 (+  5909us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b5400382fa0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aac733 00007f7e63b31dbf 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c
0709 13:00:41.373168 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.373244 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.373290 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:41.373301 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.373443 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20342,"prepare.queue_time_us":524323,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":181929,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":8762,"spinlock_wait_cycles":19361792,"thread_start_us":743965,"threads_started":3,"wal-append.queue_time_us":552360}
I20260709 13:00:41.410557  3911 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.411424  4102 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.373982  4127 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:41.408371  2259 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:41.372164  4149 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:41.408085  4091 raft_consensus.cc:993] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:00:41.412756  1533 rpcz_store.cc:276] 0709 13:00:39.859083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.859253 (+   170us) service_pool.cc:224] Handling call
0709 13:00:39.859867 (+   614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.873731 (+ 13864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.873766 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:39.877909 (+  4143us) log.cc:844] Serialized 590 byte log entry
0709 13:00:40.046589 (+168680us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:40.065603 (+ 19014us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.065825 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.065915 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.768115 (+702200us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:41.372917 (+604802us) raft_consensus.cc:1685] finished
0709 13:00:41.376806 (+  3889us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.376955 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20959,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":211,"spinlock_wait_cycles":32688384,"thread_start_us":168253,"threads_started":1,"wal-append.queue_time_us":350125}
I20260709 13:00:41.412722  2259 pending_rounds.cc:85] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 5
I20260709 13:00:41.422356  2259 pending_rounds.cc:107] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:41.422686  2259 raft_consensus.cc:2889] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.410104  2255 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:41.425146  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:41.433926  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50075.4us
I20260709 13:00:41.429193  3955 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:41.432910  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 386593us
I20260709 13:00:41.448714  2260 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:41.430485  4091 raft_consensus.cc:1081] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
W20260709 13:00:41.439832  4101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.007s	sys 0.005s
W20260709 13:00:41.441725  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.441396  3955 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:41.484207  4101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.007s	sys 0.005s
I20260709 13:00:41.323239  4131 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.439581  3911 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:41.491302  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:41.493896  4133 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:41.494678  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.472393  4030 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:00:41.448536  4146 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:41.491914  4147 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:41.441779  4155 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:41.450284  4136 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:41.507637  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54036.4us
W20260709 13:00:41.499125  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.424788  4127 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:41.496023  4156 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:41.528256  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:41.495221  3955 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:41.545047  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:41.508793  4155 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:41.493647  4091 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:00:41.497200  3860 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.552371  4149 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.565097  4149 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.566164  4149 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.568233  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 387) took 1101 ms. Trace:
I20260709 13:00:41.569070  3851 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.569896  3851 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.550990  3962 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:41.524528  3815 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:41.545998  3911 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:00:41.574980  3860 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.508756  4146 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.578156  4146 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:41.578423  4127 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.096113   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:41.549664  4155 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:41.583276  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1761) took 1508 ms (client timeout 1663 ms). Trace:
W20260709 13:00:41.583688  1534 rpcz_store.cc:269] 0709 13:00:40.074997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.075639 (+   642us) service_pool.cc:224] Handling call
0709 13:00:41.583062 (+1507423us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:41.583192 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777229696}
I20260709 13:00:41.585517  3938 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.589090  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:41.568807  1525 rpcz_store.cc:276] 0709 13:00:40.466589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.466749 (+   160us) service_pool.cc:224] Handling call
0709 13:00:40.467083 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.510399 (+ 43316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.510448 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:40.510503 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:40.510580 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.567932 (+1057352us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b54000b59d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:41.567984 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.568158 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98917120}
W20260709 13:00:41.604957  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 97653.7us
I20260709 13:00:41.608588  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:41.586067  3938 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:41.611178  1648 leader_election.cc:400] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5.
I20260709 13:00:41.624459  4150 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:41.624727  4142 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:00:41.625054  4150 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.625988  4150 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.626515  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.627149  4150 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.627669  4146 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:41.628060  4146 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.628401  4146 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.636672  4146 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.641064  4146 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.641010  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.645080  4146 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:41.650053  1606 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:41.646705  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.651156  4102 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:41.652333  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47361.8us
I20260709 13:00:41.653131  4169 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:41.653702  4169 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:41.654630  4169 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.658324  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:41.658627  4102 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:41.659121  1533 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.659621  4102 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:41.660068  4102 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.660688  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:41.661441  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:41.662127  1527 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.658210  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:41.664913  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:41.665210  1534 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:41.660094  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:41.661048  4102 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.666092  1525 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:41.666180  1532 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.670122  1528 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:00:41.683475  1527 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:41.684927  1533 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:41.650210  4146 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:41.651031  3938 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.693938  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.724776  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:41.730669  4159 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.731244  4159 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.727725  3938 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:41.736418  3938 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.717108  4102 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:41.749727  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.719627  4124 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:41.818636  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 139075us
I20260709 13:00:41.819119  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.821557  4159 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:41.826722  4094 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:41.827747  4094 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:41.828644  4094 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:41.836656  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.839956  4094 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:41.844071  4094 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:41.841887  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.845513  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.846359  4150 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:41.847102  4159 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.847605  4159 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.848542  4159 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.853058  4150 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.854789  4150 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.859175  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:41.860260  4100 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.860807  4100 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.861743  4100 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.865813  3955 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:41.866489  3955 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:41.876384  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55449.1us
I20260709 13:00:41.888494  4049 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:41.888862  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.893936  3955 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:41.895439  4134 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:41.895898  4134 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:41.820678  4124 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:41.938330  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60894.4us
I20260709 13:00:41.946955  1608 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:41.949128  3938 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:41.949620  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:41.950461  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:41.950980  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:41.928596  4124 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.951556  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:41.719545  4146 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:41.975270  1678 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:41.972127  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:41.977770  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:41.981164  1608 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:41.982395  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:41.949188  4108 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.175s	user 0.006s	sys 0.001s
I20260709 13:00:41.984838  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 462) took 1457 ms. Trace:
I20260709 13:00:41.997293  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:41.997601  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:41.998886  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:42.000249  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:42.005491  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:42.007704  4177 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:00:41.985252  2252 rpcz_store.cc:276] 0709 13:00:40.527385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.537164 (+  9779us) service_pool.cc:224] Handling call
0709 13:00:40.610173 (+ 73009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.924368 (+314195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.930804 (+  6436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.670304 (+739500us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:00:41.670721 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.820191 (+149470us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.875726 (+ 55535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.896654 (+ 20928us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.953259 (+ 56605us) raft_consensus.cc:1685] finished
0709 13:00:41.955865 (+  2606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.984771 (+ 28906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13589,"raft.queue_time_us":150184,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":7288576,"thread_start_us":293327,"threads_started":2,"wal-append.queue_time_us":259391}
I20260709 13:00:42.010653  4094 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:42.017997  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:41.908943  4082 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:00:42.044695  1574 leader_election.cc:400] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6.
I20260709 13:00:41.985020  4049 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:42.064280  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33528
I20260709 13:00:42.066412  1607 raft_consensus.cc:606] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:42.066741  1607 raft_consensus.cc:614] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:42.019793  4078 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.930490  4155 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.069859  4049 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.076021  1574 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:42.076687  1574 leader_election.cc:403] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:42.065085  4100 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:42.077836  4100 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.079698  3851 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5.
I20260709 13:00:42.081171  4100 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.084136  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:42.085378  4171 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:42.085951  4171 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:42.086975  4171 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.092749  3860 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:42.097188  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.098296  3860 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:42.099290  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.003s
W20260709 13:00:42.099946  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.004s
I20260709 13:00:42.101084  4091 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:42.040166  4094 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:42.052956  4159 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:42.068437  3938 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:42.075721  4129 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:42.014222  4134 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.145961  4150 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:42.145393  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.775s (SENT) [suppressed 25 similar messages]
I20260709 13:00:42.128216  4157 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:42.075555  4078 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:42.200039  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 103016us
W20260709 13:00:42.202754  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 183505us
I20260709 13:00:42.112654  4094 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:42.207041  4186 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:00:42.221340  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.206900  4129 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.215761  4189 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.204847  3938 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.211416  4150 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.202108  4159 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:42.239405  4176 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:00:42.238508  3860 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.256489  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.238335  4082 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:42.222463  4146 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:00:42.252715  4155 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:42.263379  4184 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:42.261472  4171 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:42.263006  4082 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.265126  4078 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.265714  4078 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.265952  4082 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.268740  3851 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:42.269824  3851 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:42.270282  4155 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.270725  4155 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:42.271868  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:42.273110  4180 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:00:42.273339  4159 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:42.278523  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.270807  3851 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.273114  4171 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.265656  4150 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:42.273427  4094 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:42.294241  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 148875us
I20260709 13:00:42.252279  4189 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:42.304718  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86764.1us
W20260709 13:00:42.311856  4183 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:42.314718  4129 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:42.279239  4078 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:42.331446  1480 auto_rebalancer.cc:893] Removing replace marker failed: Replica 428f0180c2cd487c8b48e91f14dff65d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 13:00:42.331943  1480 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:00:42.332198  4078 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.336694  1676 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:42.295755  3851 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:42.297258  3860 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.297823  4082 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:42.342084  1530 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:42.332204  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:42.346068  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.346804  1529 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:42.345371  4207 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:42.369005  1533 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:42.371610  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.372524  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.390564  1608 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:42.373202  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.373854  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.372548  1607 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:42.379774  2257 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:42.382220  3851 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.401645  4201 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:42.402776  4202 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.407953  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.414183  4139 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.418045  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.420522  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 722) took 1381 ms. Trace:
I20260709 13:00:42.421505  1681 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:42.397324  3973 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:42.431967  1683 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:42.424435  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:42.429903  4200 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:00:42.345727  3860 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.358121  4082 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.435274  4202 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.437453  3815 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:42.438092  3815 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:42.440636  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56308.5us
I20260709 13:00:42.430255  4207 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.446237  1532 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:42.451292  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:42.451756  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:42.452875  1532 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:00:42.454520  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.455421  1527 raft_consensus.cc:2410] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:42.457839  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.449424  3851 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.461798  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.462285  1532 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.466212  3938 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.469167  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.486297  1532 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.486862  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:42.488018  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:42.493050  1534 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:42.492623  1533 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:42.456220  4211 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.497694  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.497874  1532 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:00:42.500725  1526 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.435035  3973 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.509599  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.431380  2257 rpcz_store.cc:276] 0709 13:00:41.039122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.071007 (+ 31885us) service_pool.cc:224] Handling call
0709 13:00:42.379063 (+1308056us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:42.379309 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.394290 (+ 14981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.420454 (+ 26164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33655552}
I20260709 13:00:42.528723  1526 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.530150  4188 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.530889  4188 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.504069  4212 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:42.534866  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74880.3us
I20260709 13:00:42.436247  4201 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.536978  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.503630  4126 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.509722  4133 consensus_queue.cc:1243] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:42.468452  4049 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.543514  1534 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.520421  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 13:00:42.622159  1529 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.622539  1529 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.544358  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:42.566313  4190 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.313s	user 0.003s	sys 0.000s
I20260709 13:00:42.573256  1526 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:42.577790  4049 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.578239  4189 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:42.579198  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.580766  4201 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.534428  4202 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.583750  4082 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.585171  4207 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.533172  4188 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.593564  4155 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.515995  4211 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.645999  4211 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:42.604579  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 298629us
I20260709 13:00:42.648983  1600 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:42.649143  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.605633  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.649793  1603 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:42.650286  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44730.2us
I20260709 13:00:42.651729  4132 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:42.606719  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.538633  4063 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:42.653354  4063 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.654275  4132 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:42.604657  4094 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:42.655683  4063 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.563967  4114 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.616561  1607 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:42.617403  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66216.8us
I20260709 13:00:42.563261  4099 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.652194  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.625344  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.630301  1609 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:42.620937  4124 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.608s	user 0.003s	sys 0.009s
I20260709 13:00:42.641187  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:42.641835  4077 raft_consensus.cc:1064] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:42.662583  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.624586  4136 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.700804  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.711658  1609 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:42.697445  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:42.704846  1600 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:42.655766  4132 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:42.720867  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:42.722792  1600 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.736338  1600 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:42.736672  1675 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:42.722031  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:42.729352  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.733923  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:42.747628  1609 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:42.748138  1609 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:42.752153  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:42.752903  1679 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.697090  4129 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.737221  1600 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:42.716395  3774 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:00:42.752069  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 264401us
I20260709 13:00:42.773761  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:42.710904  4155 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.704789  4063 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:42.748967  1609 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.775180  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.719995  1529 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.705582  3815 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.637948  4146 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:00:42.847045  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:42.782399  1677 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:42.854352  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.820013  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:42.856668  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:42.857295  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 321252us
W20260709 13:00:42.833863  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.857837  1679 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.858932  1531 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:42.860140  1674 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:42.878713  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.641222  4206 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:00:42.846236  1534 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.850080  1600 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.891726  1526 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:42.558539  4126 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.736105  4132 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:42.885013  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:42.902381  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.848428  1609 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.886830  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.906400  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.778841  4129 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.907325  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.908473  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:42.892910  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:42.893523  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:42.773824  3860 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:42.710377  4124 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:42.744827  4028 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.896559  1529 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.704977  4099 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.722472  4136 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.912377  1674 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:42.911825  1683 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:42.753690  3962 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
W20260709 13:00:43.003158  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 263498us
I20260709 13:00:42.908600  4063 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:42.696722  4114 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:42.881381  3545 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:43.006389  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:43.065763  1534 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:43.066816  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:43.008062  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:43.067806  1532 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:43.008000  2260 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:42.913450  1677 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:43.011190  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:43.015038  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:43.070670  1683 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:43.072775  1674 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:43.063472  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:42.855821  4216 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.157s
I20260709 13:00:43.022078  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:43.023475  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:43.085391  1679 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.967257  1675 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.063269  1600 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:42.931265  4131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.022s
I20260709 13:00:43.017115  4099 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:43.077539  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.086680  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:43.091212  2256 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:42.970037  4127 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:42.939843  3860 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:43.061381  3973 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:42.774354  4119 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:00:42.852067  4211 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:00:43.254031  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.569258  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.192997  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.570576  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.571139  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.571558  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.572574  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.578099  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:43.603598  4119 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.604233  4119 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:43.606410  4119 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:43.606956  4119 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.607393  4119 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:43.618129  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 554680us
I20260709 13:00:43.188516  4132 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:43.620985  4132 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.623371  3860 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:43.625818  3860 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:43.079784  3545 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:43.627966  1680 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:43.175959  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:43.074345  4028 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:43.630563  4127 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:43.631589  1682 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:43.185392  4201 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.457s
I20260709 13:00:43.634421  1675 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:43.635936  1675 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:43.637387  1675 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:43.638672  1675 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:43.639865  1675 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:00:43.093729  4131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.006s	sys 0.033s
I20260709 13:00:43.641207  1530 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:43.641824  1608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.001s	sys 0.006s
W20260709 13:00:43.642208  1608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.001s	sys 0.006s
I20260709 13:00:43.179320  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:43.643566  1683 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:43.643870  1683 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:43.630059  1677 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:43.630017  3545 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:43.644608  1683 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:43.690128  1683 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.719265  1529 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:43.760514  1525 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:00:43.824643  1679 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.000s
I20260709 13:00:43.825150  1679 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:43.844120  1609 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.000s
I20260709 13:00:43.176245  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 462) took 1870 ms. Trace:
I20260709 13:00:43.690111  4082 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.587528  4124 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:43.369894  4219 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:43.858069  1609 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:43.859660  1529 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:43.549283  4230 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:43.904762  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1881) took 1157 ms. Trace:
I20260709 13:00:43.859660  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:43.088656  3911 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.680s
I20260709 13:00:43.094347  4102 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.739s
I20260709 13:00:43.736074  4136 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:43.905318  4230 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:43.905257  1609 rpcz_store.cc:276] 0709 13:00:42.746964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.747128 (+   164us) service_pool.cc:224] Handling call
0709 13:00:42.747494 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.904329 (+1156835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.904680 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.083066  4127 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.132931  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:44.133795  2254 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:44.134898  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:44.135501  2254 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:43.827394  3938 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:44.143220  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:44.144284  4218 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.302s	user 0.000s	sys 0.000s
I20260709 13:00:43.859858  4099 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.290850  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.011s	sys 0.060s
W20260709 13:00:44.160444  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.029s	sys 0.012s
W20260709 13:00:44.370253  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.030s	sys 0.023s
W20260709 13:00:43.874363  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.008s	sys 0.011s
I20260709 13:00:44.356490  1677 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:44.369252  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.011s	sys 0.063s
I20260709 13:00:44.394667  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 328) took 1317 ms. Trace:
I20260709 13:00:44.395329  1677 rpcz_store.cc:276] 0709 13:00:43.077515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.673508 (+595993us) service_pool.cc:224] Handling call
0709 13:00:44.356267 (+682759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.390572 (+ 34305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.394555 (+  3983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.368062  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1775) took 1885 ms. Trace:
I20260709 13:00:44.416569  1527 rpcz_store.cc:276] 0709 13:00:42.482835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.482951 (+   116us) service_pool.cc:224] Handling call
0709 13:00:42.531036 (+ 48085us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:42.531633 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.531680 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:42.532582 (+   902us) log.cc:844] Serialized 52 byte log entry
0709 13:00:42.895915 (+363333us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:42.895969 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.896041 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.145599 (+1249558us) raft_consensus.cc:1685] finished
0709 13:00:44.145639 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.367948 (+222309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95828,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":24791,"thread_start_us":362666,"threads_started":1,"wal-append.queue_time_us":654342}
W20260709 13:00:44.371316  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 511704us
I20260709 13:00:44.421706  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:44.136437  4224 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.423221  4224 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.425663  4224 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.426414  4224 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.427002  4224 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.529779  4225 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:44.530433  4225 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:44.461138  1647 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.007s	sys 0.002s
W20260709 13:00:44.533401  1647 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.008s	sys 0.002s
W20260709 13:00:44.171464  3774 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
W20260709 13:00:44.357163  3544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.001s	sys 0.006s
I20260709 13:00:44.126597  4172 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:44.390158  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.003s	sys 0.043s
W20260709 13:00:44.549701  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.004s	sys 0.043s
W20260709 13:00:44.550485  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.525032  1683 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.002s
I20260709 13:00:44.136540  4233 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:44.390282  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.008s	sys 0.017s
I20260709 13:00:44.368217  4129 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:44.146528  4114 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:44.388494  4119 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:44.534198  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 892428us
I20260709 13:00:44.408354  4230 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:44.482648  3851 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 2.000s	user 0.008s	sys 0.003s
I20260709 13:00:44.404645  4126 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:44.551441  1683 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:44.177340  3938 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:44.548712  2261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.004s	sys 0.010s
W20260709 13:00:44.593230  2261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.005s	sys 0.010s
I20260709 13:00:44.594260  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 466) took 2062 ms. Trace:
I20260709 13:00:44.407465  4099 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.542339  4082 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.154007  4219 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:44.544298  3544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.002s	sys 0.006s
I20260709 13:00:44.538162  4063 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:44.570762  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.001s	sys 0.013s
I20260709 13:00:44.599606  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1563) took 1572 ms. Trace:
I20260709 13:00:44.599905  1604 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:44.594630  2261 rpcz_store.cc:276] 0709 13:00:42.532267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.533327 (+  1060us) service_pool.cc:224] Handling call
0709 13:00:42.546521 (+ 13194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.556954 (+ 10433us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:42.887747 (+330793us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.593862 (+1706115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.593938 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.593984 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.594055 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.594198 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349789,"prepare.queue_time_us":448163,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":58,"raft.queue_time_us":642066,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3402,"thread_start_us":2024994,"threads_started":3,"wal-append.queue_time_us":1594022}
W20260709 13:00:44.626012  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.004s	sys 0.006s
I20260709 13:00:44.553575  4233 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:44.605213  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 985674us
W20260709 13:00:44.638341  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.009s	sys 0.017s
W20260709 13:00:44.641352  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.527s	user 0.006s	sys 0.012s
W20260709 13:00:44.637914  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.018s	sys 0.022s
I20260709 13:00:44.642379  1683 rpcz_store.cc:276] 0709 13:00:43.004644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.085880 (+ 81236us) service_pool.cc:224] Handling call
0709 13:00:44.576439 (+1490559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.643204  4231 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:44.645649  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.019s	sys 0.023s
W20260709 13:00:44.666224  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.666668  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.667107  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.606998  4228 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.639899  3774 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.627538  4230 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.605475  4119 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:44.673144  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 251458us
W20260709 13:00:44.626091  4234 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:00:44.678639  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.004s	sys 0.017s
W20260709 13:00:44.698360  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.004s	sys 0.018s
I20260709 13:00:44.594913  4237 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:00:44.639578  4233 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.603830  4114 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:00:44.591284  4172 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.574419  4028 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:44.667423  4126 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.689394  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.732803  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.001s	sys 0.020s
W20260709 13:00:44.734066  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.001s	sys 0.020s
I20260709 13:00:44.734938  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 399) took 1729 ms. Trace:
I20260709 13:00:44.735390  1528 rpcz_store.cc:276] 0709 13:00:43.005699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.005864 (+   165us) service_pool.cc:224] Handling call
0709 13:00:43.076297 (+ 70433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.076540 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:43.880936 (+804396us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.734550 (+853614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.734609 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:44.734660 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.734735 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.734862 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108752,"prepare.queue_time_us":540519,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":1116632,"threads_started":2}
I20260709 13:00:44.626767  4082 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.780963  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 395) took 2420 ms. Trace:
I20260709 13:00:44.781404  1530 rpcz_store.cc:276] 0709 13:00:42.360151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.360501 (+   350us) service_pool.cc:224] Handling call
0709 13:00:42.365329 (+  4828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.641609 (+1276280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.780717 (+1139108us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002cdb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:44.780897 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933703424}
I20260709 13:00:44.664887  2254 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:44.784543  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:44.785408  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1871) took 2138 ms. Trace:
I20260709 13:00:44.786197  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:44.786974  2254 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:44.789474  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1723) took 1905 ms. Trace:
I20260709 13:00:44.789975  1526 rpcz_store.cc:276] 0709 13:00:42.884480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.884618 (+   138us) service_pool.cc:224] Handling call
0709 13:00:42.891524 (+  6906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.892125 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.789229 (+1897104us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b54003066d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:44.789398 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15043840}
I20260709 13:00:44.678524  4188 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.673964  4231 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:44.704190  2261 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:44.745065  3774 tablet_bootstrap.cc:492] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:00:44.676967  4129 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:00:44.697314  4230 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:43.860751  2255 rpcz_store.cc:276] 0709 13:00:41.306978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.436082 (+129104us) service_pool.cc:224] Handling call
0709 13:00:41.448496 (+ 12414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.484953 (+ 36457us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:41.491080 (+  6127us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.641860 (+1150780us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.021099 (+379239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.026662 (+  5563us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.071657 (+ 44995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.080542 (+  8885us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.112240 (+ 31698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086150,"prepare.queue_time_us":424112,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":109,"raft.queue_time_us":1669712,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":79123,"spinlock_wait_cycles":1258554752,"thread_start_us":481697,"threads_started":2,"wal-append.queue_time_us":467739}
I20260709 13:00:44.748775  4229 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:44.750783  4172 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:44.752095  3938 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.686273  4228 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.733909  4126 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.752422  4250 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:44.773334  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1545) took 2833 ms (client timeout 1718 ms). Trace:
I20260709 13:00:44.757228  4099 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.753091  4244 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.753878  4249 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.754011  3544 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.752660  4247 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:44.871011  3938 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.777043  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1781) took 2290 ms. Trace:
I20260709 13:00:44.787945  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:44.780722  4082 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:44.762943  4153 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 2.340s	user 0.010s	sys 0.019s
I20260709 13:00:44.785830  1608 rpcz_store.cc:276] 0709 13:00:42.647357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.647472 (+   115us) service_pool.cc:224] Handling call
0709 13:00:42.647775 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.020858 (+373083us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:43.642541 (+621683us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.700987 (+1058446us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.737529 (+ 36542us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.737702 (+   173us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:44.737740 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.737821 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.785186 (+ 47365us) raft_consensus.cc:1685] finished
0709 13:00:44.785211 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.785348 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1730351,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":155649,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":20576,"thread_start_us":1535669,"threads_started":3,"wal-append.queue_time_us":719306}
I20260709 13:00:44.806526  4188 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:44.752285  4132 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.131s	user 0.004s	sys 0.004s
I20260709 13:00:44.758605  4219 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.754312  4245 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.752966  4028 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:44.759908  4255 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.931497  1648 connection.cc:256] RPC call timeout handler was delayed by -1.1711142319999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:00:44.842218  4171 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:44.869798  1676 rpcz_store.cc:269] 0709 13:00:41.940367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.942017 (+  1650us) service_pool.cc:224] Handling call
0709 13:00:44.773116 (+2831099us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54002242d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:44.773257 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883429760}
I20260709 13:00:44.766223  4157 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.765439  4224 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.758759  4225 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.763384  4256 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:44.921663  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:44.942687  1609 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:44.900755  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:44.774703  4233 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:44.870718  4172 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.903005  1533 rpcz_store.cc:276] 0709 13:00:42.486947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.499599 (+ 12652us) service_pool.cc:224] Handling call
0709 13:00:42.500006 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.609008 (+109002us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:42.609264 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.642488 (+ 33224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.642537 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.642577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.776778 (+2134201us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540008ded4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:44.776826 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.776978 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33005,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":33809,"spinlock_wait_cycles":281730560}
I20260709 13:00:44.869601  4250 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:44.842198  3774 ts_tablet_manager.cc:1403] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 3.792s	user 0.031s	sys 0.046s
I20260709 13:00:44.927367  4129 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:44.756099  4155 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.906s	user 0.010s	sys 0.000s
I20260709 13:00:44.844938  4229 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.946276  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:44.947558  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:44.944435  2261 raft_consensus.cc:2376] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7. Re-sending same reply.
I20260709 13:00:44.926273  4063 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.962296  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:44.933573  4028 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:44.965966  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1558) took 2061 ms (client timeout 1648 ms). Trace:
I20260709 13:00:44.967679  4240 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:44.970570  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 453) took 4501 ms. Trace:
I20260709 13:00:44.975149  4126 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:44.976785  4231 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.025759  4264 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.026324  4264 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.026381  3774 raft_consensus.cc:359] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:45.027454  3774 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:00:44.952739  4256 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.029081  1603 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:44.934212  4245 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.030656  3851 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.031190  3851 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:44.975157  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.031813  4245 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:44.898980  3544 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.032280  2259 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
W20260709 13:00:45.033041  2259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 471) took 2462 ms (client timeout 2021 ms). Trace:
I20260709 13:00:45.033800  3544 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:44.986394  4230 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:44.987552  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:44.923628  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1636189139999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:00:45.030068  4224 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.035795  4224 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.036199  4224 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.036756  4256 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:45.037364  1647 leader_election.cc:336] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.775s (SENT)
I20260709 13:00:45.038791  4233 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:44.923029  3938 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:45.033392  2259 rpcz_store.cc:269] 0709 13:00:42.571036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.571179 (+   143us) service_pool.cc:224] Handling call
0709 13:00:44.975000 (+2403821us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:45.032947 (+ 57947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89837440}
I20260709 13:00:45.020263  4063 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.020618  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.020725  4228 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.010310  2253 rpcz_store.cc:276] 0709 13:00:40.469026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.481509 (+ 12483us) service_pool.cc:224] Handling call
0709 13:00:40.747872 (+266363us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:00:40.758905 (+ 11033us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.006639 (+247734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.009083 (+  2444us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.116599 (+107516us) log.cc:844] Serialized 52 byte log entry
0709 13:00:41.364472 (+247873us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.397709 (+ 33237us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.442901 (+ 45192us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.422077 (+979176us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18003ed6a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:42.466554 (+ 44477us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18003ed6a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:00:42.466745 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.466836 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.762260 (+2295424us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:44.970247 (+207987us) raft_consensus.cc:1685] finished
0709 13:00:44.970273 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.970475 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95277,"prepare.queue_time_us":31966,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":3800,"raft.queue_time_us":1092904,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":14047,"spinlock_wait_cycles":53254016,"thread_start_us":312579,"threads_started":2,"wal-append.queue_time_us":199070}
I20260709 13:00:44.902598  4247 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.021512  4250 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:44.938093  4171 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:44.950255  4157 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.023023  4146 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:44.888792  4244 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:44.936911  4255 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.024441  4240 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.074674  4264 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:45.075393  4264 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:45.076327  4240 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.030529  4082 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.042182  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.001936  1680 rpcz_store.cc:269] 0709 13:00:42.904959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.908214 (+  3255us) service_pool.cc:224] Handling call
0709 13:00:44.965656 (+2057442us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540031a6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:44.965857 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649088896}
W20260709 13:00:45.029083  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66887.2us
I20260709 13:00:45.001322  4129 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.082077  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:45.044009  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.033s	sys 0.081s
W20260709 13:00:45.051007  1648 connection.cc:256] RPC call timeout handler was delayed by -1.1142771589999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:00:45.084609  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0982142319999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:00:44.899221  4249 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.099267  4249 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.099599  4247 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.101178  4231 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:45.101773  4231 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.053004  1601 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:45.104010  4231 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:45.042227  3911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.033s	sys 0.038s
I20260709 13:00:45.055231  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.019471  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.060350  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.062323  4126 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.028136  3774 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:45.044631  4188 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.024441  4229 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.048280  4245 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.127470  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 470) took 2566 ms. Trace:
I20260709 13:00:45.070343  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:44.978942  4172 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.074944  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.057710  3544 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.138530  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:45.086669  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.094620  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.094640  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.140267  1683 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:45.095445  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.095616  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.141330  1677 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:45.096287  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:45.053750  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.002s	sys 0.013s
I20260709 13:00:45.141126  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:45.084513  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.033s	sys 0.081s
W20260709 13:00:45.141999  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.002s	sys 0.013s
W20260709 13:00:45.081391  4207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.620s	user 0.029s	sys 0.012s
I20260709 13:00:45.107328  4171 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.110077  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:45.067097  4078 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.073925  4146 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.071854  3955 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.117074  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:45.148258  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1209643519999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:00:45.149369  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.112505  4219 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:45.128012  2260 rpcz_store.cc:276] 0709 13:00:42.561396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.561611 (+   215us) service_pool.cc:224] Handling call
0709 13:00:42.561918 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.068694 (+506776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.127150 (+2058456us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400580f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:45.127379 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024944000}
I20260709 13:00:45.141436  1676 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:45.105768  3938 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.057106  2257 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:45.142283  1675 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
W20260709 13:00:45.143054  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 81383.5us
I20260709 13:00:45.111162  4082 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.117702  4157 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.166774  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.150316  1527 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:45.145507  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.151706  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.149292  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:45.157461  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.112272  4132 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:00:45.161070  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.161262  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:45.143422  4207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.030s	sys 0.012s
I20260709 13:00:45.168730  1609 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.171869  1607 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:45.169600  1608 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:45.161814  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:45.172974  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.273983  4229 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:45.274153  2259 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:45.274597  4229 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.275156  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.275740  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:45.185134  4226 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.899s	user 0.004s	sys 0.006s
I20260709 13:00:45.263355  4244 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.277627  4255 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:45.278019  4229 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.278429  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.279253  4272 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.279757  4272 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.281708  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.281890  4272 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.282883  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.283620  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.283915  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:45.199155  2257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 469) took 2628 ms (client timeout 1607 ms). Trace:
W20260709 13:00:45.286523  2257 rpcz_store.cc:269] 0709 13:00:42.544557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.549887 (+  5330us) service_pool.cc:224] Handling call
0709 13:00:45.020478 (+2470591us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0ce9c 00007f7e60a0ca5b 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:45.169471 (+148993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58322688}
I20260709 13:00:45.287688  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.199380  4132 consensus_queue.cc:1243] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:45.169775  4219 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:45.289101  4215 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.288968  4219 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.289744  4215 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.291585  4272 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:45.199978  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.291808  4215 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.202133  4157 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.292152  4272 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.203678  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.294561  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.295152  1529 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:45.295500  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1719) took 2458 ms. Trace:
I20260709 13:00:45.295822  1531 rpcz_store.cc:276] 0709 13:00:42.837607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.837749 (+   142us) service_pool.cc:224] Handling call
0709 13:00:42.838105 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.859322 (+ 21217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.295297 (+2435975us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b540043c954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:45.295439 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47483136}
I20260709 13:00:45.297003  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.297521  1531 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 2.
I20260709 13:00:45.298216  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.299096  3851 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.204377  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.139513  4245 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.301187  4272 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.301687  4245 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:45.299096  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.165668  4224 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.205333  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.302578  1525 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:45.303465  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.161326  3955 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.165501  3911 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.212774  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.213028  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.145241  3544 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.144800  2253 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:45.122468  4126 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:45.223897  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.236111  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.162135  4078 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.169705  1526 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:45.170672  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:45.170372  4249 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:45.408443  3911 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:45.408960  3911 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.185901  4254 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:00:45.184589  4263 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.185084  4220 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:45.185397  4262 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.419378  2260 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:45.245330  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1784) took 2367 ms. Trace:
W20260709 13:00:45.258167  4270 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:45.260113  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.160531  4169 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.261745  4082 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.350005  3851 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.440201  3851 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.441394  4078 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.432677  4262 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.262431  1676 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:45.159144  4247 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.443565  4247 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.444271  4262 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.445608  4247 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.117475  4077 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.446439  3955 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.428218  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:45.447994  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.448629  2257 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:45.449505  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.449640  3544 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:45.159307  4171 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.186498  4269 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:45.261665  4146 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.264799  3774 ts_tablet_manager.cc:1434] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.287s	user 0.011s	sys 0.002s
I20260709 13:00:45.266077  4028 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:45.201292  4206 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.450707  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.263576  3938 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:45.269210  4129 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.273054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.452246  1608 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:45.273392  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:45.454883  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 181544us
I20260709 13:00:45.255895  4100 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:45.285081  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 464) took 2753 ms (client timeout 1823 ms). Trace:
W20260709 13:00:45.457850  2252 rpcz_store.cc:269] 0709 13:00:42.531706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.542408 (+ 10702us) service_pool.cc:224] Handling call
0709 13:00:45.283470 (+2741062us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:45.285006 (+  1536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88066432}
I20260709 13:00:45.459920  4118 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.460666  4118 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.461099  4118 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.463161  4118 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.287861  4202 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.294833  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1548) took 2925 ms (client timeout 1867 ms). Trace:
I20260709 13:00:45.295918  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.407997  1525 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
W20260709 13:00:45.279175  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1729) took 1716 ms (client timeout 2113 ms). Trace:
I20260709 13:00:45.410815  1533 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:45.341225  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:45.373934  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1878) took 2678 ms. Trace:
I20260709 13:00:45.413667  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.470804  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:45.414774  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.411096  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.413079  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 242451us
I20260709 13:00:45.475131  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:45.472137  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.477663  1609 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.478664  1531 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.309026  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:45.479636  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 170692us
I20260709 13:00:45.480926  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:45.303655  4224 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.424943  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:45.473443  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:45.245105  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.428968  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:45.484283  1606 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.429538  1601 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:45.484359  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:45.476537  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:45.485332  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.428534  1674 rpcz_store.cc:276] 0709 13:00:42.853366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.201153 (+347787us) service_pool.cc:224] Handling call
0709 13:00:44.966697 (+1765544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.966983 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.967012 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.967062 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:44.967099 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.967162 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.220328 (+253166us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540031a6d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:45.220492 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117008128}
W20260709 13:00:45.372782  4213 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 2.277s	user 0.001s	sys 0.007s
I20260709 13:00:45.489640  4231 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.490222  1529 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:45.491102  4231 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.493037  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:45.494858  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.433069  2261 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:45.262109  4172 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.435254  1607 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:45.436854  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.424628  4151 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.437551  4169 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.427789  4225 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.427551  4244 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:45.430456  4220 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.427053  4263 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.442341  3851 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.450402  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:45.187263  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.285718  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.551348  1600 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:00:45.466346  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.467635  1604 rpcz_store.cc:269] 0709 13:00:42.369600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.371350 (+  1750us) service_pool.cc:224] Handling call
0709 13:00:45.294658 (+2923308us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54003c5d54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:45.294749 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5081734400}
W20260709 13:00:45.420812  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 259044us
I20260709 13:00:45.468870  1603 rpcz_store.cc:276] 0709 13:00:42.695868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.700129 (+  4261us) service_pool.cc:224] Handling call
0709 13:00:42.700425 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.029508 (+2329083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.373622 (+344114us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b5400384fd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:45.373862 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5354520320}
W20260709 13:00:45.467836  1532 rpcz_store.cc:269] 0709 13:00:43.562853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.563213 (+   360us) service_pool.cc:224] Handling call
0709 13:00:45.278279 (+1715066us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:45.279113 (+   834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193272704}
I20260709 13:00:45.451630  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:45.540498  1533 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:45.541497  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.500900  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.499424  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:45.550674  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:45.539005  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:45.463696  3774 ts_tablet_manager.cc:1467] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 508ms
I20260709 13:00:45.483922  3938 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.450342  4171 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.545058  2257 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:45.558516  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.559005  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:45.572674  1531 raft_consensus.cc:2410] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:00:45.574515  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 75171.7us
I20260709 13:00:45.572924  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.580444  1601 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:45.539376  4272 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.499557  4082 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.562619  1609 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:45.589715  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.590296  1609 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
W20260709 13:00:45.577543  4094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.381s	user 0.018s	sys 0.014s
W20260709 13:00:45.575951  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 427992us
I20260709 13:00:45.492604  4229 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.661685  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.538000  4078 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:45.546550  4228 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.668480  1607 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:45.575491  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 411597us
I20260709 13:00:45.499219  4267 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.580717  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.493299  4202 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.558094  4268 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.586071  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.551803  4225 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:45.493959  4146 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:00:45.566741  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:45.552105  2252 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:45.492255  4205 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:00:45.664696  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.821293  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.664695  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.561388  4151 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.822368  1683 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.776386  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.841416  1600 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:45.581614  4172 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:45.588397  4082 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:45.680856  1498 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:45.889698  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 2.30484e+06us
W20260709 13:00:45.890678  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.687357  1606 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.775614  1676 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:45.776026  4268 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.914601  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.681950  4245 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:00:45.588774  4272 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:45.576820  3938 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:45.711494  4224 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.709786  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.581445  4260 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:45.661866  4094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.468s	user 0.018s	sys 0.014s
W20260709 13:00:45.582232  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 271415us
I20260709 13:00:45.584895  3955 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.584823  4049 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:45.683045  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 324) took 2951 ms. Trace:
I20260709 13:00:45.682880  2259 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:45.969355  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.777529  4267 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.969835  2259 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:45.969519  1682 rpcz_store.cc:276] 0709 13:00:42.712468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.712839 (+   371us) service_pool.cc:224] Handling call
0709 13:00:42.756330 (+ 43491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.632025 (+875695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.662085 (+2030060us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540007d0d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:45.664226 (+  2141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012008704}
I20260709 13:00:45.781426  2253 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:45.669301  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.986531  1609 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:45.681018  4228 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.710675  3851 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:00:45.609189  4254 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.688529  2254 raft_consensus.cc:2410] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:45.570482  3774 ts_tablet_manager.cc:1469] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:00:31.244797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.279107 (+ 34310us) service_pool.cc:224] Handling call
0709 13:00:31.381935 (+102828us) ts_tablet_manager.cc:934] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:00:39.227197 (+7845262us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:39.357965 (+130768us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:39.358091 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:39.444886 (+ 86795us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:39.445434 (+   548us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:39.445941 (+   507us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:39.446167 (+   226us) inbound_call.cc:177] Queueing success response
0709 13:00:41.049870 (+1603703us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:44.977852 (+3927982us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:44.985627 (+  7775us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:44.986232 (+   605us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":76709,"mutex_wait_us":8803,"raft.queue_time_us":4833,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":13476,"tablet-copy.queue_time_us":70565,"tablet-download-pool.queue_time_us":13896,"tablet-download-pool.run_cpu_time_us":1557,"tablet-download-pool.run_wall_time_us":938951,"thread_start_us":157807,"threads_started":2}
I20260709 13:00:45.774889  4225 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.916352  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:45.484858  4269 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:46.014079  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.922051  1498 connection.cc:256] RPC call timeout handler was delayed by -2.106396616999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:00:46.010690  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:46.015661  1498 connection.cc:256] RPC call timeout handler was delayed by -1.8227052209999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:00:46.016027  1498 connection.cc:256] RPC call timeout handler was delayed by -1.6031306749999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:00:45.939790  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 164667us
W20260709 13:00:45.944005  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 364348us
I20260709 13:00:45.944329  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.779927  4202 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.913691  4082 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.998175  4228 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.933148  4172 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:45.945863  4244 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:45.948649  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:45.949397  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:45.952096  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:45.959158  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.064149  1600 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:45.965078  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.967056  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:45.672914  4229 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:45.970196  1677 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:45.941988  4231 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.942063  4272 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.921892  4268 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.981289  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.100692  1682 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:45.981482  2259 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:45.982229  4263 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:45.977901  4267 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:46.074196  4280 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:46.071022  4229 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.996733  1601 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.963860  4247 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.960839  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 729) took 1259 ms. Trace:
I20260709 13:00:46.019309  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:46.004585  4254 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.974177  3955 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.058014  1605 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:46.008113  4126 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:45.980576  4260 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.025851  4169 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:45.968642  4224 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.008147  2257 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:46.027247  4205 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:00:46.064007  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47094.3us
I20260709 13:00:46.145192  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.067194  1683 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:46.116104  4077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.046s	sys 0.089s
I20260709 13:00:46.020249  3851 consensus_queue.cc:1243] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:00:46.071957  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 119903us
I20260709 13:00:46.020725  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 735) took 1309 ms. Trace:
W20260709 13:00:46.098352  4291 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:00:46.098858  4293 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.103458  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:45.990571  1609 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:46.117693  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 168353us
I20260709 13:00:46.100585  4231 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.130903  4101 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.147516  4078 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.147723  4205 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:46.166580  4205 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:46.167378  4231 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.167637  4205 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.169011  4205 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.135372  4254 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:46.161309  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57948.1us
W20260709 13:00:46.147991  4077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.046s	sys 0.089s
I20260709 13:00:46.164044  3851 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.173573  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:46.174427  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1727) took 3113 ms (client timeout 1882 ms). Trace:
W20260709 13:00:46.174768  1534 rpcz_store.cc:269] 0709 13:00:43.064355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.088039 (+ 23684us) service_pool.cc:224] Handling call
0709 13:00:46.173424 (+3085385us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:46.174327 (+   903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47653120}
W20260709 13:00:46.179215  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.179916  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.154137  2253 rpcz_store.cc:276] 0709 13:00:44.711179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.780647 (+1069468us) service_pool.cc:224] Handling call
0709 13:00:45.781032 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.992472 (+211440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.015334 (+ 22862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.181591  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.182229  2253 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:46.182312  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 749) took 1076 ms. Trace:
I20260709 13:00:46.182783  2261 rpcz_store.cc:276] 0709 13:00:45.105802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.177058 (+ 71256us) service_pool.cc:224] Handling call
0709 13:00:46.182124 (+1005066us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54004c4854. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:46.182248 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52168448}
I20260709 13:00:46.156467  4244 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.186285  4254 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.192530  4254 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:46.192970  4269 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:46.128904  2252 rpcz_store.cc:276] 0709 13:00:44.701783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.459994 (+758211us) service_pool.cc:224] Handling call
0709 13:00:45.467581 (+  7587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.848714 (+381133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.943374 (+ 94660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.194494  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 467) took 3661 ms. Trace:
I20260709 13:00:46.194811  4151 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:46.195974  3911 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.003s
I20260709 13:00:46.196599  3911 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.199503  3911 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:46.201339  4290 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:00:46.201637  2256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 472) took 3630 ms (client timeout 1704 ms). Trace:
W20260709 13:00:46.202301  4277 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:00:46.202050  2256 rpcz_store.cc:269] 0709 13:00:42.571402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.631100 (+ 59698us) service_pool.cc:224] Handling call
0709 13:00:46.201431 (+3570331us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540027d3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:46.201564 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903018880}
I20260709 13:00:46.203500  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.203770  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 403) took 1057 ms. Trace:
I20260709 13:00:46.205396  3545 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:46.202100  2255 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:46.205922  3545 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:46.206840  3545 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.207506  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 470) took 2364 ms. Trace:
I20260709 13:00:46.204223  1530 rpcz_store.cc:276] 0709 13:00:45.145849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.145968 (+   119us) service_pool.cc:224] Handling call
0709 13:00:45.163339 (+ 17371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.163728 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.163764 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.171406 (+  7642us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.664130 (+492724us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:45.664172 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.664239 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.203539 (+539300us) raft_consensus.cc:1685] finished
0709 13:00:46.203562 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.203698 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2569,"raft.queue_time_us":2882,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3309,"thread_start_us":446293,"threads_started":1,"wal-append.queue_time_us":847105}
I20260709 13:00:46.210094  4224 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.160113  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:46.211594  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51591.8us
I20260709 13:00:46.213047  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:46.213235  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.213667  4146 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:46.213866  4133 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.214043  2256 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:46.215315  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.214373  4133 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.216532  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.216826  4133 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.217757  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.173640  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:46.223172  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49605.4us
I20260709 13:00:46.225587  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:46.226061  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.226387  4205 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:46.226595  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.207952  2255 rpcz_store.cc:276] 0709 13:00:43.842811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.019270 (+1176459us) service_pool.cc:224] Handling call
0709 13:00:46.201740 (+1182470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.206160 (+  4420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.207275 (+  1115us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540027d3d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:46.207437 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718551808}
W20260709 13:00:46.227345  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.203298  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.230213  2253 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:46.233011  4206 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.233511  4206 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:46.233894  4206 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.214664  4224 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.236001  4224 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.236650  4224 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.216104  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:46.245867  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.248411  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.249794  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.184165  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:46.229409  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 313131us
I20260709 13:00:46.132210  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.255110  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:46.252323  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:46.249104  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:46.259421  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.264523  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:46.240794  2258 rpcz_store.cc:276] 0709 13:00:42.532589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.537387 (+  4798us) service_pool.cc:224] Handling call
0709 13:00:42.537722 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.903665 (+365943us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:45.234811 (+2331146us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800118a20. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf
0709 13:00:45.260857 (+ 26046us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.577856 (+316999us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.581807 (+  3951us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.581990 (+   183us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.582026 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.582140 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.194183 (+612043us) raft_consensus.cc:1685] finished
0709 13:00:46.194284 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.194433 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80366,"prepare.queue_time_us":209706,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":109040,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6152,"spinlock_wait_cycles":25584896,"thread_start_us":932809,"threads_started":3,"wal-append.queue_time_us":527608}
I20260709 13:00:46.266170  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:46.267993  4063 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:46.268739  4187 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:46.269011  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 249769us
I20260709 13:00:46.270664  4245 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.270818  4205 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:46.272593  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:46.273377  1609 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:46.274086  4129 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.274513  4129 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:46.274856  4129 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.268003  4269 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:46.276953  4187 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.278944  4187 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.279894  4136 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:46.280774  1534 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:46.282059  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 404) took 1135 ms. Trace:
I20260709 13:00:46.282428  1528 rpcz_store.cc:276] 0709 13:00:45.146245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.146363 (+   118us) service_pool.cc:224] Handling call
0709 13:00:45.166587 (+ 20224us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:45.245063 (+ 78476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.245098 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:45.361930 (+116832us) log.cc:844] Serialized 52 byte log entry
0709 13:00:45.738104 (+376174us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.738151 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.738233 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.281837 (+543604us) raft_consensus.cc:1685] finished
0709 13:00:46.281872 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.282009 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7701,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":63281,"thread_start_us":310573,"threads_started":1,"wal-append.queue_time_us":731291}
I20260709 13:00:46.283911  4233 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.284042  4212 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.284369  4233 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:46.284895  4212 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.285452  4256 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.286270  4247 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:46.286763  4247 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:46.273931  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 263300us
I20260709 13:00:46.232050  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 471) took 1432 ms. Trace:
I20260709 13:00:46.288247  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:46.290273  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:46.266475  2258 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.293915  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 472) took 1489 ms. Trace:
I20260709 13:00:46.294476  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:46.295101  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.295786  1527 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:46.156759  4293 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:46.296365  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:46.291417  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.300541  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.284817  4233 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.240181  4101 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.299890  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.194490  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.306632  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.160606  4171 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.314368  4151 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.301196  1679 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:46.164418  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 736) took 1451 ms. Trace:
I20260709 13:00:46.239389  4078 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.322513  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.322815  4078 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.323247  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.324371  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.324805  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.324949  1533 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:46.303975  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:46.297816  4248 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.313570  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.326498  1530 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.294322  2258 rpcz_store.cc:276] 0709 13:00:44.809873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.265994 (+1456121us) service_pool.cc:224] Handling call
0709 13:00:46.266290 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.293664 (+ 27374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.293857 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.242195  4146 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:46.297246  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:46.327244  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:46.312215  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.313261  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.315759  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.262213  3851 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.265342  4254 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.318470  1528 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:46.262735  4220 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:46.319186  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.331162  1679 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:46.332286  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:46.333602  1679 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:46.321566  4151 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:46.333154  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:46.322178  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.301934  4293 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.326650  2261 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:46.313570  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.333256  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:46.316802  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:46.330309  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.321946  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.340696  1532 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:46.340796  1533 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:46.301517  4049 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.287122  4216 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:00:46.155908  4172 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.340102  2258 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:46.315325  4255 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.319201  4269 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:46.345506  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.356106  1528 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:46.317572  4187 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.379644  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:46.380211  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.332552  4231 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.326020  3955 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.381232  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:46.331559  4254 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:46.332470  4123 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.337252  4151 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.378259  4248 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.332809  3938 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.386286  4150 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.343459  4049 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.374893  4101 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.378518  4187 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.337132  4063 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:00:46.335178  4235 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:46.397446  1680 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:46.398276  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.419873  1530 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:46.326908  2257 rpcz_store.cc:276] 0709 13:00:44.711423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.847024 (+1135601us) service_pool.cc:224] Handling call
0709 13:00:45.967232 (+120208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.143743 (+176511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.162660 (+ 18917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.391095  4212 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.429409  1674 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:46.408954  1543 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-87db66ba9ff145009d8e513e5d0ef1e4 received from {username='slave'} at 127.0.0.1:56406
I20260709 13:00:46.386193  4248 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:46.383378  4231 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:46.414499  4134 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.387770  4254 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.386755  4123 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:46.396775  3955 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:46.423759  4287 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:00:46.392500  4269 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:46.396973  4049 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.378479  4171 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:00:46.431162  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.459725  4248 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.428524  4187 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.297356  2253 rpcz_store.cc:276] 0709 13:00:44.799682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.231029 (+1431347us) service_pool.cc:224] Handling call
0709 13:00:46.231443 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.231663 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.231701 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.231751 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:46.231787 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.231855 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.231982 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.483736  4123 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.521790  4229 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.522625  4078 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:46.524163  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 377825us
W20260709 13:00:46.504354  4091 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.477s	user 0.006s	sys 0.048s
W20260709 13:00:46.540350  4091 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.535s	user 0.007s	sys 0.048s
I20260709 13:00:46.540575  4078 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:46.510177  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.540529  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.340050  1681 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:00:46.541795  4078 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.409381  4225 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.409144  4150 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.542201  4078 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.542586  4078 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.543665  4225 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:46.543885  4150 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:46.471139  4231 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.545210  1680 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:46.498974  2254 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:46.420449  4267 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.433326  4127 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.482991  3955 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.533782  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:46.534427  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:46.521719  2286 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:41741 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:41741 timed out after 15.000s (SENT)
I20260709 13:00:46.458369  1543 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-87db66ba9ff145009d8e513e5d0ef1e4 on tablet 87db66ba9ff145009d8e513e5d0ef1e4 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:46.553550  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:46.628741  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75305us
W20260709 13:00:46.630182  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.516979  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:46.610905  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 277793us
I20260709 13:00:46.424897  4146 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:46.624472  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 361379us
I20260709 13:00:46.632864  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.633315  2227 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:46.629644  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:46.633782  1679 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:46.631908  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:46.636093  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:46.640172  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 295073us
I20260709 13:00:46.610569  4244 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:46.713896  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.717046  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1567) took 1265 ms. Trace:
I20260709 13:00:46.532552  4123 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.719481  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:46.628572  3955 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.720001  4077 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.724498  1679 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:46.739260  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.638908  4225 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:46.740856  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.660580  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 474) took 1488 ms. Trace:
I20260709 13:00:46.719127  4269 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.639896  4212 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:46.689518  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.724400  1608 rpcz_store.cc:276] 0709 13:00:45.452037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.452840 (+   803us) service_pool.cc:224] Handling call
0709 13:00:45.453137 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.453349 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.453374 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.453846 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.947202 (+493356us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:45.947238 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.947307 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.716785 (+769478us) raft_consensus.cc:1685] finished
0709 13:00:46.716804 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.716976 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":492498,"threads_started":1,"wal-append.queue_time_us":678956}
I20260709 13:00:46.728826  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:46.764127  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 130880us
I20260709 13:00:46.713678  4202 raft_consensus.cc:2764] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:00:46.764773  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 128756us
I20260709 13:00:46.765686  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.777633  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.736467  4063 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.781025  1607 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:46.785218  4077 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:46.787657  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.812134  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.805924  1607 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:00:46.816438  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 161747us
I20260709 13:00:46.821894  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:46.744246  4225 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:46.813098  1607 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.829131  1607 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.766548  4212 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.624248  4127 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:46.846297  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.854507  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.853395  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 741) took 1814 ms. Trace:
I20260709 13:00:46.733508  4244 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:46.855110  1679 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:00:46.855087  2260 rpcz_store.cc:276] 0709 13:00:45.039177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.278478 (+1239301us) service_pool.cc:224] Handling call
0709 13:00:46.278774 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.328659 (+ 49885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.328691 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.328734 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.328767 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.853109 (+524342us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b5400408654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:46.853152 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.853336 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114281216}
W20260709 13:00:46.831668  4272 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.733s	user 0.015s	sys 0.018s
I20260709 13:00:46.805833  4063 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.873560  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.878741  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:46.885761  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 120822us
W20260709 13:00:46.878911  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 109338us
I20260709 13:00:46.892151  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:46.878872  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 109057us
I20260709 13:00:46.893239  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:46.813550  4260 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:46.854204  4212 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.857939  4127 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.761763  2254 rpcz_store.cc:276] 0709 13:00:45.147175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.341996 (+1194821us) service_pool.cc:224] Handling call
0709 13:00:46.429073 (+ 87077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.612700 (+183627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.635333 (+ 22633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.977396  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:46.872401  4091 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:46.828747  4254 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.895144  4063 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.013412  4078 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.991833  1607 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:46.889817  1679 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
W20260709 13:00:46.992509  4316 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:00:46.992923  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:46.993904  4288 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.898s	user 0.003s	sys 0.000s
I20260709 13:00:47.056337  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1567) took 1599 ms. Trace:
W20260709 13:00:46.994726  4307 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:00:46.995427  4303 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:00:46.996327  4300 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:00:46.996762  4171 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:46.997270  4295 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:00:47.057976  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 739) took 2284 ms. Trace:
I20260709 13:00:47.056741  1675 rpcz_store.cc:276] 0709 13:00:45.457383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.458029 (+   646us) service_pool.cc:224] Handling call
0709 13:00:45.458372 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.458760 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.458787 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.459240 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.940289 (+481049us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:46.005278 (+ 64989us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.220220 (+214942us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18004d3e00. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:00:46.220422 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.220491 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.993269 (+772778us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:47.056098 (+ 62829us) raft_consensus.cc:1685] finished
0709 13:00:47.056122 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.056255 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20050,"prepare.queue_time_us":59123,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":218086,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":201,"spinlock_wait_cycles":12481152,"thread_start_us":480571,"threads_started":1,"wal-append.queue_time_us":587224}
W20260709 13:00:47.005060  4306 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:00:47.009471  4206 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.000s
I20260709 13:00:47.060398  1675 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:47.058653  2255 rpcz_store.cc:276] 0709 13:00:44.773258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.227593 (+1454335us) service_pool.cc:224] Handling call
0709 13:00:46.227987 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.228435 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.228468 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.228996 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.604632 (+375636us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.618199 (+ 13567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.625743 (+  7544us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.057756 (+432013us) raft_consensus.cc:1685] finished
0709 13:00:47.057778 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.057917 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":499,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":283730,"threads_started":1,"wal-append.queue_time_us":504214}
W20260709 13:00:47.059214  4233 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.744s	user 0.004s	sys 0.005s
I20260709 13:00:47.058198  4171 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.014024  4049 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.062882  1675 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:47.063331  4049 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.063937  1675 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.064491  2261 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.060560  4206 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.066864  4206 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:47.069392  4293 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.014s
I20260709 13:00:47.070612  4171 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.070060  4293 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:46.985486  4133 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.768s	user 0.018s	sys 0.012s
W20260709 13:00:47.024986  4297 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.504s	user 0.003s	sys 0.000s
I20260709 13:00:47.071460  4133 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.072556  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 389) took 1148 ms. Trace:
I20260709 13:00:47.068925  4049 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:00:47.045066  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 227846us
I20260709 13:00:46.888677  4296 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:47.038544  4268 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.938s	user 0.019s	sys 0.016s
I20260709 13:00:46.872797  4320 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:47.061259  4233 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.069087  1675 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:47.033367  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.011281  4129 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.006s
I20260709 13:00:47.014678  4091 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.019660  4225 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:46.889349  4272 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:47.090471  1681 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:00:47.017206  4322 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.115938  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 476) took 1839 ms. Trace:
W20260709 13:00:47.346668  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.272162  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:47.068594  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.358729  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:47.116487  2252 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:47.258617  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:47.185552  4187 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.004s
W20260709 13:00:47.194720  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.781s (SENT) [suppressed 21 similar messages]
W20260709 13:00:47.265898  4134 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.001s
I20260709 13:00:47.372279  2261 rpcz_store.cc:276] 0709 13:00:45.284463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.338778 (+1054315us) service_pool.cc:224] Handling call
0709 13:00:46.382546 (+ 43768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.064818 (+682272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.115721 (+ 50903us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54005de8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:47.115880 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567905664}
W20260709 13:00:47.378201  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.378064  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.358729  1679 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:47.182749  3851 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.850s	user 0.005s	sys 0.024s
W20260709 13:00:47.114938  4248 consensus_meta.cc:287] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.581s	user 0.003s	sys 0.003s
I20260709 13:00:47.384616  1675 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:00:47.262281  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:47.126170  4228 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.057s	user 0.007s	sys 0.027s
I20260709 13:00:47.073436  4133 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:47.072887  1604 rpcz_store.cc:276] 0709 13:00:45.924094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.942311 (+ 18217us) service_pool.cc:224] Handling call
0709 13:00:45.942624 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.962321 (+ 19697us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:45.962351 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.976775 (+ 14424us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.327307 (+350532us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.327346 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.327409 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.024582 (+697173us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b24003c9308. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a8309d 00007f7e636b510e 00007f7e636cc88c 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221
0709 13:00:47.072269 (+ 47687us) raft_consensus.cc:1685] finished
0709 13:00:47.072290 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.072502 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24957,"raft.queue_time_us":25200,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":24875,"spinlock_wait_cycles":82858240,"thread_start_us":307049,"threads_started":1,"wal-append.queue_time_us":516770}
I20260709 13:00:47.389586  1606 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:47.288908  4250 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:47.268038  4151 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.027s
W20260709 13:00:47.113371  4312 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
W20260709 13:00:47.255636  4323 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:47.391052  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1589) took 1074 ms. Trace:
W20260709 13:00:47.349152  4231 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.004s
I20260709 13:00:47.041265  3955 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:47.391393  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 498177us
I20260709 13:00:47.245136  4235 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:47.268759  4101 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.837s	user 0.013s	sys 0.019s
W20260709 13:00:47.260149  4082 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.214s	user 0.004s	sys 0.032s
W20260709 13:00:47.120635  4305 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:00:47.395953  1527 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:47.435504  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1749) took 1108 ms. Trace:
I20260709 13:00:47.435909  1527 rpcz_store.cc:276] 0709 13:00:46.327134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.261986 (+934852us) service_pool.cc:224] Handling call
0709 13:00:47.435436 (+173450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.292224  3545 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.401213  1678 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:47.386556  1680 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:47.125432  4078 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.181541  4251 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.115854  4298 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.250751  4267 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.270754  4229 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.217797  4254 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.127841  4123 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.364657  4296 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:47.369855  4322 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.149797  4324 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:47.246281  4077 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:47.383383  4255 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:47.441438  4265 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.206781  4244 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.426057  1679 rpcz_store.cc:276] 0709 13:00:46.316747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.055821 (+739074us) service_pool.cc:224] Handling call
0709 13:00:47.056967 (+  1146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.390784 (+333817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.390993 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.369088  4320 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:47.430909  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:47.115494  4127 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.043133  4310 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.391s
I20260709 13:00:47.195276  4212 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.405987  3851 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.421983  4330 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.507182  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 312481us
I20260709 13:00:47.481972  4296 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.411517  4318 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.372660  4308 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:47.364991  4129 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.380400  4268 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:47.473847  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.009s	sys 0.046s
W20260709 13:00:47.436430  4313 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:00:47.401820  4248 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.438493  4101 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.400334  4187 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.425990  4151 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:47.498179  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67353.7us
I20260709 13:00:47.500298  4320 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.504558  4265 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.517887  4320 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.502485  4127 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.481724  4322 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.503904  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1584) took 1203 ms. Trace:
I20260709 13:00:47.520979  1674 rpcz_store.cc:276] 0709 13:00:46.300353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.055293 (+754940us) service_pool.cc:224] Handling call
0709 13:00:47.055677 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.056049 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.056078 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.056586 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.397581 (+340995us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:47.397619 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.397684 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.503700 (+106016us) raft_consensus.cc:1685] finished
0709 13:00:47.503719 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.503845 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2682,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":74,"thread_start_us":340597,"threads_started":1,"wal-append.queue_time_us":440009}
I20260709 13:00:47.522434  1602 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:47.486419  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1583) took 1570 ms. Trace:
I20260709 13:00:47.432994  4231 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.507398  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1582) took 1615 ms. Trace:
I20260709 13:00:47.442322  4082 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.494789  4077 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:47.506042  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128042us
W20260709 13:00:47.510958  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.046s
W20260709 13:00:47.532873  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 640311us
I20260709 13:00:47.527082  1682 rpcz_store.cc:276] 0709 13:00:45.915969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.101390 (+185421us) service_pool.cc:224] Handling call
0709 13:00:46.106072 (+  4682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:46.268654 (+162582us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:46.268938 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.646531 (+377593us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:46.725570 (+ 79039us) log.cc:844] Serialized 52 byte log entry
0709 13:00:46.725723 (+   153us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:47.293501 (+567778us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b1800040840. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf 00007f7e63b4b038
0709 13:00:47.475950 (+182449us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.476251 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.476355 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.486177 (+  9822us) raft_consensus.cc:1685] finished
0709 13:00:47.486200 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.486352 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148246,"prepare.queue_time_us":15462,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3542,"raft.queue_time_us":180106,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":73728,"spinlock_wait_cycles":115213952,"thread_start_us":542365,"threads_started":2,"wal-append.queue_time_us":597167}
W20260709 13:00:47.534485  4314 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:00:47.535429  4328 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:00:47.535874  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1756) took 1076 ms. Trace:
I20260709 13:00:47.536617  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 484) took 1377 ms. Trace:
I20260709 13:00:47.536998  2257 rpcz_store.cc:276] 0709 13:00:46.159488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.456908 (+297420us) service_pool.cc:224] Handling call
0709 13:00:46.516083 (+ 59175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.642946 (+126863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.658277 (+ 15331us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.811981 (+153704us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.244853 (+432872us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.244927 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.246513 (+  1586us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.536395 (+289882us) raft_consensus.cc:1685] finished
0709 13:00:47.536418 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.536557 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2069,"raft.queue_time_us":8815,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":73292,"thread_start_us":257679,"threads_started":1,"wal-append.queue_time_us":496955}
I20260709 13:00:47.532038  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1747) took 1206 ms. Trace:
I20260709 13:00:47.538836  4101 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:47.540447  4212 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:47.541778  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 485) took 1382 ms (client timeout 1627 ms). Trace:
I20260709 13:00:47.542285  4151 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.538683  1529 rpcz_store.cc:276] 0709 13:00:46.325839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.326567 (+   728us) service_pool.cc:224] Handling call
0709 13:00:46.338648 (+ 12081us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:46.339111 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.339144 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:46.356121 (+ 16977us) log.cc:844] Serialized 78 byte log entry
0709 13:00:46.531289 (+175168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:46.813975 (+282686us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.814171 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.814243 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.245918 (+431675us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b1800463c00. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:47.527057 (+281139us) raft_consensus.cc:1685] finished
0709 13:00:47.531822 (+  4765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.531980 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":314371,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":67604,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":36602,"spinlock_wait_cycles":85968768,"thread_start_us":427356,"threads_started":2,"wal-append.queue_time_us":378387}
I20260709 13:00:47.545574  4231 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.546119  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:47.546300  4310 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:47.547740  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:47.551465  1607 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.543022  2258 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:47.424208  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.011s
W20260709 13:00:47.512468  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.506017  4324 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:47.527230  1677 rpcz_store.cc:276] 0709 13:00:45.892123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.099470 (+207347us) service_pool.cc:224] Handling call
0709 13:00:46.099766 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.237828 (+138062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.237857 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.238342 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.625875 (+387533us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:46.625913 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.625983 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.507174 (+881191us) raft_consensus.cc:1685] finished
0709 13:00:47.507192 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.507328 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137653,"raft.queue_time_us":154596,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":24532,"thread_start_us":387152,"threads_started":1,"wal-append.queue_time_us":592654}
I20260709 13:00:47.560796  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:47.536240  1530 rpcz_store.cc:276] 0709 13:00:46.459974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.460082 (+   108us) service_pool.cc:224] Handling call
0709 13:00:46.460451 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:46.460829 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.460858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:46.473615 (+ 12757us) log.cc:844] Serialized 52 byte log entry
0709 13:00:46.871804 (+398189us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:46.871873 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.871996 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.535666 (+663670us) raft_consensus.cc:1685] finished
0709 13:00:47.535685 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.535822 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12007,"raft.queue_time_us":551,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10827,"thread_start_us":349359,"threads_started":1,"wal-append.queue_time_us":873966}
I20260709 13:00:47.504096  4255 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:47.561820  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.422411  4228 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.565596  1607 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:47.530495  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:47.555544  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.008s	sys 0.012s
I20260709 13:00:47.558346  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:47.566968  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 673034us
I20260709 13:00:47.567659  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.569531  1533 raft_consensus.cc:2368] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
I20260709 13:00:47.571025  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.571624  1679 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.572722  1530 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:47.577350  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.580155  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.579612  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.580410  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.579612  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.581086  1680 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:47.581264  1608 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:47.581632  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.583250  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:47.584206  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:47.582624  4254 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:47.586815  1682 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:47.591500  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.587926  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:47.592700  2260 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.586100  1525 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:47.591034  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.593456  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:47.599905  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.563549  4324 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.604434  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74010.2us
I20260709 13:00:47.611356  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1750) took 1281 ms. Trace:
I20260709 13:00:47.605098  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.612274  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:47.608136  1607 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.608295  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:47.614975  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 79743.4us
I20260709 13:00:47.609758  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:47.615576  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:47.578389  4317 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.363s	user 0.004s	sys 0.000s
I20260709 13:00:47.509907  4330 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.600626  1603 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:47.610594  1683 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.569162  4101 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:47.592244  4247 consensus_meta.cc:287] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.293s	user 0.015s	sys 0.019s
I20260709 13:00:47.621965  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.616456  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.617259  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.617558  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.616906  1526 rpcz_store.cc:276] 0709 13:00:46.340735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.340880 (+   145us) service_pool.cc:224] Handling call
0709 13:00:46.341197 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.344482 (+  3285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.344514 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.391359 (+ 46845us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.759912 (+368553us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.759959 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.760032 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.611136 (+851104us) raft_consensus.cc:1685] finished
0709 13:00:47.611155 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.611299 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2880,"raft.queue_time_us":41724,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6752,"thread_start_us":326910,"threads_started":1,"wal-append.queue_time_us":625051}
I20260709 13:00:47.569587  4293 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.604005  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.627710  1608 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.563628  4326 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.630034  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.587468  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:47.587118  4325 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:47.642042  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.642724  1600 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:47.542174  2252 rpcz_store.cc:269] 0709 13:00:46.159801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.194130 (+ 34329us) service_pool.cc:224] Handling call
0709 13:00:47.541557 (+1347427us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54002dc154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:47.541699 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766881152}
I20260709 13:00:47.613837  4310 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:47.625283  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.587798  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:47.624581  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.603868  4229 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.596649  4172 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.633555  2260 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:47.587742  3851 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:47.635818  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.639160  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.598084  4272 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.585173  4333 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.647490  1679 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:47.623059  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:47.705542  1607 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.561362  4332 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:00:47.661948  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.610517  4196 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:47.668545  1608 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:47.712110  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.692646  1680 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:47.614686  4324 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.626950  4318 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.627197  4212 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.592509  4269 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:47.629560  2257 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Advancing to term 5
W20260709 13:00:47.699556  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.705957  4317 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:00:47.700742  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76240us
I20260709 13:00:47.629160  4326 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.728591  2260 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.635546  4091 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.704108  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.732942  1601 raft_consensus.cc:2410] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:47.706339  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.707520  2255 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:47.704988  1603 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:47.643149  4077 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:47.714550  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 91579.5us
I20260709 13:00:47.644083  4101 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:47.631080  4124 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:00:47.631775  4151 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:00:47.629647  4244 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:00:47.699533  4224 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.462s	user 0.014s	sys 0.002s
I20260709 13:00:47.619719  4134 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:00:47.725811  4216 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.723286  1608 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.631927  4247 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.721868  4082 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:47.726758  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123680us
I20260709 13:00:47.708022  4078 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.637451  4268 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.699352  4310 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:47.733642  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:47.733510  1604 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:47.698825  3955 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:47.704725  3851 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:47.708966  4333 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.753150  1607 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:47.754482  4202 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.742491  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 121890us
I20260709 13:00:47.722107  4196 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.750433  1600 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:47.753587  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.754978  2260 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:47.781692  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.661914  4325 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.758546  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.783936  1534 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:47.763079  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.763383  1525 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:47.782788  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49207.4us
I20260709 13:00:47.625936  4322 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.733968  4326 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.765759  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.766237  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.708689  4172 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.766106  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:47.767932  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.790190  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:47.785758  1601 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:47.728855  4133 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:47.744851  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.778275  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.795042  1604 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:47.719735  4212 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.762861  4231 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:47.787513  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:47.818122  1680 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:47.765475  4078 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:47.792203  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.788663  4343 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:47.799554  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.837050  1534 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:47.837402  1607 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.760013  4077 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:47.800807  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.773681  4292 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:47.803458  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.804769  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.779021  3851 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.771534  4187 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:47.787446  4063 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.000s
I20260709 13:00:47.795575  4030 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:47.838003  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:47.843644  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.879663  1604 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:47.880704  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:47.816680  4212 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.778383  4333 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.766548  4224 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.867210  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:47.789696  4311 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:47.799006  4332 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.869589  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.400696  1525 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:47.798591  3955 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:47.855325  4292 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:47.801173  4248 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.858039  4231 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.941556  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.413007  3955 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:48.413503  4247 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.414054  3955 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.415727  1531 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:47.915681  4063 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.838930  4101 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.837924  4129 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.396129  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 738) took 3623 ms. Trace:
W20260709 13:00:48.040225  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.838055  4082 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
W20260709 13:00:48.374816  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.001s
W20260709 13:00:48.436652  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.001s
W20260709 13:00:48.410032  4346 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.576s	user 0.010s	sys 0.000s
W20260709 13:00:48.409834  4336 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.715s	user 0.000s	sys 0.010s
I20260709 13:00:47.838231  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:47.872681  4216 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:00:47.983994  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:47.807803  4338 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.172s
I20260709 13:00:48.016462  4310 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:47.787150  4202 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:48.449801  3851 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.578s	user 0.002s	sys 0.021s
I20260709 13:00:48.450239  3851 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:47.844105  4078 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.857650  4228 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:47.873327  4124 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 13:00:48.396215  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.396003  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.406353  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.432665  4292 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.425405  2256 rpcz_store.cc:276] 0709 13:00:44.772959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.218761 (+1445802us) service_pool.cc:224] Handling call
0709 13:00:46.220556 (+  1795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.222571 (+  2015us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:46.657965 (+435394us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.171703 (+513738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.178578 (+  6875us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.178727 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.178934 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.179110 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.179216 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.543960 (+364744us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:48.395870 (+851910us) raft_consensus.cc:1685] finished
0709 13:00:48.395898 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.396069 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2505,"prepare.queue_time_us":1132214,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":201762,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":27510,"spinlock_wait_cycles":32497920,"thread_start_us":877918,"threads_started":3,"wal-append.queue_time_us":452804}
I20260709 13:00:48.450860  4202 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:48.419234  4296 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.898s	user 0.012s	sys 0.005s
W20260709 13:00:48.465333  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.436944  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 570526us
I20260709 13:00:48.417137  4231 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:48.429492  2253 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:48.445488  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.446030  4338 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:48.446846  4333 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.493592  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:48.448218  4091 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:48.449997  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.496526  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.497079  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.399153  4030 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.452914  1604 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:48.452637  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.454944  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.453181  1525 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:48.453655  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1757) took 1943 ms (client timeout 1639 ms). Trace:
W20260709 13:00:48.436009  1607 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.569s	user 0.022s	sys 0.027s
I20260709 13:00:48.503268  1600 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.504174  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.464975  2254 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:48.483841  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.064s	sys 0.071s
I20260709 13:00:48.486096  4265 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.486414  4078 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.487248  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1571) took 3033 ms. Trace:
I20260709 13:00:48.513266  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.514070  1604 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:48.487951  4322 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:48.489540  4324 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.004s
W20260709 13:00:48.489709  4320 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.006s
W20260709 13:00:48.480566  4326 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.014s
I20260709 13:00:48.452284  3851 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:48.490571  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.453713  4292 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.480334  4338 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:48.503252  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:48.504390  1607 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:48.480880  4224 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.505067  1525 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.513001  4281 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:48.503813  1533 rpcz_store.cc:269] 0709 13:00:46.509815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.509941 (+   126us) service_pool.cc:224] Handling call
0709 13:00:48.453445 (+1943504us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54002a8d54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:48.453586 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169318272}
W20260709 13:00:48.506016  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.064s	sys 0.071s
W20260709 13:00:48.546418  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 746393us
I20260709 13:00:48.487563  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.473958  4327 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.515228  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.513695  1602 rpcz_store.cc:276] 0709 13:00:45.453464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.920888 (+467424us) service_pool.cc:224] Handling call
0709 13:00:45.963311 (+ 42423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.522855 (+1559544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.487010 (+964155us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54003b8dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:48.487191 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3585086208}
I20260709 13:00:48.523341  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.551249  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:48.551769  1609 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.441463  4330 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.553112  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.532220  1531 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:48.538465  1600 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:00:48.495934  4091 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:48.541189  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.501504  4228 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.543306  1534 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.547271  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:48.480029  4296 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.501736  4240 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:48.581043  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.545431  4265 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.583921  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.581462  2256 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:48.592988  1533 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.586150  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.595029  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.587903  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.595682  1531 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:48.597601  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50400.6us
I20260709 13:00:48.598666  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:48.600880  1525 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.601876  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.602691  1525 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.554595  1674 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:48.584758  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.604631  1607 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 3: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:48.600558  4265 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.606281  4078 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.607018  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.607560  4265 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.608085  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.608807  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.609081  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.609629  1602 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:48.609807  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.610263  4091 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.610841  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.610988  1531 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:48.611383  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.611907  2256 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.612805  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.613791  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.611989  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.614413  1602 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:00:48.614751  1525 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:48.612902  4091 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.615561  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.616088  1525 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:48.616847  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.608757  2260 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:48.613826  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.618158  2256 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:48.611893  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.618188  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:48.619397  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1579) took 2361 ms (client timeout 1512 ms). Trace:
I20260709 13:00:48.619832  1531 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:48.592710  4228 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.620934  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:48.622364  4228 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.619035  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.626679  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.619032  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.621644  1526 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:48.631243  1647 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.113s (SENT)
W20260709 13:00:48.648651  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50029.8us
W20260709 13:00:48.619819  1606 rpcz_store.cc:269] 0709 13:00:46.258286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.259148 (+   862us) service_pool.cc:224] Handling call
0709 13:00:48.619236 (+2360088us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003840d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:48.619332 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594754432}
I20260709 13:00:48.651882  1525 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.555044  4352 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:48.655927  1649 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:48.660203  1609 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:48.550989  4327 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:48.655611  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.554831  4172 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.668058  1526 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:48.669679  1526 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:48.670918  1526 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.674412  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.584432  4351 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:48.675382  4351 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.675740  4351 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.675199  2256 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:48.677297  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.677819  2256 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:48.678512  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.678983  2256 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.603716  4197 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:48.653762  4240 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:48.680923  4333 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.593364  4196 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:48.681375  4212 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.004s
I20260709 13:00:48.674355  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:48.681824  4212 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.683787  4212 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.683887  1533 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.538890  4324 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.685287  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.686100  4324 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:48.686486  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.686868  1529 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.688503  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.690016  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
W20260709 13:00:48.690147  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 187264us
I20260709 13:00:48.691636  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.550133  4281 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:48.693881  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:48.695672  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.539966  4326 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:48.697520  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.702950  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.693439  4350 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.707099  4350 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:48.707537  4350 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.709077  4136 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.709667  4136 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:48.710700  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.710538  4136 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.680270  4030 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.703917  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:48.713131  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.690037  4129 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:48.696821  2257 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.963s	user 0.013s	sys 0.001s
I20260709 13:00:48.715252  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.691888  4127 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:48.680588  4197 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:48.719450  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:48.701769  4250 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.275s	user 0.018s	sys 0.000s
I20260709 13:00:48.692440  4325 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.721447  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.723838  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:48.729125  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.729609  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:48.730989  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:48.731777  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:48.691583  4240 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:48.705466  3545 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.261s	user 0.011s	sys 0.009s
I20260709 13:00:48.725896  1608 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:48.698899  4281 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.734472  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:48.735743  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:48.736618  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 1910) took 1009 ms. Trace:
I20260709 13:00:48.736991  1608 rpcz_store.cc:276] 0709 13:00:47.727533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.719164 (+991631us) service_pool.cc:224] Handling call
0709 13:00:48.736547 (+ 17383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.743178  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.744959  2256 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:48.746141  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:48.747773  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.748627  1608 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:48.748751  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:48.749020  1676 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:48.693495  4243 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:48.719450  4330 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.762136  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.766078  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:48.766855  1608 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:48.744792  4172 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.744555  4349 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.768640  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.767761  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.760600  4239 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.738363  4311 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:48.744693  4078 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.750260  3851 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.745460  4091 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:48.749800  4241 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:48.774267  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.747660  3955 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.775396  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.666894  4338 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.753468  4030 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.778143  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.793505  1680 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.751371  4320 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:48.751634  4228 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.770934  4231 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:48.771550  2255 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:48.760643  4077 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:48.788797  1674 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.786510  4349 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:48.790057  3955 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:48.776221  4172 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:48.763880  4310 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:00:48.793320  4030 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:48.820859  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 164994us
I20260709 13:00:48.795001  4241 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:48.792048  4091 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:48.782503  3851 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:48.802147  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:48.833590  2256 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:48.774189  4332 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.796494  4320 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:48.792253  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 240064us
I20260709 13:00:48.831604  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:48.835595  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.838838  1682 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.813635  3955 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.818087  4172 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.779259  4197 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.852882  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 428) took 1014 ms. Trace:
I20260709 13:00:48.815936  4338 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.801124  4228 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.814468  4063 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.823316  4030 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.818840  4077 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:48.810946  4231 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:48.860925  4197 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.853665  1531 rpcz_store.cc:276] 0709 13:00:47.838834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.621780 (+782946us) service_pool.cc:224] Handling call
0709 13:00:48.622043 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.622221 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:48.769511 (+147290us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.841004 (+ 71493us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.852543 (+ 11539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.852592 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:48.852634 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.852699 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.852824 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23565,"prepare.queue_time_us":195389,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":12457,"thread_start_us":203383,"threads_started":2}
W20260709 13:00:48.864063  4359 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:00:48.847204  4320 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.865278  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.866076  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:48.890313  1683 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:48.866791  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.867461  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.868672  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:48.892249  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.892623  2256 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:48.797683  4311 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.780612  4239 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.874794  1674 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:48.875698  1680 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:00:48.838104  3851 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.900440  4366 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.900964  4366 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:48.903160  4366 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:48.841694  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:48.864583  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.884692  4349 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:48.886847  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1552) took 6500 ms (client timeout 2758 ms). Trace:
I20260709 13:00:48.843266  4296 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:48.906502  1678 rpcz_store.cc:269] 0709 13:00:42.385952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.386073 (+   121us) service_pool.cc:224] Handling call
0709 13:00:48.886562 (+6500489us) spinlock_profiling.cc:243] Waited 4.97 s on lock 0x7b540024a4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:48.886727 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11436144896}
I20260709 13:00:48.892982  2254 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:48.897032  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1902) took 1276 ms. Trace:
I20260709 13:00:48.831800  4129 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:00:48.898713  4241 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.800634  4240 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:48.904759  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.905344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.921489  1675 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.893657  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:48.905175  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.880492  4362 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.913712  1605 rpcz_store.cc:276] 0709 13:00:47.620244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.621487 (+  1243us) service_pool.cc:224] Handling call
0709 13:00:47.638687 (+ 17200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.639023 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.639049 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.639500 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.888751 (+1249251us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18000cb3e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1
0709 13:00:48.888929 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:48.888968 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.889040 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.889086 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:48.889097 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.896965 (+  7868us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4646,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":32931,"spinlock_wait_cycles":14347648,"thread_start_us":57418,"threads_started":1,"wal-append.queue_time_us":38589,"wal-append.run_cpu_time_us":1760,"wal-append.run_wall_time_us":1002253}
I20260709 13:00:48.918107  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 492) took 1152 ms. Trace:
I20260709 13:00:48.924185  2254 rpcz_store.cc:276] 0709 13:00:47.765737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.768512 (+  2775us) service_pool.cc:224] Handling call
0709 13:00:48.918021 (+1149509us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:48.922293  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.930716  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:48.931399  1605 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.909569  4091 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.929881  1675 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:48.905081  4369 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:48.933853  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92221.5us
I20260709 13:00:48.935190  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.935787  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.938337  1675 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:48.940222  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.918777  4235 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.917145  4326 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:48.940650  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.942098  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.943125  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.923815  4362 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.896090  4350 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:48.947461  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.931354  3962 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:48.946159  1683 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.944555  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:48.948870  1675 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
I20260709 13:00:48.953547  2254 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: [3.5-7.7]
I20260709 13:00:48.939328  4129 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.962265  1605 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:48.963841  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:48.941002  4235 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:48.955168  3938 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.000s	sys 0.013s
I20260709 13:00:48.968693  2254 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:48.971661  1682 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:48.909955  4231 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:48.973029  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:48.953176  3962 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:48.975668  4146 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:48.978533  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.978948  4030 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.979344  4172 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.948797  4362 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.909683  4077 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:48.995152  1678 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.010349  2254 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:49.000910  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0989201040000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:00:49.002635  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:49.004122  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1906) took 1338 ms. Trace:
W20260709 13:00:48.993880  3938 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.000s	sys 0.013s
I20260709 13:00:49.011711  1605 rpcz_store.cc:276] 0709 13:00:47.665631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.001493 (+1335862us) service_pool.cc:224] Handling call
0709 13:00:49.003560 (+  2067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.003755 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.003783 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.003826 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:49.003860 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.003929 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.004057 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.981096  4351 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.026501  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:49.033656  1683 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 4: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:49.035362  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.036639  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1909) took 1322 ms. Trace:
I20260709 13:00:49.037016  1605 rpcz_store.cc:276] 0709 13:00:47.714194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.034875 (+1320681us) service_pool.cc:224] Handling call
0709 13:00:49.036162 (+  1287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.036349 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.036372 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.036411 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:49.036442 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.036492 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.036589 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.038434  1605 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:49.041103  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:49.041886  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1583) took 1313 ms. Trace:
I20260709 13:00:49.042215  1605 rpcz_store.cc:276] 0709 13:00:47.728974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.037878 (+1308904us) service_pool.cc:224] Handling call
0709 13:00:49.038152 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.038712 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.041834 (+  3122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.044126  1605 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.017863  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 483) took 1451 ms. Trace:
I20260709 13:00:49.041704  1683 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:49.011726  4352 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.046978  1648 leader_election.cc:336] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.689s (SENT)
I20260709 13:00:49.048167  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1911) took 1316 ms. Trace:
I20260709 13:00:49.049750  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:49.045662  3962 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.051940  3962 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.054100  1683 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.009001  3851 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.049078  1605 rpcz_store.cc:276] 0709 13:00:47.731594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.043695 (+1312101us) service_pool.cc:224] Handling call
0709 13:00:49.043960 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.047221 (+  3261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.048117 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.057605  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:49.062794  4255 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.049374  4352 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.068867  4352 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:49.069314  2255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 496) took 1279 ms (client timeout 1512 ms). Trace:
W20260709 13:00:49.068881  4374 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:49.069757  2255 rpcz_store.cc:269] 0709 13:00:47.789582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.834153 (+ 44571us) service_pool.cc:224] Handling call
0709 13:00:49.069112 (+1234959us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400660154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.069253 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648901376}
I20260709 13:00:49.071419  4345 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:49.071790  4345 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:49.072604  4362 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.072649  4345 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.078907  4345 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.080782  1677 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:49.081310  4172 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:49.082067  1525 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:49.082255  1682 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.077546  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:49.082962  2253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 488) took 1499 ms (client timeout 1732 ms). Trace:
I20260709 13:00:49.083180  4030 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:49.084957  4362 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.085996  4350 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.080770  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1790) took 1327 ms. Trace:
I20260709 13:00:49.086985  1529 rpcz_store.cc:276] 0709 13:00:47.753159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.753337 (+   178us) service_pool.cc:224] Handling call
0709 13:00:49.080595 (+1327258us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54002a8354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.080717 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078380800}
I20260709 13:00:49.091725  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:49.092937  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45986.2us
I20260709 13:00:49.064966  4281 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:49.098088  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.425859   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:49.139266  1675 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:49.049494  4228 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:49.108639  1605 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:49.110756  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.145777  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1594) took 1399 ms. Trace:
I20260709 13:00:49.146236  1602 rpcz_store.cc:276] 0709 13:00:47.745981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.087084 (+1341103us) service_pool.cc:224] Handling call
0709 13:00:49.145237 (+ 58153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.145428 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.145454 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.145505 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:49.145538 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.145586 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.145713 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.146533  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1595) took 1394 ms. Trace:
I20260709 13:00:49.148581  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:49.147657  1605 rpcz_store.cc:276] 0709 13:00:47.752165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.108043 (+1355878us) service_pool.cc:224] Handling call
0709 13:00:49.108444 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.143437 (+ 34993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.146471 (+  3034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.157629  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:49.164863  1683 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:49.098340  4332 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.100219  4350 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.148737  4381 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.130s	user 0.002s	sys 0.003s
W20260709 13:00:49.179292  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.672s (SENT)
I20260709 13:00:49.179850  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:49.180863  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.182691  2255 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:49.185904  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.186554  1601 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.198307  3962 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:49.216792  1648 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.721s (SENT)
I20260709 13:00:49.218606  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.217593  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:49.220929  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.228636  1609 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:49.229509  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:49.087819  2253 rpcz_store.cc:269] 0709 13:00:47.583616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.587509 (+  3893us) service_pool.cc:224] Handling call
0709 13:00:49.082788 (+1495279us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400760f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.082907 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692760832}
I20260709 13:00:49.230248  1607 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:49.231886  4377 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:49.234710  4281 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:49.230182  1648 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.651s (SENT)
I20260709 13:00:49.242164  1601 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:49.244627  1674 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:49.198292  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.246855  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:49.247612  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:49.248082  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:49.251240  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.231786  4255 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.252218  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:49.224680  4350 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.222070  4352 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.254334  3851 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:49.255461  4320 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:49.252733  4390 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:00:49.263450  4239 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.200219  3955 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.274585  4233 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:49.275569  3955 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:49.276988  2259 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.283895  2259 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:49.285218  4304 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:49.287292  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 731) took 4577 ms. Trace:
I20260709 13:00:49.287149  4304 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.287741  2259 rpcz_store.cc:276] 0709 13:00:44.710038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.606706 (+896668us) service_pool.cc:224] Handling call
0709 13:00:45.682700 (+ 75994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.270540 (+587840us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b1800185dc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b6c646 00007f7e63aa658e 00007f7e63b27f9e 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:00:49.276586 (+3006046us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b58006c1dd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63a8d0aa 00007f7e63b0f447 00007f7e63b27fe7 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:00:49.287013 (+ 10427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.287231 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5185769600}
I20260709 13:00:49.289165  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:49.286495  4129 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.252038  4348 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.256507  3962 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.293296  3962 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.293681  4321 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.294104  4321 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:49.048691  2257 rpcz_store.cc:276] 0709 13:00:47.559630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.560914 (+  1284us) service_pool.cc:224] Handling call
0709 13:00:47.609945 (+ 49031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.771338 (+1161393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.779152 (+  7814us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.810146 (+ 30994us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.973326 (+163180us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:48.980118 (+  6792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.999632 (+ 19514us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.000577 (+   945us) raft_consensus.cc:1685] finished
0709 13:00:49.000593 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.010928 (+ 10335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19135,"raft.queue_time_us":19729,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6048,"thread_start_us":120789,"threads_started":1,"wal-append.queue_time_us":142083}
I20260709 13:00:49.294965  4321 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.289645  4254 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.296144  4321 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.297116  4225 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.252570  4311 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:49.296711  4254 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.266160  4350 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:49.299202  3962 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.307896  4350 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.311185  4350 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.311187  4327 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.312359  4327 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.311242  4320 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:49.352254  1430 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 3, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.358085  1430 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 2, term changed from 1 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 13:00:49.369535  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.372991  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1802) took 1584 ms. Trace:
I20260709 13:00:49.373535  1529 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:49.373726  1534 rpcz_store.cc:276] 0709 13:00:47.788270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.941274 (+153004us) service_pool.cc:224] Handling call
0709 13:00:49.372432 (+1431158us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001abb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.372725 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305441152}
I20260709 13:00:49.375974  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:49.256750  1602 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:49.384821  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.386008  1602 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
W20260709 13:00:49.387511  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 184) took 17931 ms (client timeout 15000 ms). Trace:
I20260709 13:00:49.391790  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.392779  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:49.392976  1605 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.393887  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.394409  1534 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:49.398970  1601 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:49.399922  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1914) took 1630 ms. Trace:
I20260709 13:00:49.402437  1603 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:49.408741  1528 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.408973  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1599) took 1632 ms. Trace:
I20260709 13:00:49.409456  1603 rpcz_store.cc:276] 0709 13:00:47.776792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.401219 (+1624427us) service_pool.cc:224] Handling call
0709 13:00:49.401833 (+   614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.408591 (+  6758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.408870 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.399497  1428 rpcz_store.cc:269] 0709 13:00:31.456171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.456475 (+   304us) service_pool.cc:224] Handling call
0709 13:00:49.387126 (+17930651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.537400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.678907 (+141507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.678967 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:00:39.678985 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:39.680078 (+  1093us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.680157 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.680185 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:39.681199 (+  1014us) tablet.cc:701] Row locks acquired
0709 13:00:39.681248 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:00:39.681436 (+   188us) write_op.cc:270] Start()
0709 13:00:39.681591 (+   155us) write_op.cc:276] Timestamp: P: 1783602039681350 usec, L: 0
0709 13:00:39.681612 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.682330 (+   718us) log.cc:844] Serialized 3693 byte log entry
0709 13:00:40.230646 (+548316us) op_driver.cc:464] REPLICATION: finished
0709 13:00:40.501268 (+270622us) write_op.cc:301] APPLY: starting
0709 13:00:40.501360 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:40.501604 (+   244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:40.501741 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:40.506445 (+  4704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:40.506802 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:00:40.506854 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:40.507243 (+   389us) log.cc:844] Serialized 71 byte log entry
0709 13:00:40.507474 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.507606 (+   132us) write_op.cc:454] Released schema lock
0709 13:00:40.507671 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:40.508066 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.508095 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":628256,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":270303,"apply.run_cpu_time_us":3835,"apply.run_wall_time_us":6776,"num_ops":9,"prepare.queue_time_us":144903,"prepare.run_cpu_time_us":29543,"prepare.run_wall_time_us":311212,"raft.queue_time_us":388415,"raft.run_cpu_time_us":41689,"raft.run_wall_time_us":192340,"replication_time_us":548861,"thread_start_us":661463,"threads_started":4,"wal-append.queue_time_us":156954,"wal-append.run_cpu_time_us":67708,"wal-append.run_wall_time_us":1669239}]]}
I20260709 13:00:49.387866  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.411230  1602 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:49.412425  1600 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:49.413462  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1596) took 1651 ms. Trace:
I20260709 13:00:49.414038  1600 rpcz_store.cc:276] 0709 13:00:47.761587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.395223 (+1633636us) service_pool.cc:224] Handling call
0709 13:00:49.395833 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.413048 (+ 17215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.413369 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.413719  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1916) took 1549 ms. Trace:
W20260709 13:00:49.407426  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.418684  1602 rpcz_store.cc:276] 0709 13:00:47.864743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.412102 (+1547359us) service_pool.cc:224] Handling call
0709 13:00:49.412728 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.413240 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.413276 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.413360 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:49.413424 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.413511 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.413631 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.408193  1601 rpcz_store.cc:276] 0709 13:00:47.769061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.397492 (+1628431us) service_pool.cc:224] Handling call
0709 13:00:49.398209 (+   717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.399534 (+  1325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.399804 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.418375  1607 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:49.425143  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.425477  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1918) took 1560 ms. Trace:
I20260709 13:00:49.425871  1607 rpcz_store.cc:276] 0709 13:00:47.865305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.417348 (+1552043us) service_pool.cc:224] Handling call
0709 13:00:49.417865 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.424407 (+  6542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.425423 (+  1016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.426285  1605 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
W20260709 13:00:49.419983  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.425210  1600 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:49.431883  1430 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 3, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.434496  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.434325  1430 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.427211  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.437039  1607 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:49.437530  1648 leader_election.cc:336] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.882s (SENT)
I20260709 13:00:49.438215  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:49.420946  1609 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:49.441058  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:49.415647  1498 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.512s (SENT)
I20260709 13:00:49.441946  1609 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:49.442646  1498 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.514s (SENT)
I20260709 13:00:49.445494  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:49.447146  1683 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:00:49.448266  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.259053  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1581) took 3546 ms (client timeout 2108 ms). Trace:
I20260709 13:00:49.254954  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1568) took 3797 ms. Trace:
I20260709 13:00:49.522301  1681 rpcz_store.cc:276] 0709 13:00:45.457676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.492883 (+ 35207us) service_pool.cc:224] Handling call
0709 13:00:45.559063 (+ 66180us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:45.591183 (+ 32120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.591218 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:45.800737 (+209519us) log.cc:844] Serialized 558 byte log entry
0709 13:00:46.339939 (+539202us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:47.361032 (+1021093us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.373111 (+ 12079us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.373355 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.689458 (+1316103us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002465e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419
0709 13:00:49.254656 (+565198us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:49.254703 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.254746 (+    43us) raft_consensus.cc:1685] finished
0709 13:00:49.254758 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.254895 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26066,"prepare.queue_time_us":143531,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":11353,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":84965,"spinlock_wait_cycles":78065792,"thread_start_us":361222,"threads_started":1,"wal-append.queue_time_us":656060,"wal-append.run_cpu_time_us":4934,"wal-append.run_wall_time_us":1885906}
W20260709 13:00:49.450727  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.533413  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.535039  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:49.537695  4320 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.435875  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:49.452627  1528 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:49.538255  4310 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:49.539443  4310 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:49.478149  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.539825  4310 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:49.271832  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:49.543576  2253 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:49.500655  3938 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:49.544762  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:49.545838  4267 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:49.546259  4267 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:49.546382  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.547766  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:49.485339  1600 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:49.549350  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.549832  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 754) took 1150 ms. Trace:
I20260709 13:00:49.550297  2260 rpcz_store.cc:276] 0709 13:00:48.399659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.620113 (+220454us) service_pool.cc:224] Handling call
0709 13:00:49.549420 (+929307us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400475c54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.549645 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900009856}
I20260709 13:00:49.550837  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.551608  1600 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:49.483847  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.490438  4171 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:49.490736  1430 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 4, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.553103  4171 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.494402  1609 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.554287  1430 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 4, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.438231  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:49.556473  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 118616us
W20260709 13:00:49.513235  4146 consensus_meta.cc:287] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:00:49.516666  4352 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.517125  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:49.520448  1676 rpcz_store.cc:269] 0709 13:00:45.712662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.922035 (+209373us) service_pool.cc:224] Handling call
0709 13:00:49.258916 (+3336881us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b54003566d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.259001 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6172686720}
W20260709 13:00:49.521495  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 132055us
I20260709 13:00:49.525317  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 495) took 1737 ms. Trace:
W20260709 13:00:49.441903  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.530644  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 478) took 3636 ms. Trace:
W20260709 13:00:49.538602  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 102951us
I20260709 13:00:49.458209  1607 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
W20260709 13:00:49.483567  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 497) took 1688 ms (client timeout 1514 ms). Trace:
I20260709 13:00:49.540347  1605 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.547523  4267 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.553745  4171 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:49.706102  4171 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.555277  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.495440  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1915) took 1660 ms. Trace:
I20260709 13:00:49.653366  4324 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.619369  1430 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 5, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:49.623489  2253 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:00:49.508138  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70847us
I20260709 13:00:49.556847  4265 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:49.550101  3962 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.623509  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:49.695489  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.694981  2258 rpcz_store.cc:276] 0709 13:00:45.893814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.379913 (+486099us) service_pool.cc:224] Handling call
0709 13:00:47.542816 (+1162903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.555038 (+ 12222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.530191 (+1975153us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002dc150. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.530423 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673573760}
W20260709 13:00:49.704528  4340 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.930s	user 0.010s	sys 0.042s
I20260709 13:00:49.711103  4324 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:49.713997  1430 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.714339  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.708113  4171 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.723382  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:49.728926  1609 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.693765  2256 rpcz_store.cc:276] 0709 13:00:47.787993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.923028 (+1135035us) service_pool.cc:224] Handling call
0709 13:00:48.933438 (+ 10410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.933637 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:49.184802 (+251165us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.524632 (+339830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.524712 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:49.524816 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.524931 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.525108 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":251072,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":12039,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":215,"spinlock_wait_cycles":11520,"thread_start_us":574034,"threads_started":2,"wal-append.queue_time_us":301144}
W20260709 13:00:49.743521  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.744107  4269 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.744805  4269 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.746968  1608 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:49.748406  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1582) took 2019 ms. Trace:
I20260709 13:00:49.749111  1430 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:49.708639  1603 rpcz_store.cc:276] 0709 13:00:47.835448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.410350 (+1574902us) service_pool.cc:224] Handling call
0709 13:00:49.411099 (+   749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.411567 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:49.412094 (+   527us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.494967 (+ 82873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.495070 (+   103us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:49.495129 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.495208 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.495345 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15488,"prepare.queue_time_us":45400,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":15744,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":284,"thread_start_us":58964,"threads_started":1,"wal-append.queue_time_us":64276}
I20260709 13:00:49.748824  1608 rpcz_store.cc:276] 0709 13:00:47.728460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.775155 (+1046695us) service_pool.cc:224] Handling call
0709 13:00:49.748058 (+972903us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54003845d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:49.748270 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201023872}
I20260709 13:00:49.754607  4267 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.755378  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.755537  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:49.757637  2260 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:49.743724  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:49.759428  2260 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:49.761566  1534 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:49.774536  3938 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.774897  1604 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:49.783046  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:49.783782  4254 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:49.786777  4320 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.759815  1648 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.690s (SENT)
W20260709 13:00:49.760501  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 225478us
I20260709 13:00:49.789170  4352 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.789744  4352 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:49.790189  4352 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:49.698673  2252 rpcz_store.cc:269] 0709 13:00:47.794622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.873130 (+ 78508us) service_pool.cc:224] Handling call
0709 13:00:48.624499 (+751369us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:49.198074 (+573575us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0ce9c 00007f7e60a0ca5b 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:00:49.483171 (+285097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21356544}
I20260709 13:00:49.757670  1608 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:49.788628  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 178176us
I20260709 13:00:49.788779  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.797665  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:49.800072  4129 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.765769  1603 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:49.768777  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:49.800091  1534 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:49.803112  1604 pending_rounds.cc:85] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 3
I20260709 13:00:49.763190  2258 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.766114  4356 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.748255  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:49.801838  1603 pending_rounds.cc:85] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:00:49.830242  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:49.830327  1608 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:49.800591  4129 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.804260  1604 pending_rounds.cc:107] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:49.750976  4310 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:49.845330  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.817902  1603 pending_rounds.cc:107] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:49.853377  1603 raft_consensus.cc:2889] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.855332  1604 raft_consensus.cc:2889] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:49.858884  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50321.8us
I20260709 13:00:49.871964  1605 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:49.752207  4265 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:49.892256  4265 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:49.893927  3962 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.879392  1608 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:00:49.880456  4235 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.004s
I20260709 13:00:49.851250  4351 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:49.884965  4304 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:49.821136  4356 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:49.885509  2259 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:49.888643  4241 raft_consensus.cc:2764] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:49.889900  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.921085  2260 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.892808  4343 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:49.867681  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:49.873771  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 407) took 1367 ms. Trace:
I20260709 13:00:49.909637  1603 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:49.848281  4354 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.921418  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1605) took 1425 ms. Trace:
W20260709 13:00:49.921516  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.860214  1649 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:49.929530  1609 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:49.944779  1608 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:49.922308  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:49.950507  1607 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:00:49.950364  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:49.950819  2256 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:49.954731  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.960973  1600 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:49.921407  4356 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.858815  4129 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.964874  3964 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:49.966003  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 113674us
I20260709 13:00:49.968442  4212 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.968951  1534 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:49.969501  1534 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:49.969992  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.970211  1532 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:49.969732  4350 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:49.937671  1602 rpcz_store.cc:276] 0709 13:00:48.495551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.419829 (+924278us) service_pool.cc:224] Handling call
0709 13:00:49.420324 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.420800 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:49.505350 (+ 84550us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.910266 (+404916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.910368 (+   102us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:49.921149 (+ 10781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.921220 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.921355 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42459,"prepare.queue_time_us":58348,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":30740,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":35973,"thread_start_us":434674,"threads_started":3,"wal-append.queue_time_us":248103}
I20260709 13:00:49.971514  4351 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.971900  4351 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:49.972965  4351 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.974385  4351 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.977584  1606 raft_consensus.cc:2368] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
W20260709 13:00:49.995144  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.008708  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:50.009763  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 143386us
I20260709 13:00:50.012156  4269 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.013247  4254 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.017134  1532 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 13:00:50.017820  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.018379  4077 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:50.018494  1525 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:49.937532  4354 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:49.931028  1601 rpcz_store.cc:276] 0709 13:00:48.498333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.423526 (+925193us) service_pool.cc:224] Handling call
0709 13:00:49.423961 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.424586 (+   625us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:49.479119 (+ 54533us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.717965 (+238846us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.865188 (+147223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.865257 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:49.865326 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.865420 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.865592 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67550,"prepare.queue_time_us":57911,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":134280,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":14714,"thread_start_us":349058,"threads_started":3,"wal-append.queue_time_us":175171}
I20260709 13:00:50.015646  4352 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.031317  1603 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:49.938750  4235 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:49.773517  4324 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:50.032097  1532 pending_rounds.cc:85] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 5
I20260709 13:00:50.043824  1532 pending_rounds.cc:107] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:49.976488  3955 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.968501  4250 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:50.046568  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 253157us
W20260709 13:00:50.046995  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.047657  4345 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:50.048245  4321 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:50.044442  1532 raft_consensus.cc:2889] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.049245  4321 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.049391  4345 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.049970  4345 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:50.050124  3955 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.051276  4345 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.053222  1534 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.053705  4354 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.054617  3955 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.054852  1534 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.055305  4354 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.055634  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 338516us
I20260709 13:00:50.057580  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.058521  4269 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.058941  4269 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:50.059336  4269 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.061602  2256 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:50.025885  3938 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.969326  4362 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:00:49.969056  4212 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.053674  4345 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.042752  4254 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:50.033448  4267 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:00:50.103549  2254 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 9. Ops: []
I20260709 13:00:50.103240  3938 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.093848  4250 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:50.120672  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.124603  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.126968  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.138394  1528 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 3.
W20260709 13:00:50.121616  4225 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.007s
I20260709 13:00:50.119709  4250 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:00:50.144454  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 176582us
I20260709 13:00:50.120288  4352 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:50.153538  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.154050  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.154129  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:50.154733  4310 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.127612  4254 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.249686  3938 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:50.177589  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68133.7us
I20260709 13:00:50.253127  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.255441  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:50.184461  4402 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.198590  3964 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.257236  4269 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.200186  2261 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:50.259687  4269 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:50.259859  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 484) took 2699 ms (client timeout 1792 ms). Trace:
I20260709 13:00:50.217716  4212 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.117853  4077 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:50.260242  2261 rpcz_store.cc:269] 0709 13:00:47.559910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.560023 (+   113us) service_pool.cc:224] Handling call
0709 13:00:50.259609 (+2699586us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:50.259769 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6016415488}
I20260709 13:00:50.261291  4355 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.261955  4077 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.261829  4355 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.262528  4077 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.262880  4077 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.263248  4077 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.233096  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 79036.5us
I20260709 13:00:50.265044  3955 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.265656  3955 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:50.266649  3955 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.235277  4282 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.267709  4282 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.268778  4282 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.269292  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:50.271531  1601 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:50.273010  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:50.273326  4355 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.235925  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 499) took 1473 ms. Trace:
W20260709 13:00:50.237730  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 85997.8us
I20260709 13:00:50.238510  4406 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.239835  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.240229  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.241499  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.257382  3964 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.274732  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:50.233469  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.276216  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.276764  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.277976  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.278767  4267 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.273922  2254 rpcz_store.cc:276] 0709 13:00:48.762036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.011097 (+249061us) service_pool.cc:224] Handling call
0709 13:00:49.037418 (+ 26321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.118524 (+1081106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.235605 (+117081us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005c0b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:50.235846 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438873856}
I20260709 13:00:50.279954  4402 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.280515  1600 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.280802  4402 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.281325  4402 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.283901  4402 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.274204  4406 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:50.284807  4406 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.225993  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:50.267196  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.276055  3964 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.298429  1534 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:50.298986  1534 pending_rounds.cc:85] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 5
I20260709 13:00:50.299264  1534 pending_rounds.cc:107] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:50.299840  1534 raft_consensus.cc:2889] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.243992  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.279621  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.279285  4267 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:50.301218  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 241823us
W20260709 13:00:50.305368  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 257714us
I20260709 13:00:50.313055  1600 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:50.280155  4212 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:50.324728  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.296202  4269 raft_consensus.cc:2764] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:50.305969  4267 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:50.323091  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.329831  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.317011  4402 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.332240  3964 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.301803  4351 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:50.340910  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:50.341768  2254 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.344926  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.348418  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.346815  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1913) took 2593 ms. Trace:
I20260709 13:00:50.321192  3938 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:50.358618  1604 rpcz_store.cc:276] 0709 13:00:47.745818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.067195 (+1321377us) service_pool.cc:224] Handling call
0709 13:00:49.774293 (+707098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.878391 (+104098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.337548 (+459157us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54003845d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:50.338944 (+  1396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570706816}
W20260709 13:00:50.362161  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 136290us
I20260709 13:00:50.332937  4402 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:50.367136  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.364800  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:50.369418  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.370263  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.370163  4171 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:50.341715  4269 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:50.383036  2260 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:50.386018  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:50.389226  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.391620  2261 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:50.391801  2258 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:50.367462  3964 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:50.375349  4402 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.329293  4265 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:50.409173  2259 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:50.415850  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:50.419620  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46706.1us
I20260709 13:00:50.425393  3964 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.427553  3964 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.383061  4241 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:00:50.429174  4241 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.430262  2252 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:50.430770  4077 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.431806  2253 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:50.432901  4077 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.433553  4265 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.436436  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.437265  2255 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:50.440268  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:50.442399  1648 leader_election.cc:336] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.796s (SENT)
I20260709 13:00:50.442987  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:50.448045  1648 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.113s (SENT)
I20260709 13:00:50.462005  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.467487  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.410686  4356 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.473348  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.477660  4414 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.477676  4408 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:00:50.478845  4356 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.479458  4408 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:50.479966  4408 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.480873  4408 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.479688  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.482159  4408 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.483923  4077 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:50.486384  2259 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:00:50.488926  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 212230us
I20260709 13:00:50.452268  4354 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:50.467263  4265 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.515527  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.516601  4421 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.517096  4421 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:50.518062  4421 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.519546  4421 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.521201  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.526108  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 81792.3us
W20260709 13:00:50.525923  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 155796us
I20260709 13:00:50.527388  2254 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:50.530206  4129 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:00:50.530664  4129 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:50.532819  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65927.9us
I20260709 13:00:50.535462  4413 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.536543  4225 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:50.537611  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.526206  4355 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:50.544735  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 300904us
I20260709 13:00:50.535151  4267 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.552531  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.553465  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.554730  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:50.555745  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:50.558933  4416 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.559163  4408 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.559736  4408 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.561839  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.563375  4324 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.563234  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14da2914452f44cca76332a550a28b6b"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:50.564105  1604 raft_consensus.cc:606] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.564524  4311 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.565362  4426 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:50.566179  4426 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.567816  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:50.568486  1604 raft_consensus.cc:606] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.568850  1604 raft_consensus.cc:614] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:50.570500  1607 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.571959  4241 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.577589  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:50.575910  4241 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:50.579279  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:50.579906  1600 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.554768  4419 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.582502  3962 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:50.579694  4241 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.582944  3962 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.583650  4241 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.585601  4235 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:50.587689  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.583951  3962 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.572206  4077 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:00:50.593566  4267 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.595293  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:50.596628  4225 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.597347  4225 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.597916  4350 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.598315  4414 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:50.598465  4350 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.599144  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.598927  4414 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.600435  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:50.601089  4414 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:50.602901  1675 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:50.603809  4320 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.551877  4265 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.604599  4320 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.604813  4265 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.607609  4265 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.607892  3955 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.608445  3955 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:50.609052  4129 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:50.609493  3955 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.611028  3955 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.614692  3962 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.617668  3938 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.618213  3938 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:50.619128  3938 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.621454  4343 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:50.621907  4343 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.622885  4343 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:50.627506  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50100.3us
I20260709 13:00:50.602212  4235 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.628131  4408 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.629067  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:50.615002  4417 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:50.631923  2254 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:50.633781  4426 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.634610  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.635349  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
W20260709 13:00:50.636181  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.636857  4320 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.637251  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:50.624195  4343 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.592295  4406 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.634904  4350 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.636924  4426 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:50.641356  4426 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:50.641753  4426 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.642946  4426 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.638023  4352 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.644569  4352 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.644944  4352 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.644147  4426 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.655414  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:50.649137  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.650385  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.660948  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.664727  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 79288us
W20260709 13:00:50.666275  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 112873us
W20260709 13:00:50.636209  4424 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 13:00:50.666263  1600 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:50.638119  3938 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.675650  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.677131  1608 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:50.678052  3955 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:50.678153  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.679138  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:50.681015  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:50.682853  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:50.683359  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:50.660454  4406 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:50.671927  4320 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.701045  1604 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:50.637665  4402 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.704458  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:50.706211  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:50.706857  1608 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.707536  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 108480us
I20260709 13:00:50.704830  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:50.678839  3962 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.710335  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:50.711895  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:50.716126  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:50.719175  1601 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:50.672560  4225 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:50.693819  4324 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:00:50.721845  1609 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:50.717830  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:00:50.729004  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50918.3us
I20260709 13:00:50.695231  4421 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:00:50.730880  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51812.4us
W20260709 13:00:50.738919  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58001.8us
I20260709 13:00:50.732661  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:50.718096  4320 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:50.701359  4265 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:50.743408  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:50.746416  4403 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.746884  4355 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.746443  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.728626  4077 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.748155  1601 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.747505  4327 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.737427  4282 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.757032  4403 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.740543  4423 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.774180  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:50.801656  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57132.2us
W20260709 13:00:50.809478  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 72679.8us
W20260709 13:00:50.813222  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 69425.4us
W20260709 13:00:50.813300  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 173008us
I20260709 13:00:50.738255  3962 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.773765  4406 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.826651  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:50.810835  4403 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.818454  4282 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.746623  4354 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:00:50.796203  4355 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:50.800544  4077 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:50.758054  4362 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:00:50.816402  4350 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.837353  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 63341.8us
I20260709 13:00:50.838251  4415 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.838622  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:50.839578  4265 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.824460  4321 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:00:50.837627  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.841316  4422 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.840481  1534 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:50.809890  4310 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:50.819530  4327 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:50.858007  4327 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:50.849187  1604 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.852613  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.854027  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.854660  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.833827  4421 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.825067  4356 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:50.796041  4416 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:50.824894  4212 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:50.887836  1609 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:50.889918  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63329.3us
I20260709 13:00:50.846733  4422 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.891719  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.898757  4419 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.905294  3962 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.880475  4423 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.842101  4345 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:50.912588  4355 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.913730  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:50.914083  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:50.914856  1681 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.910346  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:50.917356  1675 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:50.920051  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:50.920753  3955 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.921350  3955 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.892767  4265 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:00:50.922503  4324 raft_consensus.cc:2764] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:50.923372  4324 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.924592  1676 raft_consensus.cc:2376] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6. Re-sending same reply.
I20260709 13:00:50.925114  4343 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:50.925580  4343 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:50.931548  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:50.937374  1678 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:50.924083  3955 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:50.984411  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:51.004577  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75882.3us
I20260709 13:00:50.987193  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:50.852895  4415 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:00:51.012270  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 199054us
I20260709 13:00:51.053630  1534 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:51.047132  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.022051  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 90579.6us
W20260709 13:00:50.938556  1648 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.639s (SENT)
I20260709 13:00:51.057350  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.049472  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.059819  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:50.896948  4402 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:51.061164  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51080.9us
W20260709 13:00:51.061524  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 235193us
I20260709 13:00:50.990345  4427 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:51.069983  1607 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.070345  1500 leader_election.cc:400] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:51.070636  1500 leader_election.cc:403] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.925515  4310 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:50.895448  4422 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.013101  4235 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:50.984439  4413 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:51.059288  3955 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.890659  4350 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.926740  3962 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 13:00:51.085124  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:51.085955  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.143226  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:50.907228  4423 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:50.895567  4320 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.216210  1606 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:51.145128  4414 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.073483  3938 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.062191  4212 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:51.088364  3955 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:51.245395  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.270439  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.181846  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.074792  4310 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:51.081980  4413 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:51.073254  4311 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.226411  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:51.251446  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 173746us
I20260709 13:00:51.079452  4235 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:51.253118  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 201094us
I20260709 13:00:50.922538  4077 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:51.255831  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 170778us
W20260709 13:00:51.217161  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.077932  4352 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.257592  1525 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:51.268977  4129 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.089354  4427 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.144094  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.145727  4426 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
W20260709 13:00:51.275054  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.255250  4415 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.286651  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:51.260159  4438 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:51.291750  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 396053us
I20260709 13:00:51.292366  2256 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.279516  3955 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.298970  1532 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:51.317170  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:51.319024  4415 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.333921  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.289312  4406 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.198561  4282 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.320663  1534 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:51.342408  1676 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:51.333343  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.345606  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.345698  1531 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:51.348462  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.352888  1529 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:51.333316  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:51.355062  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.873s (SENT)
I20260709 13:00:51.298930  4416 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:00:51.344928  4406 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:51.350226  4419 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.361896  1530 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:51.299185  4311 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.319322  4129 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:51.369206  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77235.1us
I20260709 13:00:51.373643  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:51.376675  1528 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:51.374509  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.368381  4406 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.360005  4446 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.406275  1528 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.344477  4413 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.408337  4413 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.377769  4355 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:51.415329  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65607.7us
W20260709 13:00:51.416343  1608 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.000s
I20260709 13:00:51.418187  1529 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.427769  1608 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:51.450220  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:51.406111  4225 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.459779  1601 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.002s
I20260709 13:00:51.460258  1601 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:00:51.461759  4411 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:51.462409  4411 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.463157  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.464735  4350 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.465373  4311 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:51.466459  4421 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.576s	user 0.002s	sys 0.006s
I20260709 13:00:51.367965  4310 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.366436  4235 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:51.462013  4442 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:00:51.446475  4419 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.487022  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:51.450224  4355 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.489825  2258 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:51.464635  4411 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:51.479301  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:51.486275  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:51.462013  4439 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:00:51.469345  4446 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.466888  4421 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.498775  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:51.502004  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:51.506351  1608 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:51.508615  1530 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:51.510263  1681 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 13:00:51.518103  1681 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:51.518659  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:51.520062  1601 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:51.487975  4427 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.520649  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.478789  4450 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.510839  1602 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:00:51.525496  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 151928us
I20260709 13:00:51.526839  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:51.539778  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.545280  2256 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:51.545873  2256 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 4
I20260709 13:00:51.546205  2256 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:00:51.548300  4457 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.548666  4212 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.549036  4457 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.549378  4212 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.551909  4212 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:51.552570  4457 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.546721  2256 raft_consensus.cc:2917] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:00:51.519847  4327 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.523245  4362 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:51.523806  4411 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.561307  1683 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:51.568392  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 101413us
I20260709 13:00:51.526980  4310 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.560819  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 97765.4us
I20260709 13:00:51.561523  4421 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.560966  4453 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:51.562019  1674 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:51.577260  1681 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.526559  4352 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.570339  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.579452  1528 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:51.560338  2256 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.531070  4250 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.501258  4225 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.586443  4225 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:51.587255  2259 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:51.557991  4362 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:51.574728  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.575892  1529 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:00:51.581036  2253 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.593165  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:51.594918  1682 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:51.596145  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.918s (SENT)
I20260709 13:00:51.596690  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.596835  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:51.597687  4462 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:51.599056  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.925s (SENT)
W20260709 13:00:51.581267  4440 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:00:51.578980  4435 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:00:51.581858  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.601632  1527 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.574388  4327 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.606438  4327 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:51.606287  4343 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.607425  4343 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:51.582970  4445 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:51.582873  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:51.609010  1680 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:00:51.609671  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 89091.6us
I20260709 13:00:51.610419  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:51.583698  4441 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:00:51.510560  4446 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:51.611270  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:51.612787  4411 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.613221  4411 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.613592  4411 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.612859  1530 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:51.588842  4443 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:00:51.616849  4348 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:51.617218  4408 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:51.617633  4408 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:51.618511  4408 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:51.619634  4408 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:51.582178  4449 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:51.624648  1527 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:51.599527  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.625387  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:51.561352  4452 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:51.701376  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 72034.5us
I20260709 13:00:51.703287  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.704394  1527 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:00:51.714709  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 124837us
I20260709 13:00:51.718638  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:51.719827  4225 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.720588  4225 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:51.720438  4453 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:51.617394  4348 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:51.719908  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:51.721683  4225 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.722900  4410 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.723580  4410 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.722813  4348 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:51.723910  4410 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.722102  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.725813  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.772791  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:51.803855  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:51.804513  2259 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.701090  4129 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.805548  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:51.774176  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:51.809391  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:51.810371  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 211319us
I20260709 13:00:51.809023  3964 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:51.735090  4354 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:51.717577  4254 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.818046  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 192691us
I20260709 13:00:51.920718  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:51.833230  4415 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:51.572857  4450 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:52.023388  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:51.835872  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:51.951737  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.835314  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:52.023916  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 218451us
I20260709 13:00:52.026086  2255 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:51.727135  4423 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:51.732076  4414 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:52.032106  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.032035  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.037281  1683 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
W20260709 13:00:52.038901  1648 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.940s (SENT)
I20260709 13:00:52.038709  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.039724  1679 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:52.044940  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:52.049085  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 229767us
I20260709 13:00:52.019768  4129 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.054553  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.019681  4345 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.036854  4403 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.189s	user 0.011s	sys 0.001s
I20260709 13:00:52.055918  1681 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:52.031107  4354 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:51.809283  4320 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.232s
I20260709 13:00:52.069459  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.040040  4457 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:52.099177  1527 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:52.087142  1680 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.033965  4426 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.053455  4424 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:00:52.051115  4352 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:52.105974  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.046022  4241 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.038575  4415 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.046180  3964 consensus_queue.cc:1243] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:52.052959  4311 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:52.110132  4426 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.120869  4241 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.060156  4129 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:51.838092  4462 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.261s
I20260709 13:00:52.024705  4254 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.022634  4459 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.263s
I20260709 13:00:52.097103  4427 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:52.157951  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.073308  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:52.126175  4355 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:52.157369  4422 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.995s	user 0.011s	sys 0.000s
W20260709 13:00:52.175768  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 145049us
I20260709 13:00:52.157691  4129 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.138451  4446 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:52.187320  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 114098us
I20260709 13:00:52.198815  4467 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.198874  4473 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:00:52.196846  4457 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.195150  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.157462  4311 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:52.099916  4403 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.216392  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.217624  1530 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:52.223407  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 134476us
I20260709 13:00:52.169782  4415 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.166771  4345 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.218189  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.952s (SENT)
I20260709 13:00:52.205209  4423 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.188171  4422 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.209203  4446 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:52.248046  1528 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:00:52.249027  4466 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:52.217446  4457 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.266251  4457 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.268446  4450 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:52.269833  4403 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.271569  4415 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:52.273347  4345 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.269761  4426 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.194067  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:52.261186  4472 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:52.262728  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:52.276675  4472 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.276707  1530 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:52.278595  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.279487  4472 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:52.279878  4472 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:52.280392  4472 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.283736  4457 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.284349  4311 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.286249  3955 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.006s
I20260709 13:00:52.286713  3955 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.289119  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.294909  1525 raft_consensus.cc:2368] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:52.296013  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
W20260709 13:00:52.297976  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 92794.1us
I20260709 13:00:52.204442  4354 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.302913  1648 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.669s (SENT)
I20260709 13:00:52.303458  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:52.293506  4438 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.946s	user 0.000s	sys 0.010s
W20260709 13:00:52.296044  4343 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.688s	user 0.001s	sys 0.008s
W20260709 13:00:52.286247  4310 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.002s
W20260709 13:00:52.295569  4406 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.850s	user 0.007s	sys 0.003s
W20260709 13:00:52.314038  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 393384us
I20260709 13:00:52.314442  4406 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.315927  1607 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.221022  4467 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.250751  4423 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.348770  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:52.312675  4438 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:52.330915  4241 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:52.363332  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.367523  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.371297  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:52.376781  1529 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:52.364620  4345 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.391144  4345 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.392877  4478 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:00:52.393304  4345 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:52.393057  4129 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.384572  4425 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:52.384895  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:52.395293  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.385573  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.397272  4425 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.398535  4425 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.398818  1532 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:52.400437  4457 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.402017  4406 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.395231  4129 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.403899  4467 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.405464  4423 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.406394  4254 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:52.407636  1534 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
W20260709 13:00:52.385905  4482 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:52.386761  2253 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:52.417557  2253 pending_rounds.cc:85] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 6
I20260709 13:00:52.417860  2253 pending_rounds.cc:107] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:52.418123  2253 raft_consensus.cc:2889] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.387738  3955 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.388453  4241 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:52.389410  4422 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:52.369180  4474 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.004s
W20260709 13:00:52.409013  4408 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.004s
I20260709 13:00:52.421131  4310 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:52.373961  4472 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.431344  4241 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:52.448537  4411 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.835s	user 0.007s	sys 0.003s
I20260709 13:00:52.448963  4411 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.451177  4422 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:52.451823  4422 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:52.437064  4481 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:52.454054  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1957) took 1112 ms. Trace:
I20260709 13:00:52.441968  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:52.457290  1609 rpcz_store.cc:276] 0709 13:00:51.341751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.342114 (+   363us) service_pool.cc:224] Handling call
0709 13:00:51.355183 (+ 13069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.857376 (+502193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.857412 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.032378 (+174966us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.238769 (+206391us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:52.238809 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.238885 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.453811 (+214926us) raft_consensus.cc:1685] finished
0709 13:00:52.453832 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.453983 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168663,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4590,"thread_start_us":638959,"threads_started":2,"wal-append.queue_time_us":182768}
I20260709 13:00:52.463363  1601 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:52.464820  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.465677  1602 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:52.474267  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.475339  1608 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:52.476588  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.477348  1601 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:52.482546  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.483714  1602 raft_consensus.cc:2410] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:52.450358  4241 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.448475  4472 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.489876  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:52.492280  1603 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.451207  4411 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.456678  4423 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:52.515121  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.515954  1528 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:52.517232  1528 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:52.517577  1528 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:00:52.518914  4410 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.000s
I20260709 13:00:52.518697  1528 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.519402  4410 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.520453  1528 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.528752  1528 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:52.528409  4423 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.530843  4423 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.497016  4422 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.496768  3955 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.533644  3955 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.535830  3955 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.538069  1528 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:52.538816  1528 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 4
I20260709 13:00:52.539227  1528 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:00:52.539394  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.539839  1528 raft_consensus.cc:2917] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:00:52.540017  1605 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:52.540643  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.541045  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:52.541404  1600 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:52.542110  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.542608  1600 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:52.542778  1605 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:52.545351  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 434) took 1169 ms. Trace:
I20260709 13:00:52.544118  1605 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:00:52.546649  1605 pending_rounds.cc:85] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:00:52.547230  1605 pending_rounds.cc:107] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:52.547569  1605 raft_consensus.cc:2889] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.548137  1528 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.545753  1607 rpcz_store.cc:276] 0709 13:00:51.376174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.376359 (+   185us) service_pool.cc:224] Handling call
0709 13:00:51.397505 (+ 21146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.316277 (+918772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.545143 (+228866us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:52.545295 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111754496}
I20260709 13:00:52.556340  2255 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:00:52.556526  1531 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:52.558622  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:52.561560  1528 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:52.566293  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.570509  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.566053  4320 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.573516  3955 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.573647  4320 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:00:52.575006  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 179816us
W20260709 13:00:52.565992  4477 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.429s	user 0.010s	sys 0.008s
I20260709 13:00:52.571949  1608 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:52.580598  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:52.578732  4446 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:52.585402  4457 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.587706  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1777) took 1298 ms. Trace:
I20260709 13:00:52.588186  1525 rpcz_store.cc:276] 0709 13:00:51.289725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.301653 (+ 11928us) service_pool.cc:224] Handling call
0709 13:00:52.587464 (+1285811us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54000d43d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:52.587639 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172924160}
W20260709 13:00:52.589812  4212 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:52.591758  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.592828  1526 raft_consensus.cc:2368] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6.
I20260709 13:00:52.574158  3955 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.574272  4320 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.602288  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.601419  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.604179  1603 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:52.608337  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.609763  1608 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:52.606690  1605 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:52.616464  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.617164  1605 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:52.618443  1605 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:52.596295  3955 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.620041  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.622051  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:52.622881  1608 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.627224  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:52.628528  1603 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:52.621053  4423 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.635210  1605 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:00:52.635864  1605 pending_rounds.cc:85] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:00:52.636169  1605 pending_rounds.cc:107] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:52.637970  1605 raft_consensus.cc:2889] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:52.636739  4352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.021s	sys 0.011s
I20260709 13:00:52.660820  1602 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.631421  4423 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:52.664904  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.665413  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:52.661664  4352 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:52.646682  1608 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:52.647415  4421 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:52.670594  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.649616  4456 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:52.638829  4422 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.663601  4423 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.654454  3955 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.659189  4413 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.660223  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.670571  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.648893  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.671365  1608 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:52.688614  1603 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:52.671816  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.651695  4410 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:52.676648  4451 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:52.692963  4451 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.695381  4451 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.694926  4362 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.686511  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:52.697290  4483 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.260s	user 0.004s	sys 0.000s
I20260709 13:00:52.699621  1530 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:52.705996  4352 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.707108  4310 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.707621  4310 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.708469  4446 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:52.672523  4456 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:52.710630  1609 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:52.715910  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.720227  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.720604  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:00:52.721343  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46826.8us
I20260709 13:00:52.721746  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.723644  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:52.720068  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:52.724841  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 76095.1us
I20260709 13:00:52.725504  1530 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 3.
I20260709 13:00:52.727128  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.727596  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:52.727830  1531 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.728363  2253 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:52.733669  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.734436  1525 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:52.736572  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.703231  4362 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.737453  1528 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:52.742405  1609 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:52.671255  4320 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.720978  4421 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.717152  4423 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.751497  1531 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:52.752499  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:52.723871  4451 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.702816  3955 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.754714  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.709808  4413 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.759946  2255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:00:52.760496  2255 raft_consensus.cc:606] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.760819  2255 raft_consensus.cc:614] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:52.751451  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.757999  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.763736  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:52.767918  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 369) took 1405 ms. Trace:
I20260709 13:00:52.757252  4254 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:00:52.743589  4476 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:52.771126  4476 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:52.771507  4476 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:52.772568  4485 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.773476  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.774326  4129 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.774746  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.774848  4129 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.758687  4451 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.776147  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.777246  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.777400  4451 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.774041  4343 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:52.773643  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.773082  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 470198us
W20260709 13:00:52.779814  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.700s (SENT) [suppressed 35 similar messages]
I20260709 13:00:52.780679  4456 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.767773  4462 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.781798  4456 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.780803  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.782912  1683 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:52.784005  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.777155  4129 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.774206  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.788668  1680 raft_consensus.cc:2376] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8. Re-sending same reply.
I20260709 13:00:52.772508  4476 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.789597  4470 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
I20260709 13:00:52.781926  1681 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:52.791519  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.792591  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 516) took 1306 ms. Trace:
I20260709 13:00:52.781823  4462 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.773150  4485 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.793628  4423 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.789757  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.796372  1680 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:52.774111  1677 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:52.809528  1683 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
W20260709 13:00:52.761988  1574 connection.cc:256] RPC call timeout handler was delayed by -2.4063415100000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:00:52.819169  1574 connection.cc:256] RPC call timeout handler was delayed by -2.3064415100000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 13:00:52.753541  4421 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:52.819689  1526 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:52.820039  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:52.799604  1678 rpcz_store.cc:276] 0709 13:00:51.362815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.362960 (+   145us) service_pool.cc:224] Handling call
0709 13:00:51.374543 (+ 11583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.374740 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:51.849779 (+475039us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.218088 (+368309us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.658987 (+440899us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b180027d900. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:52.767404 (+108417us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b180027d900. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:00:52.767548 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.767592 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:52.767637 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.767699 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.767840 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169807,"prepare.queue_time_us":49715,"prepare.run_cpu_time_us":484,"prepare.run_wall_time_us":1410,"raft.queue_time_us":591145,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":11341,"spinlock_wait_cycles":148569984,"thread_start_us":599559,"threads_started":2,"wal-append.queue_time_us":273180}
I20260709 13:00:52.797030  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:52.821722  1606 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:52.824412  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44619.7us
I20260709 13:00:52.826267  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:52.822069  1683 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:52.827257  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:52.793087  2252 rpcz_store.cc:276] 0709 13:00:51.486631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.489598 (+  2967us) service_pool.cc:224] Handling call
0709 13:00:51.537528 (+ 47930us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:51.576648 (+ 39120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.576689 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:51.588774 (+ 12085us) log.cc:844] Serialized 52 byte log entry
0709 13:00:51.841187 (+252413us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:51.841228 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.841298 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.788915 (+947617us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:52.792176 (+  3261us) raft_consensus.cc:1685] finished
0709 13:00:52.792202 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.792513 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11503,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6296,"spinlock_wait_cycles":6473088,"thread_start_us":246813,"threads_started":1,"wal-append.queue_time_us":595203}
W20260709 13:00:52.830597  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.827859  1607 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
W20260709 13:00:52.830606  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75634.2us
I20260709 13:00:52.832046  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.794904  4485 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:52.833662  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.818431  4446 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.834311  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:52.935238  1680 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:00:52.931602  1678 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:52.930397  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.868144  1681 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:52.862726  1682 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:52.835143  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:52.889524  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54978.7us
I20260709 13:00:52.905277  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:52.882251  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.863111  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.950376  1531 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:52.950693  1676 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:52.951189  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1626) took 1370 ms. Trace:
I20260709 13:00:52.913704  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.951493  1676 rpcz_store.cc:276] 0709 13:00:51.580846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.881945 (+1301099us) service_pool.cc:224] Handling call
0709 13:00:52.951134 (+ 69189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:52.861032  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:52.894430  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:52.956979  1674 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:00:52.959931  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 98993.6us
I20260709 13:00:52.906764  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:52.962487  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 55823us
W20260709 13:00:52.868551  4499 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:00:52.834229  4254 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:52.930843  4421 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.961787  4446 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:52.966421  4485 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.968801  4485 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.969208  4485 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.969575  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.969717  4446 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.962025  4463 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.967638  4254 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.906597  4129 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:52.970947  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.971434  4254 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.834928  4451 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:00:52.972915  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:52.836253  4356 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.966404  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:52.834810  4410 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
W20260709 13:00:52.993371  1648 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.109s (SENT)
I20260709 13:00:52.861900  4402 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.973592  1674 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.974364  1526 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:52.964898  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:52.958341  4320 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.960863  4413 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:52.976284  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:52.971706  4129 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:52.966367  4212 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:52.978807  2258 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:52.914165  4462 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:52.980159  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 145962us
I20260709 13:00:52.980710  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.009335  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:52.876322  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.831166  4423 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 13:00:52.882436  4459 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:52.978132  4356 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.998731  4354 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.834260  1675 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:52.988368  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:52.989488  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.991056  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:52.835366  4476 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.994410  4310 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:52.972826  4503 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:00:52.996129  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.008037  1531 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
W20260709 13:00:53.035315  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 202783us
I20260709 13:00:53.014935  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.036657  1680 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:53.014954  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.037519  2252 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 3.
I20260709 13:00:53.024302  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.028667  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.023144  1529 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.001219  4414 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.029995  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.015714  3955 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.023665  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:53.035631  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:53.023653  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1631) took 1252 ms (client timeout 1504 ms). Trace:
W20260709 13:00:53.052143  1675 rpcz_store.cc:269] 0709 13:00:51.771105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.833432 (+1062327us) service_pool.cc:224] Handling call
0709 13:00:53.023574 (+190142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.022492  4212 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:53.053277  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.053928  1675 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:53.054899  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:53.055449  1675 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.053788  4212 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.038604  1678 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:53.058245  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.058809  4129 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.059954  1678 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:53.061036  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:53.061231  4502 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:00:53.061619  1678 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.063078  4254 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.064059  1529 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:53.066231  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.066838  1531 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:53.043874  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.039063  1683 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:53.067442  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:53.039415  2259 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:53.045979  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.069754  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.027468  4356 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.025839  4459 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.049677  4410 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:53.050014  1602 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.077852  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.078740  1678 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:53.050572  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.050547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:53.048637  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.071416  1532 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.072198  1677 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:53.024410  4354 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.074077  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.074383  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:53.074702  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 81392.8us
I20260709 13:00:53.076025  1525 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:53.085383  1681 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:53.085455  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:53.011423  4402 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.084048  1676 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
W20260709 13:00:53.076810  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 53240.7us
I20260709 13:00:53.089980  1603 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.090636  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:53.094974  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 189794us
I20260709 13:00:53.086951  4491 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.111227  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:53.111490  4491 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:53.112637  4491 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.114180  1676 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.098793  4426 raft_consensus.cc:1064] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:00:53.087142  4354 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.100896  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:53.123230  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72758.7us
W20260709 13:00:53.101454  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.124683  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.125000  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.101629  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.122318  1532 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:53.126030  1530 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:53.101807  4462 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.126677  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.127183  4462 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.106078  4459 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.130302  4462 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:53.125069  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.131448  1648 connection.cc:256] RPC call timeout handler was delayed by -1.1180661419999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:00:53.131780  1648 connection.cc:256] RPC call timeout handler was delayed by -1.1045661420000101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:00:53.108529  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:53.128041  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.132825  1532 raft_consensus.cc:2376] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7. Re-sending same reply.
I20260709 13:00:53.126773  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.134140  1530 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:53.135195  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.135869  1530 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:53.110296  4402 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.121609  1674 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:53.132592  1683 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.122377  2256 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:53.138051  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.138857  1532 raft_consensus.cc:2368] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:53.073549  4414 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:53.083711  4129 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.153981  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.143491  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.165385  1678 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:53.165555  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.166281  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:53.167227  2256 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:53.166966  1600 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:53.147439  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.147784  4519 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:53.115877  4362 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:53.174535  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:53.174355  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.150960  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:53.152558  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.176563  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.168485  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:53.140202  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.148422  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.169001  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.166893  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:53.177929  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:53.178983  4451 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.179225  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.179800  4320 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.180403  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.180931  1532 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:53.169054  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:53.181515  1605 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.181869  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.146695  4459 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:53.175755  4362 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.183707  4362 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.154639  4480 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:53.185282  4480 consensus_queue.cc:1243] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:53.172515  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:53.168810  4475 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.180197  4320 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.175618  1609 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:53.186371  4414 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.186408  4320 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.179472  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:53.188655  4451 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.189147  4451 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.180738  4509 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:53.178233  1530 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:53.174314  4212 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:53.150141  4426 raft_consensus.cc:1068] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Unable to promote non-voter 9b6586a864a94c019cae2d8e2987a7af: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:53.192389  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.157006  1683 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:53.193106  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:53.185025  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.153913  1602 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:53.178046  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:53.201023  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:53.165445  4427 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.180994  4321 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.154232  4311 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.179137  4254 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:53.217797  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.217993  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.153820  4456 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.153430  4129 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.198964  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.231050  1531 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:53.195525  1601 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:53.193171  1678 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:53.201720  1604 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:53.205786  1605 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:53.204855  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.185838  4480 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:53.195523  4462 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.221591  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.223397  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:53.196924  4510 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.240844  2259 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:53.242312  1675 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:53.197389  4212 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.154516  4343 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:53.234047  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.238766  2252 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:53.239707  1683 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:53.200981  4487 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:53.244163  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 219435us
I20260709 13:00:53.222388  4311 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.226493  4525 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.255141  1527 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:53.255525  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63364.4us
I20260709 13:00:53.261759  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.207412  4459 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:00:53.236930  4129 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:53.271339  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.240211  4480 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:53.285857  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.264854  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.200812  4519 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.220419  4457 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:53.290330  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:53.291155  1678 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:53.225265  4427 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.300833  1527 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.304957  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:53.243115  4496 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.258685  4254 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:53.259152  4212 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.312659  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.315960  1674 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.301347  4491 raft_consensus.cc:2764] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:53.284533  4525 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:53.360832  4525 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.363090  4310 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.320552  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:53.368615  1605 raft_consensus.cc:606] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:53.368948  1605 raft_consensus.cc:614] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.369598  4519 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.258462  4462 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:53.371181  4462 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.371680  4356 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.241556  4456 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:53.263376  4487 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:53.301710  4413 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.350219  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:53.356932  4514 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:53.319648  4426 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.376801  1675 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.461417  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:53.462015  1605 raft_consensus.cc:606] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.462358  1605 raft_consensus.cc:614] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.288727  4311 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.370394  4402 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:53.463653  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 113495us
I20260709 13:00:53.468282  2261 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:53.468926  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:53.464010  4519 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:53.465417  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 247673us
I20260709 13:00:53.464495  4321 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:53.470570  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:53.475067  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.477246  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.474679  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.487530  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:00:53.488216  1605 raft_consensus.cc:606] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.309764  4526 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 13:00:53.488595  1605 raft_consensus.cc:614] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.320135  4485 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.461050  4459 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.392858  4487 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.498312  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:53.342521  4254 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.368187  4525 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.467422  4413 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:53.467933  4422 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:53.473914  4519 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:53.526437  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.491945  4518 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.487723  4491 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.495847  4402 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:53.531939  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 381022us
I20260709 13:00:53.534420  1679 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7.
I20260709 13:00:53.498875  4523 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.537925  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:53.542006  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.542766  4523 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.543462  4402 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:53.534366  4422 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.544361  4402 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.544879  4523 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.530830  4519 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.545464  4523 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.474439  4480 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:53.524106  4522 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:00:53.545528  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47283.3us
I20260709 13:00:53.544067  4254 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.525481  4457 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.531446  4414 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.535250  4491 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:53.535483  4343 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:00:53.554747  4212 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.582505  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.554203  4457 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.516484  4459 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:53.581317  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.536051  4527 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:53.591195  4527 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.591585  4527 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.591904  4527 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.593598  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.594053  4459 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.575107  4480 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.622805  1528 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 4: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:53.581249  4491 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.589089  4457 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.554239  4501 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:00:53.622689  4320 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:53.551776  4539 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:00:53.658109  1532 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:00:53.658766  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 124863us
I20260709 13:00:53.595754  4538 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:53.650063  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 149074us
I20260709 13:00:53.652810   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:53.577769  4321 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.653906  4320 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.654191  4235 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.654340  4536 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:00:53.648950  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.659973  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:53.682231  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:53.664878  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.682924  2255 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.690089  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:00:53.663935  4476 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.002s
W20260709 13:00:53.711774  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136346us
I20260709 13:00:53.719038  1648 leader_election.cc:400] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6.
I20260709 13:00:53.719448  1648 leader_election.cc:403] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:53.661239  4427 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:53.665905  4538 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:53.707780  4535 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 13:00:53.724359  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.729606  1526 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:53.732968  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:53.636013  4413 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:53.707914  4414 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.688479  4356 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:53.733628  1533 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:53.723948  4343 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.742460  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:53.726105  4533 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:53.733999  4362 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.001s
I20260709 13:00:53.726359  4456 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.729483  4538 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.734545  4542 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.744977  4354 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:00:53.739630  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:53.780123  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 471296us
I20260709 13:00:53.723677  4462 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:53.732084  4427 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:53.744545  4343 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:53.782802  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 59471.8us
I20260709 13:00:53.740557  4544 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:53.783613  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.732537  4485 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:53.785475  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 120669us
I20260709 13:00:53.753960  4546 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.765434  4414 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6.
I20260709 13:00:53.789813  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:53.786536  4462 consensus_queue.cc:1243] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:53.768229  4525 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:53.754386  4362 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:53.767062  4456 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:00:54.092629  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1638) took 1089 ms. Trace:
W20260709 13:00:54.059254  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 292047us
W20260709 13:00:54.091961  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 305135us
W20260709 13:00:54.115151  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 331606us
I20260709 13:00:54.119451  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:54.126284  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.127580  1604 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.131110  1601 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:54.134126  1648 leader_election.cc:400] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:53.786756  4343 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.134562  1648 leader_election.cc:403] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.113299  1680 rpcz_store.cc:276] 0709 13:00:53.003496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.099401 (+ 95905us) service_pool.cc:224] Handling call
0709 13:00:53.100068 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.100642 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.100676 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.101387 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.149007 (+ 47620us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:53.149053 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.058842 (+909789us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400425020. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b34a02 00007f7e63b31dde 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:00:54.058939 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.058982 (+    43us) raft_consensus.cc:1685] finished
0709 13:00:54.058996 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.092531 (+ 33535us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":428,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":46895360,"thread_start_us":39694,"threads_started":1,"wal-append.queue_time_us":46075}
W20260709 13:00:54.091403  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 280992us
W20260709 13:00:54.039568  4540 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:00:53.793917  4539 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:53.796176  4534 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:00:53.835297  4543 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:53.991518  4463 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:53.857635  4310 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.810788  4212 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.144867  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:53.847545  4451 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.004s
I20260709 13:00:54.038902  4523 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:53.857296  4403 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:54.145222  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:53.794046  4546 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:53.991792  4518 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:54.147327  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:54.206578  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59312us
I20260709 13:00:54.154307  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:54.031944  4538 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.161725  2255 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:54.160880  4310 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:54.143518  4539 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.194375  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:53.782477  4354 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.198681  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.225431  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.151198  4402 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.780184  4542 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.211874  4212 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.213477  4554 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:54.214097  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 59880.7us
I20260709 13:00:54.213950  4552 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:54.222560  1600 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:54.236440  2258 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:54.205862  4546 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:54.210570  4519 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.000s
I20260709 13:00:54.161532  4548 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:54.160893  4457 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.231552  4544 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.198690  4446 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.222043  4485 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:54.224677  4539 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.265035  1678 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:54.266247  4554 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.267606  4485 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.268154  4485 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:54.269188  4553 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:54.245797  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:54.245702  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:54.193848  4463 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.195272  4451 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.237977  2257 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:54.249385  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 465) took 1036 ms. Trace:
I20260709 13:00:54.243741  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.227161  4456 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.202975  4403 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.246591  4414 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.270107  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 453) took 1244 ms. Trace:
I20260709 13:00:54.286185  1607 rpcz_store.cc:276] 0709 13:00:53.025716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.026642 (+   926us) service_pool.cc:224] Handling call
0709 13:00:53.047106 (+ 20464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.150275 (+103169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.150306 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.167397 (+ 17091us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.466036 (+298639us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.466075 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.466142 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.269839 (+803697us) raft_consensus.cc:1685] finished
0709 13:00:54.269863 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.270035 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086,"raft.queue_time_us":30270,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6582,"thread_start_us":346239,"threads_started":2,"wal-append.queue_time_us":378307}
W20260709 13:00:54.280799  4487 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 13:00:54.276015  1600 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 4.
I20260709 13:00:54.299160  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.299867  1600 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:54.300971  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.241650  4212 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.275365  1530 rpcz_store.cc:276] 0709 13:00:53.212676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.213755 (+  1079us) service_pool.cc:224] Handling call
0709 13:00:53.214111 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.260786 (+ 46675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.260816 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.300842 (+ 40026us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.478750 (+177908us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.478800 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.478872 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.249184 (+770312us) raft_consensus.cc:1685] finished
0709 13:00:54.249204 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.249329 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42253,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":23471,"thread_start_us":129495,"threads_started":2,"wal-append.queue_time_us":231623}
I20260709 13:00:54.236617  4552 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:54.211941  4547 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.316002  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:54.273711  2253 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 13:00:54.316998  2253 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:54.275336  4446 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.296216  2260 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:54.297048  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.320921  1605 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.297778  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.309566  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.322189  1600 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.225361  4518 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:54.293905  4129 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.988s	user 0.006s	sys 0.005s
I20260709 13:00:54.252978  4519 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.285254  4556 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.233566  4402 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:54.284626  4544 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.331272  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:54.317648  4311 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.001s
W20260709 13:00:54.332360  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 106993us
I20260709 13:00:54.339579  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:54.347102  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1828) took 1597 ms. Trace:
I20260709 13:00:54.326017  4446 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.351058  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:54.349431  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:54.347759  1525 rpcz_store.cc:276] 0709 13:00:52.749870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.023048 (+273178us) service_pool.cc:224] Handling call
0709 13:00:54.346891 (+1323843us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b540042c7d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:54.347041 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16953088}
I20260709 13:00:54.349871  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:54.348724  1530 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:00:54.308923  4487 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.334801  4362 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.334136  4547 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:54.337719  4542 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.362392  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:54.348737  1609 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:54.368279  1605 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:54.293118  4310 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.372999  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.373050  1533 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.374986  1607 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.352532  4427 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.330891  4129 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.393157  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.347198  4566 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.400236  4566 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.403453  1600 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:54.404908  1600 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:54.402597  4552 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.413173  4310 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.350394  4530 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:54.415002  4463 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.415295  4212 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.416013  4451 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.342111  4311 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.402868  4427 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.418826  4129 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.416730  4538 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:54.417294  4559 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:00:54.420444  4565 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:54.337275  4556 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.385731  4542 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:54.359652  4462 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:54.416630  4507 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:54.391041  4354 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.416013  4212 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.341847  4544 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.431380  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:54.429590  1604 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:00:54.428300  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77303.9us
I20260709 13:00:54.436353  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:54.460269  1604 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:54.438437  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 114388us
I20260709 13:00:54.461292  1607 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:54.445796  4480 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.005s
I20260709 13:00:54.449347  4456 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:54.465274  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:54.461792  4542 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.469554  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:54.470446  4567 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:54.431581  4414 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.470532  1604 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:54.444018  4427 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.471372  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:54.455399  4507 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.456918  4457 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.461663  4554 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:54.485289  4235 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.000s
I20260709 13:00:54.453537  4547 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.470782  4542 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.481201  4403 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.482057  4507 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.481449  4129 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:54.503352  1574 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.525s (SENT)
I20260709 13:00:54.502177  4578 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.501580  4456 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:54.521086  1646 connection.cc:256] RPC call timeout handler was delayed by -1.0307113400000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:54.510457  4576 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:54.518651  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:54.513984  4254 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.457785  4565 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.514187  4129 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.480719  4212 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.510594  4518 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.513865  4548 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.526803  4576 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.504690  4462 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:00:54.516760  4402 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.491669  4414 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.527756  4573 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.530073  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:54.562765  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 90197.1us
I20260709 13:00:54.518329  4578 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:54.531486  4129 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.532300  4542 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.537110  4564 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:54.530961  4254 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.566040  4589 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.567056  4585 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.592679  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:54.571133  4491 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.925s	user 0.006s	sys 0.005s
I20260709 13:00:54.569808  4311 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.571416  4402 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.625226  4578 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.627954  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 467) took 1414 ms. Trace:
I20260709 13:00:54.628481  1531 rpcz_store.cc:276] 0709 13:00:53.213244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.242167 (+ 28923us) service_pool.cc:224] Handling call
0709 13:00:53.256194 (+ 14027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.270182 (+ 13988us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:53.466486 (+196304us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.467870 (+  1384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.467920 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.467971 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.627638 (+1159667us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54002cea54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:54.627699 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.627855 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17918,"prepare.queue_time_us":306488,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":20922,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":154,"spinlock_wait_cycles":31415040,"thread_start_us":161742,"threads_started":1}
I20260709 13:00:54.617493  4585 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.543417  4548 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.638206  4427 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:54.639205  4527 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.035s	user 0.010s	sys 0.001s
I20260709 13:00:54.594929  4565 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.647393  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.568583  4343 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.669641  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:54.642452  2257 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:54.674451  4580 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.092s	user 0.004s	sys 0.001s
I20260709 13:00:54.622031  4491 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.653926  4402 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.654351  4462 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:54.699152  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:54.617163  4589 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.650725  4542 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.703220  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:54.652563  4527 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.672262  4565 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:54.690584  4518 raft_consensus.cc:2764] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:00:54.701583  4402 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.704101  4574 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:00:54.712396  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 151757us
I20260709 13:00:54.714030  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.704407  4594 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.722402  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 517) took 1961 ms. Trace:
I20260709 13:00:54.705253  4403 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:00:54.692231  4462 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.706918  4463 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:00:54.712738  4576 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.730660  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:54.732538  4588 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.007s
I20260709 13:00:54.731084  2254 rpcz_store.cc:276] 0709 13:00:52.761086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.764388 (+  3302us) service_pool.cc:224] Handling call
0709 13:00:52.764664 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.764870 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:52.765162 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.538364 (+1773202us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b180049a440. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf
0709 13:00:54.538571 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.722082 (+183511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.722134 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:54.722175 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.722235 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.722344 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15926,"prepare.queue_time_us":4019,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":46475,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":21794,"spinlock_wait_cycles":16219520,"thread_start_us":405489,"threads_started":3,"wal-append.queue_time_us":161529,"wal-append.run_cpu_time_us":1906,"wal-append.run_wall_time_us":1137493}
I20260709 13:00:54.728003  4574 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:54.737674  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 786) took 1725 ms (client timeout 2050 ms). Trace:
I20260709 13:00:54.726227  4594 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.740571  3955 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.741106  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 469) took 1486 ms. Trace:
I20260709 13:00:54.741823  4569 raft_consensus.cc:2764] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:00:54.745285  4541 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.018s	user 0.008s	sys 0.004s
I20260709 13:00:54.746091  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1814) took 1653 ms. Trace:
W20260709 13:00:54.752966  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 370) took 1754 ms (client timeout 2241 ms). Trace:
I20260709 13:00:54.754390  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 523) took 1548 ms. Trace:
I20260709 13:00:54.809146  2261 rpcz_store.cc:276] 0709 13:00:53.205788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.205950 (+   162us) service_pool.cc:224] Handling call
0709 13:00:53.206305 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.471615 (+265310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.754071 (+1282456us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54004eb6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:54.754319 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601898240}
I20260709 13:00:54.727165  4518 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:54.712212  4573 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:00:54.731287  4582 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:00:54.726564  4414 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:54.774535  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 43907.4us
I20260709 13:00:54.825461  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.803436  1529 rpcz_store.cc:276] 0709 13:00:53.254375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.380828 (+126453us) service_pool.cc:224] Handling call
0709 13:00:53.466114 (+ 85286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:53.628499 (+162385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.628571 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:53.647126 (+ 18555us) log.cc:844] Serialized 52 byte log entry
0709 13:00:53.818656 (+171530us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.818702 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.740647 (+921945us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400266bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:54.740702 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.740752 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:54.740767 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.741033 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64332,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":18796,"spinlock_wait_cycles":296125312,"thread_start_us":153321,"threads_started":1,"wal-append.queue_time_us":546651}
W20260709 13:00:54.796344  2258 rpcz_store.cc:269] 0709 13:00:53.012278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.012751 (+   473us) service_pool.cc:224] Handling call
0709 13:00:54.737458 (+1724707us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400515254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:54.737610 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727606144}
I20260709 13:00:54.774459  4311 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:54.773412  4525 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.772399  4596 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:54.808470  1679 rpcz_store.cc:269] 0709 13:00:52.998834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.999032 (+   198us) service_pool.cc:224] Handling call
0709 13:00:54.752684 (+1753652us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:54.752863 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198663936}
I20260709 13:00:54.755887  4507 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.839874  4595 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.851181  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.862028  4462 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.859627  4446 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:54.862757  4590 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:54.863215  1526 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:54.812057  4518 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:54.806739  3955 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:54.807687  1532 rpcz_store.cc:276] 0709 13:00:53.092979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.181618 (+ 88639us) service_pool.cc:224] Handling call
0709 13:00:54.745856 (+1564238us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:54.746026 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093454720}
I20260709 13:00:54.871912  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:54.872160  1683 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:54.875572  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:54.855268  4565 raft_consensus.cc:2764] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:00:54.858664  4546 consensus_meta.cc:287] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.607s	user 0.016s	sys 0.001s
I20260709 13:00:54.857250  4569 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:54.883111  4410 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.869158  4596 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.891660  4410 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.892493  4129 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.893947  4410 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.855701  4311 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.870329  4574 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:54.905056  4446 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.883491  4546 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.905975  4574 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.907886  4546 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.909276  4594 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.910524  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1640) took 1767 ms. Trace:
I20260709 13:00:54.910144  3955 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.880823  4462 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:54.878157  4599 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:54.883937  4539 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.004s
I20260709 13:00:54.870800  4566 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.857398  4525 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.860435  4595 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.883381  4414 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:54.901669  4589 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:54.902253  4311 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.902635  4573 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.904754  4542 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.910924  1606 rpcz_store.cc:276] 0709 13:00:53.143411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.143947 (+   536us) service_pool.cc:224] Handling call
0709 13:00:53.144240 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.144608 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.144634 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.145038 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.774766 (+1629728us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b18004001e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:54.873281 (+ 98515us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:54.873321 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.873383 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.910190 (+ 36807us) raft_consensus.cc:1685] finished
0709 13:00:54.910210 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.910451 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":673,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":25125,"spinlock_wait_cycles":17213312,"thread_start_us":89706,"threads_started":1,"wal-append.queue_time_us":1723646}
I20260709 13:00:54.916997  4519 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.917233  4462 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:54.918467  4485 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:00:54.894006  4596 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:54.926292  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50814.3us
I20260709 13:00:54.887266  4463 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.920023  4539 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.919026  4518 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.884661  4597 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.932696  4485 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:54.933409  4525 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.934666  4491 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.931624  4462 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:54.934811  4595 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:54.940155  4593 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
W20260709 13:00:54.941239  2253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 516) took 2180 ms (client timeout 2072 ms). Trace:
W20260709 13:00:54.964835  2253 rpcz_store.cc:269] 0709 13:00:52.760728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.819706 (+ 58978us) service_pool.cc:224] Handling call
0709 13:00:54.941068 (+2121362us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54003944d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:54.941172 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058042624}
I20260709 13:00:54.941879  4507 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:54.959666  4566 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:00:54.966331  4487 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.967797  4462 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:54.964754  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.969445  4462 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.945232  1601 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:54.945151  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.946611  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:54.958559  4570 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.457s	user 0.000s	sys 0.002s
I20260709 13:00:54.968523  4485 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:54.975011  4539 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.975972  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:54.977844  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:54.978403  1602 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.982992  4523 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.986153  4595 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.986792  4595 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:54.990078  4212 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:54.990213  4595 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.001590  1528 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:55.004940  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.012468  1526 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:55.013839  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.016682  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.017206  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.017573  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.018160  1532 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.018750  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.019281  1527 raft_consensus.cc:2368] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.017297  1529 raft_consensus.cc:2376] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6. Re-sending same reply.
I20260709 13:00:55.023867  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:55.006618  4597 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:55.061708  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:55.033401  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 83697us
I20260709 13:00:55.061715  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.063381  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.109969  1674 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.062757  1678 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:00:55.056526  1533 pending_rounds.cc:85] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 3
I20260709 13:00:55.110718  1528 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:55.050432  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.062142  1606 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:55.110286  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.062206  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.111582  1533 pending_rounds.cc:107] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:55.113402  1533 raft_consensus.cc:2889] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.057616  4129 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.114585  4597 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:55.120868  4537 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.413s	user 0.002s	sys 0.015s
I20260709 13:00:55.111090  4212 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:00:55.057966  4547 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:55.122529  4352 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.122752  4547 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:55.123206  4519 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:55.124836  1676 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.061954  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.125619  1675 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:55.125619  1677 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:55.033372  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.127887  1526 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.123719  4519 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.128608  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.129170  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.129415  1683 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.013470  4578 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:55.084022  4413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.004s	sys 0.008s
I20260709 13:00:55.135311  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.032819  4567 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.138262  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:55.143362  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.138375  1678 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.123741  4547 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:55.125792  4352 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:55.142300  4596 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.153260  4352 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.153597  4596 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.154582  4352 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.155524  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.156607  1606 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:55.157392  4519 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.158048  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.159469  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.161190  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.161976  1674 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:00:55.163095  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.164618  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.165789  1675 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:55.166813  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.167691  1675 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.168700  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.169271  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.169932  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.170543  1529 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:55.171176  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.171375  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.171594  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.171770  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:00:55.106251  4604 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.172586  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.173219  1528 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:55.173801  4542 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:55.174353  4542 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.179445  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1647) took 1056 ms. Trace:
I20260709 13:00:55.179867  1603 rpcz_store.cc:276] 0709 13:00:54.122790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.123010 (+   220us) service_pool.cc:224] Handling call
0709 13:00:54.123337 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.231933 (+108596us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:54.369704 (+137771us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.465286 (+ 95582us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.472111 (+  6825us) log.cc:844] Serialized 52 byte log entry
0709 13:00:54.472339 (+   228us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.472373 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.472441 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.176675 (+704234us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b18003d9840. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:55.179134 (+  2459us) raft_consensus.cc:1685] finished
0709 13:00:55.179230 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.179365 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24859,"prepare.queue_time_us":240434,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":137985,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":34906,"spinlock_wait_cycles":22530304,"thread_start_us":236957,"threads_started":3,"wal-append.queue_time_us":111313}
I20260709 13:00:55.182142  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:55.183846  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1653) took 1034 ms. Trace:
I20260709 13:00:55.184899  1600 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:55.183279  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.184273  1609 rpcz_store.cc:276] 0709 13:00:54.149117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.297535 (+148418us) service_pool.cc:224] Handling call
0709 13:00:55.183627 (+886092us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400207e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:55.183789 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61712640}
I20260709 13:00:55.187335  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.188405  1602 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:55.189440  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.185945  1603 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:00:55.193950  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:55.187927  1609 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:55.221675  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.221845  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:55.222517  1609 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.156204  4596 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.193529  4568 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.225943  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:55.211004  1680 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:55.212212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.195009  1500 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:55.142441  4413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.005s	sys 0.009s
I20260709 13:00:55.233175  4568 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.227052  4491 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:55.234937  4491 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.237464  4491 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.239391  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.214589  4523 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.240422  4523 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.242254  4568 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.242609  4523 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.174037  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:55.162245  4555 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.914s	user 0.002s	sys 0.000s
I20260709 13:00:55.062320  4463 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:00:55.257335   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:55.269018  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.269879  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:00:55.270792  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.207834  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:55.193744  4456 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.226521  1678 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:55.271395  1528 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:55.227422  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:55.275791  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:55.276697  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.228618  1680 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:55.172580  4604 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.229801  4542 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.215718  4567 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.142851  4578 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.224936  4574 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.217617  4569 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.240141  1602 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:55.216377  1526 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:55.227349  4562 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:55.273818  1606 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:55.275075  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.277776  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.281754  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:55.292865  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.305420  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.305598  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:55.325261  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43593.5us
I20260709 13:00:55.325394  1529 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:55.310832  1609 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:55.258764  4491 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.339699  1531 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.339066  1527 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.340358  1648 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.324141  1532 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:55.341336  1648 leader_election.cc:400] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.341686  1648 leader_election.cc:403] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:55.436022  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:55.440726  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 99519.9us
I20260709 13:00:55.311609  4320 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:55.441165  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 252662us
I20260709 13:00:55.440929  1526 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.286280  4129 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.303923  4212 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:55.282133  4566 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.157s
I20260709 13:00:55.312388  4523 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.436094  4589 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:55.282698  4456 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.361567  4403 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.307603  4487 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:00:55.312824  4565 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:00:55.478411  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.482728  1526 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:55.436399  4597 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:55.321548  4574 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.469797  4566 consensus_queue.cc:1243] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 6.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:55.342518  4414 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 13:00:55.458901  4129 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.360894  4562 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.459764  4212 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.488235  1528 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:55.513033  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.549661  1534 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:55.485925  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.551509  1526 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.551738  1534 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 8. Ops: []
I20260709 13:00:55.526355  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:55.512251  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.339643  4569 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.562798  4566 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:55.515002  4567 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.509867  4604 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.516777  4561 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.471844  4523 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.509078  4578 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.509802  4422 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.563588  4282 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.566704  4589 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.587575  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 524) took 2378 ms. Trace:
I20260709 13:00:55.589588  4562 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.592962  4554 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.595207  4456 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.566583  4566 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:55.597846  4569 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.553776  4596 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:55.610947  2260 rpcz_store.cc:276] 0709 13:00:53.208919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.221350 (+ 12431us) service_pool.cc:224] Handling call
0709 13:00:55.587303 (+2365953us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400740254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:55.587503 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420437888}
W20260709 13:00:55.617357  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 291158us
I20260709 13:00:55.618292  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:55.619869  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:55.621498  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:55.610854  4589 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.613481  4554 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:55.620929  4596 consensus_queue.cc:1243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:55.620512  4560 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.632373  4569 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:55.658253  4352 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.003s
I20260709 13:00:55.659052  1679 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.611560  4282 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.663117  4282 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.640342  4599 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:55.642963  4589 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.668413  1679 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:55.675292  4574 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.686151  4554 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.687765  4566 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.689006  4566 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.694099  4129 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.698756  4427 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.652724  4569 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:55.700896  4569 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.668601  4599 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.704733  4599 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:55.705137  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.731513  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:55.732461  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.732827  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:55.733285  1678 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.733736  2253 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:55.730891  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:55.735738  2260 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:55.737438  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.738103  1678 raft_consensus.cc:2376] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7. Re-sending same reply.
I20260709 13:00:55.739034  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.740097  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.741091  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.744421  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:55.747110  2253 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.747547  2253 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:55.731204  4554 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.752471  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:55.765553  1674 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:55.778445  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.779369  1527 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:55.748301  2253 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.781404  2253 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.785699  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.788416  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:55.776464  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:55.789059  2257 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:55.790694  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:55.791925  2253 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:55.792852  2253 pending_rounds.cc:85] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 7
I20260709 13:00:55.793201  2253 pending_rounds.cc:107] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:55.793525  2253 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.792701  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:55.794849  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.795657  1531 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:55.733470  4596 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:55.800637  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:55.801231  1526 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.808182  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:55.768033  4589 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:55.800495  4451 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:55.846627  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.865965  1678 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.764050  4569 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.888547  4603 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.901181  4603 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.903635  4603 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.889302  4523 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.888981  4542 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.918063  4542 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.866278  4547 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:55.921802  4547 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:55.922252  4547 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.922933  4569 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.799775  4525 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.924901  4585 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:55.927181  4589 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:55.929986  4542 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.952622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.955216  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.955997  1682 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:55.956961  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.801838  4456 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:55.967720  1682 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.967583  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:55.968680  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:00:55.969061  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 157857us
I20260709 13:00:55.969673  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.970863  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.971171  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:55.811810  4539 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:55.973662  1678 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:00:55.973929  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:55.975857  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:55.872170  4533 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.978873  1682 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:55.969882  4556 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:55.817207  4568 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:00:55.804044  4596 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:55.973129  4554 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.976464  4456 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:55.989156  4544 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:56.014549  4544 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.015142  4544 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:55.981058  4533 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.031083  4544 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:56.037043  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1991) took 1076 ms. Trace:
I20260709 13:00:56.038843  1608 rpcz_store.cc:276] 0709 13:00:54.960402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.276903 (+316501us) service_pool.cc:224] Handling call
0709 13:00:55.277184 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.280918 (+  3734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.280949 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.286944 (+  5995us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.621455 (+334511us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:55.621497 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.621563 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.036806 (+415243us) raft_consensus.cc:1685] finished
0709 13:00:56.036826 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.036969 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3369,"raft.queue_time_us":4835,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":20033,"thread_start_us":162628,"threads_started":1,"wal-append.queue_time_us":631324}
I20260709 13:00:56.033802  4456 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.045746  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 1972) took 1818 ms. Trace:
I20260709 13:00:56.046178  1600 rpcz_store.cc:276] 0709 13:00:54.227418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.429060 (+201642us) service_pool.cc:224] Handling call
0709 13:00:55.184519 (+755459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.190017 (+  5498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.045527 (+855510us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400207e50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:56.045684 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736537856}
I20260709 13:00:56.043732  4596 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:56.058147  4525 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.058576  4527 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:56.058830  4525 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.066284  4525 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.067365  4599 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.067809  4552 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.077993  4599 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.078047  4254 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:56.081508  4320 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:56.082935  2253 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:56.084540  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.085386  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.085886  2260 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.088510  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.088896  1526 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:56.090183  2257 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.091604  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.092257  2258 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.098006  4343 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:56.102911  4547 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.105854  4538 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:56.110258  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:56.111222  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.111549  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:56.111960  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.112432  4573 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:56.113685  4573 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:56.114207  4573 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:56.114857  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.115185  4573 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.115882  2261 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:56.116350  4578 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:56.116755  4578 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:56.114096  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.117552  4578 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.118791  4578 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.118920  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.119800  2261 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:56.122020  2261 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:56.122470  4629 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.570s	user 0.003s	sys 0.003s
I20260709 13:00:56.082067  4320 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.123831  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.124876  2261 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:56.127177  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.128037  2256 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:56.129153  4547 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:56.129696  4554 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.130095  2254 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.112702  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:56.132910  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1829) took 1131 ms. Trace:
W20260709 13:00:56.112015  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.133306  1530 rpcz_store.cc:276] 0709 13:00:55.001093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.001204 (+   111us) service_pool.cc:224] Handling call
0709 13:00:55.001460 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.007261 (+  5801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.007293 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.007761 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.303851 (+296090us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.440752 (+136901us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.444755 (+  4003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.444823 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.113929 (+669106us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18004923a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:56.132650 (+ 18721us) raft_consensus.cc:1685] finished
0709 13:00:56.132736 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.132855 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3766,"prepare.queue_time_us":149731,"prepare.run_wall_time_us":6906,"raft.queue_time_us":27692,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":28166,"spinlock_wait_cycles":38064128,"thread_start_us":210734,"threads_started":1,"wal-append.queue_time_us":421301}
I20260709 13:00:56.229157  2258 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:56.230223  2257 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:56.131958  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.232999  2254 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:56.234872  4589 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:56.235318  4589 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.235648  4589 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.240921  2261 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:56.242305  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.243736  2260 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:56.245069  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.245782  2258 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:56.245976  2256 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:56.246454  4320 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:56.250695  4548 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:56.253321  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 525) took 2575 ms. Trace:
I20260709 13:00:56.253772  2252 rpcz_store.cc:276] 0709 13:00:53.679638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.687914 (+  8276us) service_pool.cc:224] Handling call
0709 13:00:53.723792 (+ 35878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.754419 (+2030627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.754451 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.754495 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:55.754526 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.253057 (+498531us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400550354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:56.253118 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.253257 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4669028224}
I20260709 13:00:56.255884  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.264217  4403 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:56.288659  4212 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.295239  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1656) took 1270 ms. Trace:
W20260709 13:00:56.300688  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.083797  4254 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:56.392014  4254 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.372668  4403 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:56.416491  4403 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.381366  1681 rpcz_store.cc:276] 0709 13:00:55.024948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.027578 (+  2630us) service_pool.cc:224] Handling call
0709 13:00:55.027966 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:55.441261 (+413295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.441290 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:55.441849 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.551788 (+109939us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:55.551848 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.121885 (+570037us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:56.294494 (+172609us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54001081d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:56.294568 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.294721 (+   153us) raft_consensus.cc:1685] finished
0709 13:00:56.294736 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.295146 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567,"raft.queue_time_us":160,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":7591,"spinlock_wait_cycles":776017920,"thread_start_us":93935,"threads_started":1,"wal-append.queue_time_us":94267}
I20260709 13:00:56.243573  4533 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.322163  4343 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:00:56.442097  2253 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:56.453014  4320 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.494792  4546 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:56.495510  4546 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:56.497082  4546 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.498399  4546 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.513814  4552 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.525324  4403 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.525151  4552 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.527297  4552 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.511540  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.529754  2254 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:56.567740  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1674) took 1390 ms. Trace:
I20260709 13:00:56.568737  1609 rpcz_store.cc:276] 0709 13:00:55.177565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.458706 (+281141us) service_pool.cc:224] Handling call
0709 13:00:55.509510 (+ 50804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.572919 (+ 63409us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:55.583687 (+ 10768us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.583912 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.583978 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.584030 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.567446 (+983416us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b5400384ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:56.567508 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.567664 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2951,"prepare.queue_time_us":18744,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1473,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":145089408}
I20260709 13:00:56.576805  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1660) took 1550 ms. Trace:
I20260709 13:00:56.577387  1679 rpcz_store.cc:276] 0709 13:00:55.026176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.213905 (+187729us) service_pool.cc:224] Handling call
0709 13:00:56.576623 (+1362718us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540031bad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:56.576740 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004063104}
I20260709 13:00:56.582679  4518 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.595585  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1678) took 1354 ms. Trace:
W20260709 13:00:56.633100  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.462793   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:56.709059  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 194866us
I20260709 13:00:56.713583  1648 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:56.714035  1648 leader_election.cc:403] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:56.714700  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.596097  1604 rpcz_store.cc:276] 0709 13:00:55.241326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.624421 (+383095us) service_pool.cc:224] Handling call
0709 13:00:55.639809 (+ 15388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.640080 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:55.640357 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.642466 (+  2109us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.284842 (+642376us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800392bc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:00:56.595222 (+310380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.595275 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.595320 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.595393 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.595520 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1898098,"prepare.queue_time_us":648857,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":955099,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":3219,"spinlock_wait_cycles":5346176}
I20260709 13:00:56.715209  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.719543  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:56.733671  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.734869  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.735767  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.737648  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:56.736169  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.739176  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.744733  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.745549  1609 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:56.747218  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.747867  1607 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
I20260709 13:00:56.748775  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.754199  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.754890  1674 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:56.756659  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.758522  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.743187  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.740248  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.762881  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:56.763557  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:56.764247  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.765748  1603 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.769460  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.770687  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.771750  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.772897  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.773665  1608 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:56.774343  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:56.775131  1683 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:56.719129  4343 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:00:56.764216  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.764917  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.768805  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:56.730814  4648 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.004s
I20260709 13:00:56.784497  1683 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:56.782948  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:56.786054  1677 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:56.786170  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.752698  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:56.779671  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.786494  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.787019  1675 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:56.712646  4569 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.788754  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.712710  3955 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:56.780395  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 183742us
I20260709 13:00:56.781132  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:56.793807  1674 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:56.787189  1604 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:56.788110  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:56.724196  4578 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.793166  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:56.789295  1680 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:56.730418  4282 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:56.761786  4626 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.210s	user 0.012s	sys 0.009s
I20260709 13:00:56.722226  4573 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.791181  1609 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:56.761739  4544 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:56.807775  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.791250  1601 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:56.808238  1603 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:56.792964  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1669) took 1682 ms. Trace:
I20260709 13:00:56.762575  4548 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:56.794566  4651 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:00:56.795601  4446 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.796705  1605 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:56.797128  4574 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.787498  4212 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:00:56.798934  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 84330.4us
I20260709 13:00:56.734274  4568 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:56.816449  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:56.799410  4561 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:56.761749  4456 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:56.731446  4463 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:00:56.782266  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64495.8us
I20260709 13:00:56.800985  1682 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:56.821473  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:56.822551  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.823060  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:56.806941  4282 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:56.826756  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:56.805109  1608 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:56.802670  2255 raft_consensus.cc:2376] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6. Re-sending same reply.
I20260709 13:00:56.734368  4572 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.783815  4552 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.768909  4402 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:56.808745  1606 rpcz_store.cc:276] 0709 13:00:55.111031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.323776 (+212745us) service_pool.cc:224] Handling call
0709 13:00:55.443420 (+119644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.443652 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:55.649793 (+206141us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.597751 (+947958us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.792664 (+194913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.792710 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:56.792750 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.792815 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.792917 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072070,"prepare.queue_time_us":132605,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":11204,"raft.queue_time_us":1136960,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15176,"spinlock_wait_cycles":20162304,"thread_start_us":198787,"threads_started":2,"wal-append.queue_time_us":330546}
I20260709 13:00:56.817656  4561 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:56.810545  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.784017  4527 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:56.809492  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.864616  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.811897  4533 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:56.815374  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:56.808483  4589 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.006s
I20260709 13:00:56.801442  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.864614  4527 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:56.871973  4527 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.836597  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.872574  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1831) took 1870 ms. Trace:
I20260709 13:00:56.872766  2252 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:56.872980  1525 rpcz_store.cc:276] 0709 13:00:55.002252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.002360 (+   108us) service_pool.cc:224] Handling call
0709 13:00:55.008143 (+  5783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:55.017014 (+  8871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.017045 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:55.056229 (+ 39184us) log.cc:844] Serialized 52 byte log entry
0709 13:00:56.392442 (+1336213us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b1800426ac0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:56.490687 (+ 98245us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.490733 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.490814 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.872258 (+381444us) raft_consensus.cc:1685] finished
0709 13:00:56.872278 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.872517 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30056,"raft.queue_time_us":8558,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":35379,"spinlock_wait_cycles":9822976,"thread_start_us":98011,"threads_started":1,"wal-append.queue_time_us":1435952}
I20260709 13:00:56.836988  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:00:56.838399  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.844141  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.846458  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:56.861716  4552 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.825100  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.815738  4573 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.818225  4446 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.880746  4563 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.800638  4569 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.857197  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.994387  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.820395  4456 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.995090  2255 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:56.995797  1604 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:56.823987  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:56.813135  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 386) took 1687 ms. Trace:
I20260709 13:00:56.996625  1676 rpcz_store.cc:276] 0709 13:00:55.126064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.228578 (+102514us) service_pool.cc:224] Handling call
0709 13:00:55.228911 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.258797 (+ 29886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.258828 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.286174 (+ 27346us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.554687 (+268513us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.634800 (+ 80113us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.645240 (+ 10440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.645312 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.560443 (+915131us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:56.812889 (+252446us) raft_consensus.cc:1685] finished
0709 13:00:56.812968 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.813082 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28626,"prepare.queue_time_us":174787,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":40559,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":12701,"spinlock_wait_cycles":10834304,"thread_start_us":177820,"threads_started":2,"wal-append.queue_time_us":229162}
I20260709 13:00:56.813203  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:56.864929  1609 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:56.865578  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.855988  4519 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:56.998548  4519 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:56.866638  4568 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:56.998759  1603 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:56.999186  4568 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:57.000083  4568 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.817425  4548 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.886066  4552 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.003535  4548 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:56.823969  4463 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.845664  4560 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.837225  4597 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:56.867807  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.809620  4578 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.007893  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:56.847086  4282 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.877756  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:56.879594  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:56.846881  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.011304  1608 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:56.880506  4343 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:56.859475  4567 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:56.862020  4554 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.819285  4574 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:56.881615  1605 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:56.883208  2258 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:57.006435  4519 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.018154  1606 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:56.861181  4565 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:56.865043  4561 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:56.990146  4573 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:56.992206  4446 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:56.818001  4544 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:56.992523  4566 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.998247  1601 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:57.004156  1531 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:56.865154  4402 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.010555  1607 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 4: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:57.012444  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 134785us
W20260709 13:00:57.011426  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 131877us
I20260709 13:00:56.863600  4572 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.046392  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:56.909029  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.876950  4589 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.049485  1601 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:57.016278  4426 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:57.023272  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.017819  4567 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.026858  4463 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.028139  4604 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.015022  4560 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.011996  4343 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.041900  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:57.018817  4652 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:00:57.052076  4426 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:57.039961  4518 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:57.056097  4422 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:57.054201  4402 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.050150  4566 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.045228  4556 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.054244  4569 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.062374  4560 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:57.041703  4527 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.058132  4533 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:57.058104  4343 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.074030  4456 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.062906  4422 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.059640  4463 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.068919  4556 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.069482  4574 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.070140  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:57.069912  4562 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:57.056691  4604 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.060501  4426 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.060910  4572 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.060623  4518 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:57.081784  1608 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.072257  4578 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.076537  4566 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.094311  1608 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:57.104045  1602 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:00:57.104612  1602 pending_rounds.cc:85] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 1
I20260709 13:00:57.104869  1602 pending_rounds.cc:107] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:57.105157  1602 raft_consensus.cc:2889] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.105505  1602 pending_rounds.cc:107] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:57.105758  1602 raft_consensus.cc:2889] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.072890  4560 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:57.135547  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 371364us
W20260709 13:00:57.127811  4403 consensus_meta.cc:287] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.006s
W20260709 13:00:57.138124  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 316771us
I20260709 13:00:57.148909  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:57.136948  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 373427us
I20260709 13:00:57.144549  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 487) took 1331 ms. Trace:
I20260709 13:00:57.085515  4463 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.150583  1531 rpcz_store.cc:276] 0709 13:00:55.812968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.965395 (+152427us) service_pool.cc:224] Handling call
0709 13:00:57.144402 (+1179007us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002a7954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:57.144493 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374236928}
I20260709 13:00:57.114094  4566 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:57.151129  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 271930us
I20260709 13:00:57.154049  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:57.153404  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.159602  1609 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:57.093209  4282 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.118913  4562 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:57.163666  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.164949  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.164934  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.167464  1603 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:57.166810  1604 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:00:57.170040  1606 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:57.158520  4573 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:57.158761  4422 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.198391  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.199709  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.201754  4282 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.202353  4282 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:57.204926  4422 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:57.205588  4422 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:57.207557  4546 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.709s	user 0.003s	sys 0.004s
I20260709 13:00:57.172093  4562 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.208402  4596 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:57.209787  4562 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.210143  4463 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:57.211745  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45518.9us
I20260709 13:00:57.212560  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.213320  4519 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.214360  1500 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.215835  4572 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:57.216322  4572 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.216761  4561 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.196408  4560 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.219537  4561 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.207942  4422 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.220608  4554 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:57.224121  4546 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:57.216691  4572 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.225117  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.255280  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.226485  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.228574  1600 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.229197  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.165846  4589 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:57.233960  1534 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:57.259361  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.257982  1533 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:57.163858  4566 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:57.263990  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92936.7us
I20260709 13:00:57.203998  4282 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:57.236428  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:57.268819  1530 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.233903  4567 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.235311  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.241415  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.241402  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.272927  1528 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:57.169462  4548 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.275808  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.137619  4518 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.276487  1527 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:57.280659  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.261529  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:57.235558  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 81597.7us
I20260709 13:00:57.264523  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:57.236107  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 430954us
I20260709 13:00:57.259959  1534 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:57.215782  4519 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.266719  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.283195  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.267927  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:57.237556  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:57.250128  4657 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:57.273861  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.286404  1528 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.251000  4422 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.277328  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.283953  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:57.283633  1529 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:57.283960  1531 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.288657  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.292560  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.292657  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.293387  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.293596  1533 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:57.265012  4546 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:57.299118  1530 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
W20260709 13:00:57.299295  1573 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.022s
I20260709 13:00:57.300000  1533 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:00:57.300128  1573 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.002s	sys 0.023s
I20260709 13:00:57.301290  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:57.301374  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 502962us
I20260709 13:00:57.302054  1530 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:57.278378  4527 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.285250  4657 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.305194  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.305970  2257 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:57.310532  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.307317  4422 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.296384  4661 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:57.312620  1529 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:57.308298  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:00:57.325991  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.320204  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:57.311187  1534 pending_rounds.cc:85] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 2
I20260709 13:00:57.352571  1534 pending_rounds.cc:107] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:00:57.352425  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44180.9us
I20260709 13:00:57.353176  1534 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:57.348737  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 181452us
I20260709 13:00:57.354233  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.352831  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.303938  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:57.356894  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51755.7us
I20260709 13:00:57.359900  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.360248  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1665) took 2340 ms. Trace:
I20260709 13:00:57.360716  1602 rpcz_store.cc:276] 0709 13:00:55.019978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.312715 (+292737us) service_pool.cc:224] Handling call
0709 13:00:55.441158 (+128443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.106248 (+1665090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.359991 (+253743us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001bc6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:57.360181 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3816911104}
I20260709 13:00:57.361068  1530 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:57.361722  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.362455  2261 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:57.370623  4656 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:57.372018  4446 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.372462  4446 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.372810  4446 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.376562  4527 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:57.360891  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.379868  2255 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:57.381083  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:00:57.383378  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63259us
I20260709 13:00:57.391579  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:57.407027  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.314195  4659 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:57.314630  4655 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:57.410293  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47980.6us
I20260709 13:00:57.433652  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.434460  2258 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:57.435712  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.436507  2254 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:57.412246  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:57.296180  4573 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:00:57.311161  4462 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:57.410239  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 58886.4us
I20260709 13:00:57.445818  1531 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:00:57.347294  4254 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.350059  4518 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.348121  4657 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.355465  4561 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.389652  4446 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.474380  1533 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.402499  4554 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:57.468116  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:57.483626  2259 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:00:57.432766  4578 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:57.410673  4567 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:57.478045  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 86476us
I20260709 13:00:57.476822  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:57.485212  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:57.491761  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 133679us
I20260709 13:00:57.414716  4659 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:00:57.490485  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 120633us
W20260709 13:00:57.487030  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 104569us
W20260709 13:00:57.500448  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.504021  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.504923  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.505177  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.505352  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.501521  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:57.505512  1682 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:57.504667  1608 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:00:57.505719  1600 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:57.503484  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:57.509456  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.510119  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:57.477310  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.008s	sys 0.024s
I20260709 13:00:57.511971  1680 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.511858  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:57.512497  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.481096  4666 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.576057  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.576989  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:57.583778  1679 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:00:57.512094  4565 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.603434  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:57.603711  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 244380us
W20260709 13:00:57.511394  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.008s	sys 0.025s
I20260709 13:00:57.605096  4538 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:57.589057  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.496330  4567 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.496973  4656 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:57.480926  4671 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:00:57.519464  1674 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:57.600857  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 97506.4us
I20260709 13:00:57.588128  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.508512  4659 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.605737  1678 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:00:57.483354  4561 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.607895  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:57.616641  1675 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:57.619102  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.620678  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.594594  4568 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.508757  4552 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.500967  4554 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.497798  4669 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:00:57.574797  4578 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:00:57.606940  4565 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.628536  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.511734  4343 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.628283  4681 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:57.645205  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:57.645426  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.637694  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.638809  4566 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.644037  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:57.490011  4546 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:57.610607  4567 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.606396  4422 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:57.645890  1600 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.672289  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:57.674501  1649 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:57.676044  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:57.688695  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44760.3us
I20260709 13:00:57.620648  4573 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:57.678364  4446 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:57.679277  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67994us
I20260709 13:00:57.673316  4560 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:57.679204  4343 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.681988  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:57.629506  4463 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.717406  1677 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.683349  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:57.687788  1526 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:00:57.689857  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:57.688647  1675 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
W20260709 13:00:57.692004  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.695652  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:57.696542  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77465.9us
I20260709 13:00:57.721931  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.627434  4538 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:57.694939  4664 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:57.681566  4561 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.628758  4533 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.640707  4554 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.719210  1678 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.710736  1600 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:57.671897  4565 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.673543  4320 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:57.734395  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.713917  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:57.765759  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.766233  1677 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:00:57.702126  4568 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:57.751632  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:57.712229  4679 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:57.798312  1499 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.504s (SENT) [suppressed 33 similar messages]
I20260709 13:00:57.718291  4673 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:57.638598  4656 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.675525  4666 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:00:57.749845  4671 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:57.801895  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.748699  4533 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:57.834851  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 142406us
I20260709 13:00:57.747012  4566 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:00:57.798223  4683 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.807751  4463 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:57.731041  4560 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.750669  4573 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:00:57.840724  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:57.824091  4343 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:00:57.764299  4561 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:00:57.847916  1573 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:57.854764  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 140928us
I20260709 13:00:57.815686  4673 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.898097  4673 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.807870  4679 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:57.826181  4661 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:57.900600  4679 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:57.904027  4677 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:00:57.904753  4687 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:00:57.904076  4661 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.907303  4556 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:57.908191  4595 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:57.853217  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:57.847416  4533 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.909998  4696 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:57.910455  4696 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:57.910835  4696 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:57.917155  4688 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:00:57.918318  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64609.2us
I20260709 13:00:57.855569  4463 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.924731  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:57.925568  1607 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:00:57.926647  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.845894  4671 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.815930  4568 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.799419  4320 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:57.864431  4683 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:57.859897  1678 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:00:57.890182  4666 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:57.909500  4544 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:57.909313  4654 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:57.850131  4566 consensus_queue.cc:1243] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:57.989869  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:57.990872  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:58.020565  1606 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:57.995673  1607 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:57.920269  4403 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.015291  1529 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:00:57.895000  4674 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:00:58.000434  4595 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:58.001529  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.936015  4463 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.927824  4343 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:58.014572  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.037953  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 239657us
I20260709 13:00:57.939957  4671 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.028257  4320 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.016605  4654 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.030318  4426 consensus_meta.cc:287] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.002s
W20260709 13:00:58.035549  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114852us
I20260709 13:00:57.946228  4548 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 13:00:58.033031  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 186485us
I20260709 13:00:58.024938  4403 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:58.029364  4679 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.037388  4562 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.081614  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:58.012521  4666 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:58.082757  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 158776us
I20260709 13:00:58.080781  1647 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:58.086155  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:00:58.085075  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:58.031150  4697 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.059854  4561 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.060189  4654 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.108650  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:58.083822  4403 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.084265  4562 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.057848  4546 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:00:58.092006  4697 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:58.082345  4426 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.092518  4704 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.083542  4693 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:00:58.101625  4700 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:00:58.142910  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:00:58.125680  4690 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:00:58.109488  4544 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.145516  1608 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:58.114176  4653 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.217988  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.128844  4562 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:58.221096  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 380411us
I20260709 13:00:58.222975  1676 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.111181  4692 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:58.145020  4704 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.224440  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 138313us
I20260709 13:00:58.224990  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.137578  4679 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.227181  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:58.140205  4673 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.232728  4343 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:00:58.143847  4697 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.211050  4706 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.221748  4675 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:58.137619  4703 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:00:58.325626  4703 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.326171  4703 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.328454  4548 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.329035  4548 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.331082  4548 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.227844  4560 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:00:58.254820  4567 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
W20260709 13:00:58.255523  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 156894us
I20260709 13:00:58.344125  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:58.207598  4566 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.118319  4691 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.110294  4561 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.268178  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.352087  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.352356  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:58.353298  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.354048  1534 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:58.354828  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.355820  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:58.285151  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.118302  4705 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.237958  4696 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.148859  4573 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
W20260709 13:00:58.356773  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.317526  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 490) took 1019 ms. Trace:
I20260709 13:00:58.208038  4666 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.322055  4713 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:58.270020  4704 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.269582  4692 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.276515  4671 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.323462  4544 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.260823  4653 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.324080  4343 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:58.331919  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 104813us
W20260709 13:00:58.346475  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 203611us
I20260709 13:00:58.379813  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.382536  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:58.262707  4518 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.770s	user 0.004s	sys 0.008s
I20260709 13:00:58.357818  1525 rpcz_store.cc:276] 0709 13:00:57.298154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.344705 (+ 46551us) service_pool.cc:224] Handling call
0709 13:00:57.345155 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.345541 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.345568 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.346094 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.746936 (+400842us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.746981 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.747984 (+  1003us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.317341 (+569357us) raft_consensus.cc:1685] finished
0709 13:00:58.317358 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.317474 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":400397,"threads_started":1,"wal-append.queue_time_us":509440}
I20260709 13:00:58.388243  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.314164  4679 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.332118  4703 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.389899  2255 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:58.345640  4566 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:58.385190  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.385915  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.387511  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.367167  4568 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.391903  1534 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.398605  2254 raft_consensus.cc:2376] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8. Re-sending same reply.
I20260709 13:00:58.394754  1674 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:58.346065  4567 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.370249  4604 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.336838  4675 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.398183  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.399624  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.400676  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.404021  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.401228  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:58.405066  1674 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.404143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:58.405831  1683 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.406960  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.407542  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.409111  1683 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:58.411717  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.411972  1679 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:58.412914  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.413504  1525 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.374238  4713 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:58.413389  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:58.415391  1683 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.419924  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.424093  1678 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:58.420778  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.425055  2258 raft_consensus.cc:2376] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5. Re-sending same reply.
I20260709 13:00:58.421577  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.426702  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.378705  4343 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:58.428206  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.428846  2254 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.389894  4656 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.429768  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:58.434346  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 81970.1us
I20260709 13:00:58.403401  4566 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.442178  1677 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:58.444167  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.444698  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.445402  1678 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:58.446287  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.446835  1678 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:00:58.447597  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:58.448189  1678 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.436578  1681 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:00:58.451658  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.452767  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.435443  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:58.445581  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:58.402204  4683 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.408651  4703 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.406571  4573 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.442188  4673 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.453861  2254 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:00:58.466184  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.362283  4691 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.410854  4568 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.419960  4518 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.477190  4463 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.477790  4518 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.420177  4589 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.479710  4589 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:58.480257  4653 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.480896  4653 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.480674  4589 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.469238  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.481938  4713 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.482707  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.484396  4719 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.484850  4719 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.485374  4719 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.486835  4562 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.432788  4717 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.469955  1525 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
W20260709 13:00:58.453948  4565 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.001s
I20260709 13:00:58.473030  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:58.493990  1679 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 3.
I20260709 13:00:58.468797  4426 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.476358  4343 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:58.469226  2257 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:58.488647  4717 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.495131  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:58.402990  4689 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:00:58.505870  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.510416  2257 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
W20260709 13:00:58.518008  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 82670.5us
I20260709 13:00:58.519814  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.493233  4709 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:58.491639  4565 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.502516  4604 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.522724  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.470963  4573 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:58.549834  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 167358us
I20260709 13:00:58.553153  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.522038  4343 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.554431  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:58.526883  4673 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.565708  1677 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:58.563676  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:58.569089  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.570637  4721 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.571452  4721 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:58.544097  4653 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.546227  4696 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.555321  4722 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.559782  4320 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:58.605711  4562 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:58.610083  4657 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.126s	user 0.010s	sys 0.000s
W20260709 13:00:58.611596  4533 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.000s
I20260709 13:00:58.613018  4565 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.612691  4704 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.613332  4722 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:58.572060  4683 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:58.562492  4568 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:00:58.628132  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1866) took 1104 ms. Trace:
I20260709 13:00:58.572983  4656 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.545617  4604 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:00:58.603368  4673 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:58.604445  4721 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.655321  1534 rpcz_store.cc:276] 0709 13:00:57.523417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.483618 (+960201us) service_pool.cc:224] Handling call
0709 13:00:58.483909 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.484120 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:58.507926 (+ 23806us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.627642 (+119716us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.627785 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.627828 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.627875 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.627937 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.628070 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25882,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"thread_start_us":119079,"threads_started":1,"wal-append.queue_time_us":147916}
I20260709 13:00:58.618109  4689 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.609925  4717 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.580291  4566 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.533758  4709 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:58.652580  4716 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:00:58.665840  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94639.4us
I20260709 13:00:58.653937  4696 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.673062  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:00:58.654503  4722 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.651667  4692 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.663270  4671 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.664628  4561 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:58.686020  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.664225  4567 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:58.688099  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.619665  4320 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.680888  4552 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.667034  4721 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:58.672866  4673 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:00:58.688602  4654 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.556s	user 0.005s	sys 0.005s
I20260709 13:00:58.675052  4696 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:58.631548  4533 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.662348  4729 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:00:58.704811  4725 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:58.732847  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:58.737309  1534 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:58.684352  4675 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.707515  4696 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.625545  4657 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:58.732560  4572 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.465s	user 0.013s	sys 0.000s
I20260709 13:00:58.756157  2254 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:58.730650  4552 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.735184  4659 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.095s	user 0.012s	sys 0.000s
W20260709 13:00:58.743918  4730 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:58.744517  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.729415  4654 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.710819  4709 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.704658  4704 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.677873  4689 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.705931  4691 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.730275  4731 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.775612  1532 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:58.776245  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 101713us
I20260709 13:00:58.777086  4422 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.778373  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 477) took 1275 ms. Trace:
I20260709 13:00:58.778798  1602 rpcz_store.cc:276] 0709 13:00:57.502971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.506088 (+  3117us) service_pool.cc:224] Handling call
0709 13:00:57.587393 (+ 81305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.587663 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:57.606263 (+ 18600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.412125 (+805862us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003029e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:00:58.776830 (+364705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.776879 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.776918 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.778033 (+  1115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.778296 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3757,"prepare.queue_time_us":18538,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":7110,"raft.queue_time_us":3872,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":6498048,"thread_start_us":360450,"threads_started":1}
I20260709 13:00:58.781091  4657 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.757699  3955 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.781968  3955 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:58.782763  3955 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.760841  4552 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.783974  3955 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.785725  4552 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.758787  4572 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:58.760478  4403 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.003s
I20260709 13:00:58.788956  4572 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.788717  4403 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.766573  4659 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.700286  4733 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:00:58.790829  1527 raft_consensus.cc:2368] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5.
I20260709 13:00:58.770089  4533 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.756681  4573 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:58.771103  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 216743us
I20260709 13:00:58.798534  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.796818  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 492) took 1498 ms. Trace:
I20260709 13:00:58.799811  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:58.800168  1533 rpcz_store.cc:276] 0709 13:00:57.298680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.467945 (+169265us) service_pool.cc:224] Handling call
0709 13:00:57.474226 (+  6281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.480037 (+  5811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.796605 (+1316568us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b54002cd150. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:58.796749 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13800832}
I20260709 13:00:58.789896  4669 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:58.824710  4669 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:58.825659  4669 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.826882  4669 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.807480  4403 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.808137  4320 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.812090  4659 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:00:58.812966  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.814198  4654 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.805444  4662 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.816677  4566 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:58.829527  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.831946  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:58.774412  4604 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:58.783425  4689 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.843216  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:58.806156  4691 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.845218  1534 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:58.849634  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.850673  2253 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.791407  4731 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:00:58.844653  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51353.8us
I20260709 13:00:58.851634  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:58.849596  2259 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEARNER]: Advancing to term 7
I20260709 13:00:58.851919  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.853171  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:58.853840  2255 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:58.854333  2253 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:58.855273  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.855862  2255 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:58.856581  2261 raft_consensus.cc:2368] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:58.857332  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:58.858531  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.859215  2255 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:58.862735  1607 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:58.870560  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:00:58.858235  4697 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:00:58.873049  2259 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:58.870747  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:58.865490  4320 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.846721  4566 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.855880  4662 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.772802  4673 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.757643  4721 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.885488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:58.903420  2255 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:58.911033  1602 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.904253  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.908788  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.868985  4572 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:58.940038  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.922286  4689 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:58.946904  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.951582  2253 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:00:58.947584  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.949002  4656 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:58.858384  4731 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.954874  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.957461  2255 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.905373  4733 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.867532  4657 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:00:58.955621  4704 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:58.963135  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1692) took 1037 ms. Trace:
I20260709 13:00:58.968899  1606 rpcz_store.cc:276] 0709 13:00:57.925325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.055795 (+130470us) service_pool.cc:224] Handling call
0709 13:00:58.085765 (+ 29970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.086081 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.086111 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.095638 (+  9527us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.682011 (+586373us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800392b60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:00:58.731377 (+ 49366us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.731419 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.731490 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.957663 (+226173us) raft_consensus.cc:1685] finished
0709 13:00:58.957682 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.963076 (+  5394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27103,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10663,"spinlock_wait_cycles":32018304,"thread_start_us":49130,"threads_started":1,"wal-append.queue_time_us":686759}
I20260709 13:00:58.970927  3955 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:58.950141  4572 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.905565  4320 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:58.965339  1534 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:58.908097  4662 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.973934  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.989888  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:58.990371  4662 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.993623  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:58.955255  4403 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.912001  4739 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:58.963706  4740 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:58.974902  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.968359  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:58.945674  4566 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.909942  4697 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:58.990129  4518 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:58.997295  4462 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:59.015837  4672 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.514s	user 0.005s	sys 0.002s
I20260709 13:00:59.021879  1605 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.022161  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.023015  4722 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:58.998421  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.038765  1604 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.026684  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.019868  1603 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:00:59.029191  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.039709  2260 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 4.
W20260709 13:00:59.034548  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 470923us
I20260709 13:00:58.960872  4733 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:00:58.972997  4691 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.048105  1601 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:59.027348  2253 raft_consensus.cc:2368] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:00:59.044519  1533 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:58.993988  4572 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.047333  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.033854  4462 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:59.040653  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:59.059862  4691 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.056753  4733 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.009009  4403 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.062637  1602 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:00:59.076625  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.091048  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:59.078553  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:59.070533  2261 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:58.975507  4704 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.083333  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.081632  1605 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:00:59.094506  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:00:59.074707  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:59.066352  4719 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.006s
I20260709 13:00:59.102370  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:59.103339  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.104111  2252 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:59.105008  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.106076  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.100128  4739 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.101379  1602 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:59.071481  4691 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.076107  4722 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.062345  4320 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.100445  1604 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:00:59.108446  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 493) took 1809 ms. Trace:
I20260709 13:00:59.069206  4696 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.129355  1531 rpcz_store.cc:276] 0709 13:00:57.298916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.473762 (+174846us) service_pool.cc:224] Handling call
0709 13:00:57.474073 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.643204 (+169131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.643232 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.643271 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:57.643298 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.108145 (+1464847us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002a7e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:59.108197 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.108376 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388539264}
I20260709 13:00:59.131093  4566 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.131582  4696 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.098071  4729 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.076834  4518 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:59.097612  4709 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.073133  4462 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:59.110142  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1857) took 1830 ms (client timeout 1507 ms). Trace:
I20260709 13:00:59.166913  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:00:59.114295  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.208618  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:00:59.563244  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.563480  4462 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.128360  4745 raft_consensus.cc:2764] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:59.217926  4589 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.113858  4704 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.416671  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1861) took 2178 ms. Trace:
W20260709 13:00:59.231562  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 1878) took 1730 ms (client timeout 2114 ms). Trace:
I20260709 13:00:59.240741  2256 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:59.570498  1532 rpcz_store.cc:276] 0709 13:00:57.238288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.238418 (+   130us) service_pool.cc:224] Handling call
0709 13:00:57.260098 (+ 21680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.776082 (+1515984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.416366 (+640284us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54003061d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:59.416583 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484898560}
I20260709 13:00:59.367080  1534 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:59.363485  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.573946  2258 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.407334  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.575992  2261 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:59.566675  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 336192us
I20260709 13:00:59.578173  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:59.579013  4527 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:59.563663  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.581182  4426 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.581990  4426 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:00:59.583719  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 416115us
I20260709 13:00:59.584288  4426 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:59.585268  4546 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.585887  4546 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:59.139856  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.234625  3955 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.246325  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1860) took 2009 ms (client timeout 2114 ms). Trace:
I20260709 13:00:59.283613  4560 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.240250  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.194921  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.564774  4463 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.588238  4527 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:59.563740  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 355189us
I20260709 13:00:59.589576  4456 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.589049  4546 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.595408  4456 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.119860  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.596446  1525 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.597775  4456 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.564124  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.120280  4320 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.122925  1431 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 5, leader changed from <none> to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:59.599749  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.606770  4456 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:59.606540  1431 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.607846  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:00:59.115692  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 295) took 19814 ms (client timeout 15000 ms). Trace:
I20260709 13:00:59.416025  4561 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.116410  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2023) took 1459 ms. Trace:
W20260709 13:00:59.559032  1527 rpcz_store.cc:269] 0709 13:00:57.279576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.280389 (+   813us) service_pool.cc:224] Handling call
0709 13:00:59.109914 (+1829525us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540008e8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:59.110053 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471311232}
W20260709 13:00:59.593361  1681 rpcz_store.cc:269] 0709 13:00:57.501157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.501288 (+   131us) service_pool.cc:224] Handling call
0709 13:00:59.231323 (+1730035us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540007cbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:59.231479 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139269376}
W20260709 13:00:59.472594  4737 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.563s	user 0.002s	sys 0.001s
W20260709 13:00:59.110616  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 1871) took 1486 ms (client timeout 1790 ms). Trace:
W20260709 13:00:59.652081  1529 rpcz_store.cc:269] 0709 13:00:57.624496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.720953 (+ 96457us) service_pool.cc:224] Handling call
0709 13:00:59.110441 (+1389488us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540043c454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:59.110559 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487606144}
I20260709 13:00:59.469172  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1883) took 1964 ms. Trace:
I20260709 13:00:59.110379  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:00:59.593300  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:00:59.647262  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.592365  2254 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:00:59.645717  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 831) took 1068 ms. Trace:
I20260709 13:00:59.622345  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.620746  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.654165  2259 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:59.621876  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.591638  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:00:59.654903  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.608603  1531 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
W20260709 13:00:59.657148  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 65602.9us
I20260709 13:00:59.128631  4719 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:00:59.649670  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66308.7us
I20260709 13:00:59.682725  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.683076  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.685114  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.685883  1604 raft_consensus.cc:2410] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:59.219440  4701 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:59.432921  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.591192  1526 rpcz_store.cc:269] 0709 13:00:57.237152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.237287 (+   135us) service_pool.cc:224] Handling call
0709 13:00:59.246123 (+2008836us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540008e3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:00:59.246258 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927716608}
I20260709 13:00:59.652953  1676 rpcz_store.cc:276] 0709 13:00:57.504660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.514071 (+  9411us) service_pool.cc:224] Handling call
0709 13:00:57.594942 (+ 80871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.227078 (+632136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.468899 (+1241821us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540024b3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:59.469099 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443875200}
W20260709 13:00:59.381067  2257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.010s	sys 0.006s
W20260709 13:00:59.699170  2257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.013s	sys 0.009s
I20260709 13:00:59.656234  1682 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:59.610755  1609 rpcz_store.cc:276] 0709 13:00:57.656817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.656989 (+   172us) service_pool.cc:224] Handling call
0709 13:00:57.657342 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.688391 (+ 31049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.688426 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.712457 (+ 24031us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.017182 (+304725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:58.017237 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.115978 (+1098741us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54001bbcd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:59.116034 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.116083 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:59.116100 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.116339 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24944,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":15272,"spinlock_wait_cycles":33132416,"thread_start_us":217831,"threads_started":1,"wal-append.queue_time_us":340042,"wal-append.run_cpu_time_us":1798,"wal-append.run_wall_time_us":1058892}
I20260709 13:00:59.639923  1525 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:00:59.660334  1681 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:00:59.659752  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.661237  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.701231  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1694) took 1265 ms. Trace:
W20260709 13:00:59.386989  4684 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.572s	user 0.000s	sys 0.004s
I20260709 13:00:59.701690  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:59.663010  1674 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:59.590718  3955 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.710763  1681 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:59.709244  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:59.663712  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.712041  1532 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.664324  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:59.667423  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.701684  1683 rpcz_store.cc:276] 0709 13:00:58.435811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.442264 (+  6453us) service_pool.cc:224] Handling call
0709 13:00:58.442551 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.442775 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.442802 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.104021 (+661219us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c0012ecf8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:00:59.104486 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.567400 (+462914us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:59.567442 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.567527 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.695643 (+128116us) raft_consensus.cc:1685] finished
0709 13:00:59.695668 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.701160 (+  5492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27884800,"thread_start_us":462525,"threads_started":1,"wal-append.queue_time_us":588933}
I20260709 13:00:59.713972  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:00:59.714545  1680 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.124209  4662 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.115886  4519 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.674661  1533 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:59.676463  4722 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.679762  1678 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:59.654865  2256 rpcz_store.cc:276] 0709 13:00:58.577557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.577709 (+   152us) service_pool.cc:224] Handling call
0709 13:00:58.578079 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.571188 (+993109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.645248 (+ 74060us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54003a1e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:00:59.645501 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523346816}
I20260709 13:00:59.688920  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.608852  4685 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.118180  4697 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.127988  4403 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.735260  2253 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:59.108064  4739 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:00:59.688753  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:59.690886  1649 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:00:59.701148  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.700022  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 828) took 1184 ms. Trace:
I20260709 13:00:59.702987  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:00:59.737483  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48804us
I20260709 13:00:59.698668  4701 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:00:59.738489  1609 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:00:59.362278  4733 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.710124  4686 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.737701  1602 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:59.741514  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50696.3us
I20260709 13:00:59.739666  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.662062  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.661425  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.743611  1600 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:00:59.709753  4422 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:00:59.705227  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:00:59.706328  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.708513  2258 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:00:59.709065  1601 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:59.676620  4679 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.703708  1675 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:59.652822  4721 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.616982  4561 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:59.711644  1676 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:00:59.717664  2260 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:59.719992  1679 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:59.720575  1683 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:59.724404  1674 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.727224  1678 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:59.756608  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.107426  4572 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.736433  4662 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.689090  4709 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:00:59.361380  4731 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.745724  1680 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:00:59.612946  4546 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 13:00:59.746436  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.244514  4726 consensus_queue.cc:1175] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:00:59.691979  4282 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:59.737926  2257 rpcz_store.cc:276] 0709 13:00:58.515292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.515757 (+   465us) service_pool.cc:224] Handling call
0709 13:00:58.516124 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.516384 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:58.848078 (+331694us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.699641 (+851563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.699705 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:59.699755 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.699823 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.699961 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369678,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":16223,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":1168407,"threads_started":2,"wal-append.queue_time_us":717324}
I20260709 13:00:59.717777  4518 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:00:59.691628  4567 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:59.757411  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:00:59.772663  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:59.737448  4722 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.757580  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:00:59.761598  1674 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:59.593554  4560 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.739451  4604 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.763054  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.736433  4739 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.768163  3955 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.751590  4678 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.764771  4654 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.754567  4422 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.748852  4686 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.779809  4561 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.787554  4733 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.772445  4451 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:00:59.805104  4751 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:00:59.806968  4686 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:00:59.812959  4700 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.813649  4700 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.819393  4731 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.781940  4604 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.821887  4604 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.823134  4572 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.794250  4709 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.797242  4561 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.794279  4678 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:00:59.837448  4678 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.792434  4701 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:00:59.841553  4701 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.844692  4719 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.846336  4722 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:00:59.849879  4700 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:00:59.851231  4700 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.851821  4700 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:00:59.855259  4685 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.855834  4685 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.865600  4700 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:00:59.649179  1430 rpcz_store.cc:269] 0709 13:00:39.301820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.302561 (+   741us) service_pool.cc:224] Handling call
0709 13:00:59.115607 (+19813046us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.412755 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.421116 (+  8361us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.421165 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:50.421183 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:50.588667 (+167484us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.588789 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.588818 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:50.589824 (+  1006us) tablet.cc:701] Row locks acquired
0709 13:00:50.589877 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:00:50.590084 (+   207us) write_op.cc:270] Start()
0709 13:00:50.590247 (+   163us) write_op.cc:276] Timestamp: P: 1783602050590008 usec, L: 0
0709 13:00:50.590267 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.591226 (+   959us) log.cc:844] Serialized 3718 byte log entry
0709 13:00:51.330006 (+738780us) op_driver.cc:464] REPLICATION: finished
0709 13:00:51.564500 (+234494us) write_op.cc:301] APPLY: starting
0709 13:00:51.564674 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:51.564991 (+   317us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:51.565150 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:52.199463 (+634313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:52.308471 (+109008us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:00:52.308537 (+    66us) write_op.cc:312] APPLY: finished
0709 13:00:52.365871 (+ 57334us) log.cc:844] Serialized 71 byte log entry
0709 13:00:52.486502 (+120631us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.499938 (+ 13436us) write_op.cc:454] Released schema lock
0709 13:00:52.503341 (+  3403us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:52.579697 (+ 76356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.604231 (+ 24534us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2162661,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":178447,"apply.run_cpu_time_us":30610,"apply.run_wall_time_us":1032959,"num_ops":9,"prepare.queue_time_us":505821,"prepare.run_cpu_time_us":13657,"prepare.run_wall_time_us":422748,"raft.queue_time_us":283189,"raft.run_cpu_time_us":8865,"raft.run_wall_time_us":212832,"replication_time_us":700006,"thread_start_us":642028,"threads_started":5,"wal-append.queue_time_us":401626,"wal-append.run_cpu_time_us":11164,"wal-append.run_wall_time_us":2331056}]]}
I20260709 13:00:59.608522  1431 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 4, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.897312  1431 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 5, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 5 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:00:59.611140  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:00:59.661939  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.902705  1431 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 4, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.910778  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:00:59.910604  1431 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:59.906719  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 295490us
I20260709 13:00:59.913147  1431 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 6 to 7, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 7 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.914258  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:59.917711  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.918373  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1855) took 2646 ms. Trace:
I20260709 13:00:59.920090  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.918933  1528 rpcz_store.cc:276] 0709 13:00:57.272138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.308813 (+ 36675us) service_pool.cc:224] Handling call
0709 13:00:57.309158 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.309501 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.309530 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.318021 (+  8491us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.502322 (+184301us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.502380 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.502492 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.384865 (+1882373us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:00:59.917685 (+532820us) raft_consensus.cc:1685] finished
0709 13:00:59.917752 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.918139 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":615,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":9584512,"thread_start_us":63904,"threads_started":1,"wal-append.queue_time_us":363066}
I20260709 13:00:59.922017  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.922920  1528 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:00:59.924515  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.925036  1525 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:00:59.926033  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.926410  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.927438  1525 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:59.928519  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.929211  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:59.930370  1530 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.930505  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.930574  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.931620  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.932166  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:00:59.932462  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:00:59.932494  1534 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:00:59.938696  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.942307  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:00:59.728114  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:00:59.704512  1603 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.721709  1604 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.945025  1606 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:00:59.945538  1607 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:00:59.931731  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:00:59.953173  1532 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:00:59.931557  1528 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.916101  1431 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 5, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.075919  1527 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.074189  1526 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:01:00.079035  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.086759  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.086622  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.091692  1533 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:00.102595  1609 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.102651  4519 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:00.104722  1682 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:00.105870  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:00.105341  4519 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.107458  1527 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:00.108809  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.109755  1526 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:00.111881  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.112902  1600 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.773795  4518 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.117113  1525 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.097359  1602 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:01:00.107391  1529 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:00.105294  1532 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:00.132565  1601 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:00.103752  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.144619  4422 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.144920  4546 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:00.146382  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 214957us
I20260709 13:01:00.147006  4456 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.147595  4456 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.105767  4527 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.148124  4456 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.114063  4683 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.150947  4683 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.152369  3955 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:00.153872  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.155287  1603 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:01:00.156908  4320 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:01:00.157953  4679 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:00.158829  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:00.161321  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.161546  4733 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.162117  4733 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.162340  1605 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:00.162676  4733 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.163936  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1876) took 1781 ms. Trace:
I20260709 13:01:00.164397  1530 rpcz_store.cc:276] 0709 13:00:58.381989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.869038 (+487049us) service_pool.cc:224] Handling call
0709 13:00:58.904297 (+ 35259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.029188 (+1124891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.163573 (+134385us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400304dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:00.163842 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2358315264}
I20260709 13:01:00.165635  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:00.165391  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 422927us
W20260709 13:01:00.166383  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.168272  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 544) took 1103 ms. Trace:
I20260709 13:01:00.168781  2260 rpcz_store.cc:276] 0709 13:00:59.064612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.075719 (+ 11107us) service_pool.cc:224] Handling call
0709 13:00:59.076244 (+   525us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:59.756185 (+679941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.167437 (+411252us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54005de8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:00.167988 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474380672}
I20260709 13:01:00.171357  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 498) took 1116 ms. Trace:
I20260709 13:01:00.174268  4685 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.171921  1534 rpcz_store.cc:276] 0709 13:00:59.054655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.654624 (+599969us) service_pool.cc:224] Handling call
0709 13:01:00.171043 (+516419us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002cd654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:00.171263 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630897536}
I20260709 13:01:00.177502  1531 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:00.176873  4675 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.182025  4567 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:00.168699  4722 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:00.186591  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.158977  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 230068us
I20260709 13:01:00.188862  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:00.181329  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.147447  1431 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:00.181497  1602 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:01:00.139951  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.146502   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:00.164988  4560 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:00.208523  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.146667  4518 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.225412  1609 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:01:00.225328  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.228448  4567 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.229686  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:00.230224  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.177109  4685 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.212611  4320 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.232885  4320 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.234441  4763 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.234911  4763 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.235280  4763 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:00.236078  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 486610us
I20260709 13:01:00.237926  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:00.240618  4654 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:00.241060  4762 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:00.229110  1603 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:00.242411  4654 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.247617  1528 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:00.159603  4679 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.186671  4722 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:00.259456  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70823.2us
I20260709 13:01:00.254776  1605 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:00.252031  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:00.251554  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:00.298359  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 108385us
I20260709 13:01:00.251147  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:00.252007  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:00.250332  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:00.252213  1431 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.285521  4320 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.263294  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:00.309116  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76827.4us
W20260709 13:01:00.319137  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.310777  4567 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:00.322908  4572 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.328224  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.323845  2252 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 5: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:00.332011  4731 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:00.339308  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.343920  4282 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:00.324014  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:00.344941  4722 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.338613  4320 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.345928  4320 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.349653  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.350613  1608 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:00.346506  4282 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:00.351228  4282 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:00.351591  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.011s	sys 0.007s
W20260709 13:01:00.352010  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.007s
I20260709 13:01:00.352358  4282 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.353629  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.354465  4775 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.356420  4567 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.356523  4685 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.356932  4777 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:00.357575  4685 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.358127  4685 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.358026  4721 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:00.355446  4775 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.356458  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:00.351733  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.357365  4655 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:00.352221  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:01:00.364248  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54573.5us
I20260709 13:01:00.364744  2252 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:00.373750  4572 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.367864  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.380614  1525 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:00.368564  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.382426  1682 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.367590  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.384133  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.368199  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.385900  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.386121  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.388334  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:00.388836  1683 raft_consensus.cc:2410] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 7 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:00.367439  4320 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.376806  4655 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.390130  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.394220  4778 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.395318  4778 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.375910  4572 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.398773  4572 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.401255  1431 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 5 to 7, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:00.402817  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:00.404421  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.405402  4761 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:00.405961  4761 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:00.407133  4761 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.407409  4733 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.411108  4771 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.402040  4778 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.412755  1528 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:00.368476  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.402972  1431 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 5 to 7, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:00.374064  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.364450  4731 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:00.382340  2257 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:00.364882  4764 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.417871  1679 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.407544  4655 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.422111  1605 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:00.422729  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 108031us
I20260709 13:01:00.424001  1532 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:00.373781  4462 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.010s
I20260709 13:01:00.419756  1431 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:00.436749  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:00.437805  4733 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.438308  1498 leader_election.cc:400] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:01:00.438573  4733 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:00.439069  4733 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.439424  4733 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:00.422294  4721 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:00.438683  1498 leader_election.cc:403] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.439325  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.444841  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.450660  1679 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:01:00.454324  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50052us
I20260709 13:01:00.454809  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.366585  4567 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:01:00.457368  1605 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:00.456956  1431 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:00.457978  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.458242  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.458748  1600 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:00.458586  1431 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 6, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 6 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.459568  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.459692  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.461529  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.463505  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:00.464571  4739 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 4. Current term is 5.
I20260709 13:01:00.465499  4739 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:00.466384  4775 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.467773  4527 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.461724  4282 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.469223  1603 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:00.461534  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.470203  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.471087  1608 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:00.471804  1603 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:00.472437  1608 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:00.468524  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.016s	sys 0.023s
W20260709 13:01:00.473162  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.016s	sys 0.024s
I20260709 13:01:00.479383  1528 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.473803  1608 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:00.472692  4763 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.482054  1600 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.489950  1606 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.489779  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.490728  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.491219  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.491671  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.469412  1605 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:00.491619  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:00.493413  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.492164  1608 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.494087  4763 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:00.468626  4456 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:00.615284  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.584482  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.455565  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:00.688661  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65422.2us
W20260709 13:01:00.587175  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.700765  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.601459  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 148521us
W20260709 13:01:00.662148  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.494210  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.705013  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:00.604146  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 152895us
I20260709 13:01:00.547883  1675 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:01:00.548130  4768 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.288s	user 0.004s	sys 0.000s
W20260709 13:01:00.728148  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.702654  1431 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 2 to 6, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 6 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:00.729251  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.728462  1533 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.423910  4731 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:00.733210  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.585595  4773 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.320s	user 0.000s	sys 0.002s
I20260709 13:01:00.731844  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.548435  4567 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:00.740782  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 187777us
I20260709 13:01:00.741756  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.687004  4546 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.742442  1528 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:00.743018  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.649672  4739 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:00.737155  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.744130  1603 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.482172  4683 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.740768  1676 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:00.741964  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.697163  4700 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.742674  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:00.749565  1531 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:00.754703  1677 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.757377  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.577134  4759 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.763342  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.544543  4721 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.766085  1676 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:00.768347  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:00.767726  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 68076.6us
I20260709 13:01:00.757586  1431 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 4, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.769275  1525 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:00.762778  1674 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.753355  4700 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:00.751765  4320 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.749099  4567 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:00.759186  4764 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.748992  4775 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.760840  4683 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.777365  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.785075  4778 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.785827  4778 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.786899  4456 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.790311  4700 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.777211  4764 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:00.792685  4764 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.793646  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.774461  4685 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.795946  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:00.796543  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 382066us
I20260709 13:01:00.799364  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:00.788079  4778 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.800437  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.795946  4685 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.796064  4758 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:01:00.803121  1678 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:00.804553  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.804728  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.805691  1608 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:00.806799  1677 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.807611  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.808794  1678 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:00.809937  4721 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:00.810809  4765 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.546s	user 0.001s	sys 0.001s
I20260709 13:01:00.771253  4759 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:00.811923  4764 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.814050  4759 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.815258  4666 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.810854  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:00.817811  1677 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:00.820102  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.821525  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.820540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.814535  4764 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.825519  1603 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:00.825930  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:00.825731  1677 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:00.780822  1431 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 6, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 6 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.828985  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2037) took 1125 ms. Trace:
I20260709 13:01:00.829212  1604 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.792138  4700 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.829396  2255 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:01:00.830158  4770 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:00.830595  4778 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.776360  4320 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:00.778893  4546 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.823315  1679 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:00.837824  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:00.840281  1680 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.829437  1609 rpcz_store.cc:276] 0709 13:00:59.703182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.739345 (+ 36163us) service_pool.cc:224] Handling call
0709 13:01:00.828700 (+1089355us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54004371d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:00.828896 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661089536}
I20260709 13:01:00.845541  1600 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:00.848049  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76529.5us
I20260709 13:01:00.829420  1431 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 5, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.762558  4572 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:01:00.856895  1678 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:00.840448  4320 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:00.865175  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65931.4us
I20260709 13:01:00.831276  4778 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.869568  1431 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.852991  4456 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:00.873680  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.831385  4683 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.879271  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.812178  4733 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.885578  4733 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:00.874809  2255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 542) took 1845 ms (client timeout 1530 ms). Trace:
I20260709 13:01:00.871600  4282 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.876163  4456 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.889768  2255 rpcz_store.cc:269] 0709 13:00:59.026103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.026366 (+   263us) service_pool.cc:224] Handling call
0709 13:01:00.861121 (+1834755us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54007602d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:00.871614 (+ 10493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4116028800}
I20260709 13:01:00.891544  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:00.831310  4567 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:00.896257  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 76343.2us
I20260709 13:01:00.892369  1431 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 1 to 4, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.866674  4527 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:01:00.887723  4761 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.905023  3955 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.905596  3955 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:00.894551  4733 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:00.896703  4456 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.911262  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.917541  1608 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.913151  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.914151  3955 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.914896  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:00.918511  1603 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:00.924562  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:00.925262  1603 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:00.926257  4527 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.926921  4527 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:00.919209  4546 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.929303  4527 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:00.931232  4733 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:00.932283  4733 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:00.933300  4683 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:00.936815  1603 raft_consensus.cc:2410] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:00.938320  4675 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.938951  4675 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:00.940480  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 146980us
I20260709 13:01:00.929121  4567 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.941337  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:00.942989  4759 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.943392  4759 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.943734  4759 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:00.946628  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 150785us
I20260709 13:01:00.946870  4604 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.948036  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:00.949846  4722 raft_consensus.cc:2764] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:00.950837  4722 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.950973  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1710) took 1015 ms. Trace:
I20260709 13:01:00.951377  4722 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:00.952594  4709 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:00.953393  4709 consensus_queue.cc:1243] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:00.951395  1604 rpcz_store.cc:276] 0709 13:00:59.935443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.153953 (+218510us) service_pool.cc:224] Handling call
0709 13:01:00.170102 (+ 16149us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0ce9c 00007f7e60a0ca5b 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:00.828868 (+658766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.832502 (+  3634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.950756 (+118254us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54004371d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:00.950911 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518806272}
I20260709 13:01:00.959466  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:00.958514  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:00.962306  4739 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:00.964128  1682 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
W20260709 13:01:01.001783  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57518.7us
W20260709 13:01:01.003786  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 251216us
I20260709 13:01:00.956544  4722 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:01.021063  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63972.5us
I20260709 13:01:01.023130  4685 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:01.023648  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 102410us
I20260709 13:01:01.023662  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1712) took 1087 ms. Trace:
W20260709 13:01:01.031931  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75515.6us
I20260709 13:01:01.023615  4685 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:01.015905  4760 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.014248  4731 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:01.018855  4777 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:01.034696  1600 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:01.024048  4701 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:01.037505  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 88129.1us
I20260709 13:01:01.027551  1607 rpcz_store.cc:276] 0709 13:00:59.936030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.594241 (+658211us) service_pool.cc:224] Handling call
0709 13:01:00.594752 (+   511us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.595267 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.595296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.596043 (+   747us) log.cc:844] Serialized 52 byte log entry
0709 13:01:00.873717 (+277674us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:00.873781 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.873868 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.023414 (+149546us) raft_consensus.cc:1685] finished
0709 13:01:01.023442 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.023607 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":150,"thread_start_us":254643,"threads_started":1,"wal-append.queue_time_us":324170}
I20260709 13:01:01.042052  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:01.040030  4787 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:01:01.047230  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.051894  4675 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.049566  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.056492  3955 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.057466  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.039958  4701 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:01.058192  1603 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:01.058487  3955 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.060528  1604 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:01.062785  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.063493  1609 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:01.063835  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1709) took 1129 ms. Trace:
I20260709 13:01:01.055545  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.065337  1602 rpcz_store.cc:276] 0709 13:00:59.935019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.153817 (+218798us) service_pool.cc:224] Handling call
0709 13:01:00.154347 (+   530us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.181130 (+ 26783us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:00.296627 (+115497us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.871653 (+575026us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.957218 (+ 85565us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.970186 (+ 12968us) log.cc:844] Serialized 52 byte log entry
0709 13:01:00.970353 (+   167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.970396 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.970469 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.063638 (+ 93169us) raft_consensus.cc:1685] finished
0709 13:01:01.063656 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.063780 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111431,"prepare.queue_time_us":117710,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":202500,"raft.run_cpu_time_us":534,"raft.run_wall_time_us":12160,"thread_start_us":415240,"threads_started":2,"wal-append.queue_time_us":368576}
I20260709 13:01:01.069561  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:01.055194  4451 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.057507  4775 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:01.055502  4777 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:01.079207  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45451.7us
I20260709 13:01:01.083034  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:01.085130  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51141.6us
I20260709 13:01:01.086453  1603 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:01.045420  4760 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.084376  4685 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.090924  4685 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.091678  4701 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.092769  4661 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.093371  4701 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.093513  4661 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.094563  4661 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.055966  4731 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.060925  4739 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.101038  3955 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.101234  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.099897  4451 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.103293  4777 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.101255  4757 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:01.097889  4760 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:01.087646  4788 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:01:01.118135  4795 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:01:01.122035  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:01:01.133829  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:01:01.127329  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44478.8us
I20260709 13:01:01.124022  4759 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:01.139814  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51366.8us
I20260709 13:01:01.139093  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.141268  4757 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:01.097766  4567 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.151271  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:01.157546  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.159698  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:01.141716  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57152.1us
I20260709 13:01:01.146379  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.124229  4778 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.169766  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.171204  3955 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.171586  3955 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.171909  3955 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.158099  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.173844  1609 raft_consensus.cc:606] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.147023  4758 raft_consensus.cc:2764] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:01:01.150856  4800 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:01.180769  1647 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7.
I20260709 13:01:01.180678  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.184387  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:01.185590  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 120309us
I20260709 13:01:01.185901  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:01.186481  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.158208  4799 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:01.193874  4761 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.156002  4567 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.152691  4709 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.196496  1608 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:01.150058  4701 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.181854  4733 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.155726  4451 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.207100  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.207518  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.195690  4761 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:01.196230  4654 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.151716  4703 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:01:01.199147  4567 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.207185  4794 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:01:01.206921  4701 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:01.216964  1603 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.217602  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.230892  1605 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:01.219439  4675 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.221964  4700 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.222306  4759 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.219919  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:01.224843  4703 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.206437  4722 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.226336  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.208082  4733 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.237979  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.215161  4654 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:01.155800  4757 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.249329  1601 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:01:01.250515  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54762.9us
I20260709 13:01:01.250787  1604 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:01.250607  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50702.8us
I20260709 13:01:01.250672  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.244462  4703 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.230054  4451 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:01.249640  4654 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.247571  4733 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.260263  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.254258  4731 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.246392  4675 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.260910  4722 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:01.266206  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 85598.6us
I20260709 13:01:01.259579  4739 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.262333  4759 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 13:01:01.277660  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.281137  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.285966  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:01.267482  4282 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.262115  4764 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:01.295137  1604 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:01.298014  4722 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:01.296103  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76292.2us
I20260709 13:01:01.306604  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.269440  4778 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:01.331167  4778 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:01.331682  4778 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.332813  4778 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.298946  4282 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:01.309039  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:01.334955  4282 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:01.309587  4806 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:01.335996  4757 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.319279  4775 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.361888  4775 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:01.362841  4775 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.321197  4759 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.295306  4809 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.321729  4675 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:01.322144  4703 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.364156  4775 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.365739  4703 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:01.324761  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45506.2us
I20260709 13:01:01.369732  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.370998  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:01.371033  4733 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.325668  4320 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.327203  4604 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.372673  4604 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:01.373663  4604 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.374799  4809 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.375037  4604 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.375605  4809 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.375964  4809 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:01.284644  4805 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.333244  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.376335  4809 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:01.376812  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 43634.3us
I20260709 13:01:01.310513  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:01.379065  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 68642.3us
W20260709 13:01:01.379654  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.382017  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:01.383255  4451 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:01.383951  4666 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:01.384205  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:01.335896  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:01.385010  1678 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:01.308818  4803 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:01.341807  4812 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.344936  4722 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:01.342903  4774 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.081s	user 0.000s	sys 0.006s
I20260709 13:01:01.385562  4679 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.341179  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.337209  4777 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:01.305087  4739 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.432875  4777 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:01.433902  4777 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.334286  4778 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:01.342373  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70901.9us
I20260709 13:01:01.374089  4320 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.269606  4701 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.384392  4451 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:01.385272  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49458.5us
I20260709 13:01:01.397665  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1704) took 1773 ms. Trace:
I20260709 13:01:01.389808  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:01.391607  1678 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:01.383687  1683 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:01:01.442471  1683 pending_rounds.cc:85] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 8
I20260709 13:01:01.339757  4799 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.348495  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:01:01.442679  4812 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.444448  1600 raft_consensus.cc:606] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.444855  1600 raft_consensus.cc:614] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:01.446717  4812 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:01.442749  4451 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.447160  4764 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.443969  4799 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:01.442724  1683 pending_rounds.cc:107] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:01.448189  1683 raft_consensus.cc:2889] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.385825  4761 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.396755  4794 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:01.400822  4731 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:01.401585  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.402685  4683 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.405210  4685 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:01.353879  3955 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.408396  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:01.411038  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:01.454761  2255 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:01.359433  4567 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.387087  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:01.456763  1676 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:01.412458  4661 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.434362  4739 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.441479  1681 rpcz_store.cc:276] 0709 13:00:59.632005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.715808 (+ 83803us) service_pool.cc:224] Handling call
0709 13:00:59.716094 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.731366 (+ 15272us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:59.731412 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.731986 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.158339 (+426353us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.158444 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.158579 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.021179 (+862600us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:01.342522 (+321343us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b240022b0c8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a8309d 00007f7e636b510e 00007f7e636cc88c 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221
0709 13:01:01.397101 (+ 54579us) raft_consensus.cc:1685] finished
0709 13:01:01.397128 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.397461 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1669,"raft.queue_time_us":1771,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11627,"spinlock_wait_cycles":119417472,"thread_start_us":395753,"threads_started":1,"wal-append.queue_time_us":510349}
I20260709 13:01:01.339722  4456 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:01.438339  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 97236.4us
W20260709 13:01:01.450338  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48873.4us
I20260709 13:01:01.447721  4764 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.461102  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.466877  3955 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.451200  4761 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.447193  4812 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.449911  4794 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.487253  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.489292  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.453778  4527 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:01.508376  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46505.6us
W20260709 13:01:01.510943  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.511016  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:01.517373  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 109079us
I20260709 13:01:01.516495  1600 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:01.442083  4654 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.545410  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:01.509845  4572 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.548458  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.475960  4731 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:01.549288  1600 raft_consensus.cc:2368] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9.
I20260709 13:01:01.506985  4761 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.509713  4709 raft_consensus.cc:2764] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:01.512873  4527 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.516098  4320 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:01:01.514784  4282 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:01.556522  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 108418us
I20260709 13:01:01.546525  4757 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.583850  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:01:01.586755  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:01.615819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.667222  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.761790  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.603521  1681 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:01.656102  1682 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:01.584520  1683 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:01.593863  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 83244.6us
I20260709 13:01:01.575412  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:01.622308  1607 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.600884  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.824005  1606 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:01.704272  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.565021  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.827829  1600 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:01.575009  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2003019260000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:01:01.659453  4817 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:01:01.835060  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.552964  4572 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:01.719985  4819 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:01.832818  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.647655  4759 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.557541  4722 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.557914  4527 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.843200  1601 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:01.843217  3955 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.843719  1676 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:01.658102  4456 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.665948  4567 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:01.757807  4721 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:01.563758  4739 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.285s
I20260709 13:01:01.845157  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.771188  4654 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:01.547008  4760 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.290s
I20260709 13:01:01.828763  4757 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.623194  4733 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.848768  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.847942  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.849706  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.875974  1607 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.855751  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.857335  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:01.859846  3955 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.878228  1601 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:01.756731  4764 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:01.863000  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:01.864092  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.842942  4572 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.883265  1609 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:01.883631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.884374  1528 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:01.665676  4809 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.616217  4810 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.407s
I20260709 13:01:01.868738  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:01.849334  4722 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.873273  1532 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:01.862785  4721 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:01.557186  4451 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.679463  4799 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.882632  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.882987  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.882426  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.886785  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.902832  1531 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:01.903503  1529 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:01.902762  1534 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:01.848359  4759 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:01.888597  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 439358us
I20260709 13:01:01.645267  4731 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.602470  4794 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.876622  4757 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.894963  1602 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.894236  3955 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:01.901407  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72111.7us
I20260709 13:01:01.903981  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:01.888618  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.893496  4820 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:01.908865  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64466.5us
I20260709 13:01:01.910753  4661 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.911891  1534 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:01:01.911350  1527 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:01.911759  4820 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:01.912644  4820 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.911376  2227 leader_election.cc:400] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9.
I20260709 13:01:01.912295  1534 pending_rounds.cc:85] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 3
I20260709 13:01:01.914669  4809 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:01.914122  1534 pending_rounds.cc:107] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:01.915861  1534 raft_consensus.cc:2889] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.893927  4722 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.917780  4757 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.918869  1608 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:01.914754  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.919660  4757 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.925308  1603 raft_consensus.cc:606] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:01.925688  1603 raft_consensus.cc:614] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:01.927029  4799 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.930974  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:01.931605  1527 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.936985  4451 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.940855  4527 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.942705  4778 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.945618  4812 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:01.972244  4829 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.973003  1604 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.972843  4829 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:01.968180  4810 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:01.940685  1609 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:01.974529  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:01.975526  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:43204
I20260709 13:01:01.976166  1609 raft_consensus.cc:606] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:01.953081  4820 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.964993  1607 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:01.975621  4829 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:01.958106  1527 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:01.984385  1607 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:01.982046  4700 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.985607  4700 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:01.973387  4701 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.986686  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:01.988580  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.992009  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.992364  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:01.991372  1527 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:01.974031  4812 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:01.991477  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:01.993271  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.970382  4778 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:01.992893  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:01.999017  1681 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.997704  4654 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:02.000744  4654 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.002053  4685 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.002553  4685 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.003568  4654 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.000288  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:02.005751  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 91117.2us
I20260709 13:01:02.005650  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.980106  4731 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:01.995741  1679 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.012279  1676 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.996992  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:01.995045  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.007591  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.013191  1675 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.008582  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:01.994571  4823 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:01:01.994791  4701 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.014159  1609 raft_consensus.cc:2368] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:01:01.997682  4700 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:01.995087  4282 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:01.986758  4825 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.018410  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:02.017089  4731 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.053745  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.053898  1649 leader_election.cc:400] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:01:02.054519  1649 leader_election.cc:403] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.054646  1681 raft_consensus.cc:2368] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:02.055049  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.024113  4794 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.024624  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:43204
W20260709 13:01:02.057874  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.058032  1606 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.024930  1534 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:02.030045  1676 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.032631  4703 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.016381  4777 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:02.033666  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:02.008862  4685 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.018783  1527 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.990279  4761 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.050590  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:01.978760  4721 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.062583  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.064595  1683 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.063073  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.053884  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.066413  4823 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.066972  2260 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:02.067590  4654 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:02.071631  2257 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:01:02.072772  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.068043  4654 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.075727  4654 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.076278  4722 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.077088  4654 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.077507  1605 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:02.078085  4721 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.078902  2253 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.079138  4722 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.080102  1678 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.080672  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.074708  2252 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:02.082886  4759 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.060475  4703 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:02.084005  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:02.085853  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.067220  4820 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:02.080030  4832 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:02.092119  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.094007  2252 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:02.097249  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.099869  1683 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.104684  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.116968  1533 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:02.122674  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.123353  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.123605  4757 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.125810  4757 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:02.126183  4809 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:02.127010  4757 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.127400  4757 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:02.128274  4757 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.129958  4757 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.125517  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.137262  4758 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:02.138792  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.104032  4282 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:02.142655  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.119715   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:02.143318  1683 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.147202  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:02.150853  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 102108us
I20260709 13:01:02.145083   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:02.102226  4759 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.151240  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.155472  2253 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.143159  4758 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.119493  4700 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:01:02.140333  4722 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.140126  4666 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.167637  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.199887  4685 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.200485  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.201464  1606 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:02.202373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.203013  1606 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:02.203081  4685 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:02.204917  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:02.205866  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.205865  4823 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.206657  4685 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.206779  4823 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.207191  4685 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:02.208129  4685 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.208698  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.209272  1606 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.207198  4823 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.168071  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.176728  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:02.176998  4527 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.192049  4701 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:02.194289  4572 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.196859  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.198536  4761 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:02.176541  4731 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.254827  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.257589  1683 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:01:02.256191  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 88186.1us
I20260709 13:01:02.259696  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.261381  1525 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:02.283607  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 122658us
I20260709 13:01:02.260494  1533 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:02.146296  4778 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.294893  4778 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.297703  1683 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:02.300592  4683 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.301407  4683 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.302176  2253 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:02.303629  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.304441  3955 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:02.304973  3955 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.305389  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.305994  1680 raft_consensus.cc:2376] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8. Re-sending same reply.
I20260709 13:01:02.306877  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.307086  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.307618  1682 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.307960  1683 raft_consensus.cc:2410] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:02.308445  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.308887  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.309474  1674 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:02.309994  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:02.310118  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55807.5us
I20260709 13:01:02.310552  1680 raft_consensus.cc:2376] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5. Re-sending same reply.
I20260709 13:01:02.310868  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.309329  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:02.310308  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.314538  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.316650  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.315939  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.320286  1675 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:02.321887  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.322624  1680 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.325078  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.325766  1676 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.260870  4282 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.332053  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:02.335336  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 232605us
I20260709 13:01:02.330176  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.337131  1683 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:02.338908  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.318555  4701 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.337884  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.324149  4758 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:02.323745  4761 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.326385  4666 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:02.355212  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.355144  1682 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.355769  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.333065  4654 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.361008  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.361853  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.362493  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.351538  4701 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.338600  4282 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.359629  4758 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:02.382011  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.390425  4758 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.391242  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.392536  4759 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.354482  4777 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.382261  2256 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.397964  1601 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.366456  4829 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:01:02.358820  4679 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.403177  4679 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.403549  4679 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.403910  2255 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:01:02.405470  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.011s	sys 0.009s
I20260709 13:01:02.364566  4567 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.364252  4320 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.409562  4320 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.411787  4320 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:02.363145  4836 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 13:01:02.414044  2259 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:02.386201  2253 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.414917  3955 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:02.416918  4843 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:02.417061  1677 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:02.417392  4820 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:02.418172  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.372728  2260 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:02.420297  4701 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.377137  4572 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:02.422996  4833 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 13:01:02.354494  4527 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.423027  4794 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:02.426561  4527 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.429369  4527 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.436468  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.437480  4757 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.439276  4661 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.439783  4661 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:02.441001  4661 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.442364  4282 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:02.442552  4661 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:02.383611  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54835.8us
I20260709 13:01:02.380812  4761 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:01:02.445601  4700 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:02.446050  4700 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.446427  4703 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.446971  4700 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.449102  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.449965  1608 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:01:02.451726  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.011s	sys 0.009s
W20260709 13:01:02.452139  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 932892us
I20260709 13:01:02.454566  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.455842  4654 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.460672  4572 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.462579  4572 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.462947  4572 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.448215  4703 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.467398  4426 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.467835  4426 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.468720  4426 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.470009  4426 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.470870  1606 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.471542  4759 raft_consensus.cc:2764] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:02.472653  4567 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:02.473232  4567 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.474016  4683 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.475780  4567 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.456177  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.481356  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.481546  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.482198  1605 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:02.445676  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.483127  4683 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.482970  4739 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.483724  4683 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.439211  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.484670  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.484870  4820 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.484162  4683 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:02.466670  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.486904  4757 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:02.487114  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48000.4us
I20260709 13:01:02.488515  4799 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.488969  4799 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.490157  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.490777  1603 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:01:02.491133  4799 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.491657  4799 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:02.492691  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.501327  1607 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:02.493738  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.502120  2258 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:02.495214  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.496028  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.503544  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:02.504069  1605 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:02.504969  1499 leader_election.cc:400] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:02.506781  1499 leader_election.cc:403] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.507447  4739 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:02.507882  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.509824  4739 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:02.510524  4739 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:02.511898  4757 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.484264  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.518234  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.493322  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.519703  1602 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:02.520609  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:02.520887  4820 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.521660  4820 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.506043  4721 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:02.522704  4721 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:02.523352  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.524212  4840 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:02.524796  4778 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.525586  4778 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:02.526259  4778 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.506336  4320 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.527199  4320 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.527730  4320 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.530354  4823 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.531589  1681 raft_consensus.cc:2368] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:02.505565  4799 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.532732  4799 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.497033  3955 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.533150  4799 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.533742  3955 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.534987  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:02.535521  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.537207  1530 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.537554  3955 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.539147  1680 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.540701  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.541400  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
W20260709 13:01:02.533030  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.543102  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.543990  4821 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.544417  4821 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.544800  4821 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.526446  4840 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:02.511714  4739 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.521421  4829 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:02.549575  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.550762  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.551880  4527 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:02.589339  4527 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:02.518631  4701 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.590375  4527 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.591837  4701 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.555583  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.557008  1525 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:02.523850  4721 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.563232  4778 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.564028  4572 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.526736  4855 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.569376  4823 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:02.569636  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.606511  1602 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.570595  4683 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:02.574590  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.576869  3955 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:02.578958  1534 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.579319  4799 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:02.580717  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 56402.2us
I20260709 13:01:02.581410  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.499365  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:02.513831  2253 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
W20260709 13:01:02.366331  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.588450  4654 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:02.592021  1679 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.554831  4825 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.593321  1530 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:02.600160  1600 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:02.602382  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.602313  4739 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:02.606393  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 244375us
W20260709 13:01:02.616292  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.633889  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.634545  2258 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.578905  4821 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:02.640982  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 90286.5us
I20260709 13:01:02.642300  4703 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.642925  4703 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.643824  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.644485  2253 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:02.644942  4799 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.648622  1533 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:02.634752  4739 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:02.650269  4739 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:02.652590  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 153303us
I20260709 13:01:02.653580  1574 leader_election.cc:400] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:02.653951  1574 leader_election.cc:403] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.617165  4757 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.568137  4679 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.657151  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.657915  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:02.658737  1680 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:02.659981  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.660354  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.661706  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.662127  1678 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.662626  1602 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:02.662945  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:02.664053  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:02.667160  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.566207  4320 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.668102  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.667182  1681 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:02.669850  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.671257  2255 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.671257  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.636940  4759 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.673107  1529 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:02.678695  1674 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:02.628881  4829 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:01:02.666055  4661 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.683146  1527 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.672346  4282 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:02.687717  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:02.687348  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 111537us
I20260709 13:01:02.670712  4701 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:02.720227  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78417.6us
I20260709 13:01:02.676187  4799 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:02.674348  4567 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.677342  4764 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:02.729890  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.668625  4757 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.679621  4759 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:02.732708  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.736289  2258 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:02.736616  4759 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.733363  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:02.731519  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56856us
I20260709 13:01:02.741863  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.743587  4572 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.744642  4799 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.717348  4855 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.743903  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.688632  4777 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.731527  2253 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEARNER]: Advancing to term 5
I20260709 13:01:02.687601  4823 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:01:02.734602  4700 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.733768  4282 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.777362  4872 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.778043  4872 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.778424  4872 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.785861  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.787175  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.724521  4661 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.748199  4777 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:02.794696  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.796891  1601 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:02.757723  4799 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.758193  4722 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.746258  4654 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:02.751542  4764 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.765839  4701 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:02.805459  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 79123.6us
I20260709 13:01:02.793416  4758 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.751935  4855 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.816563  4758 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.797725  4777 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.809042  2253 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:02.810343  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.811445  4764 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.813128  4282 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.814352  4320 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.814851  4683 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:02.825585  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 154391us
I20260709 13:01:02.807880  4722 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.815208  4778 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.835590  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.836557  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.837363  2256 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:02.827224  1498 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.937s (SENT) [suppressed 26 similar messages]
I20260709 13:01:02.842407  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.844024  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.850461  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.850826  2257 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:02.851003  2253 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.833931  4875 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.854079  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:02.826807  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:02.827801  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 94524.5us
W20260709 13:01:02.830274  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.830542  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:02.859530  1600 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.859990  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.839008  4679 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.825773  4867 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:02.874600  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.876029  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.877533  2257 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.877892  4567 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.815235  4872 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.866060  4320 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.886680  2253 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:01:02.870198  4426 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:02.887465  2256 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:02.901926  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.902604  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.903226  2256 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:02.904729  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:02.893106  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:02.894806  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:02.904584  4869 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:01:02.906111  4320 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.907729  2257 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:02.908238  2257 pending_rounds.cc:85] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 8
I20260709 13:01:02.908340  4426 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:02.908550  4654 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.909471  4426 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.904027  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.887017  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.902622  2254 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.911409  2256 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
I20260709 13:01:02.908591  2257 pending_rounds.cc:107] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:02.912165  2257 raft_consensus.cc:2889] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.913807  2255 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:02.914968  2253 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.881351  4855 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.895785  4829 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:02.929334  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:02.930568  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.931845  1678 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:02.932536  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:02.886660  1600 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:02.918110  1499 leader_election.cc:400] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:02.933526  1499 leader_election.cc:403] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.918532  4877 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.919770  4654 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.947667  1530 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:02.948119  4654 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:02.948686  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.949819  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:02.950367  1531 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.897743  4759 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:01:02.919627  4679 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.952598  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:02.953218  1525 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:02.953018  4679 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.955411  4679 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.920414  4701 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.956164  4701 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:02.921077  4700 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:02.925194  2254 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.964840  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.913532  4757 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:02.891211  4870 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.933080  1532 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.933997  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:02.961102  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.968618  1681 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:02.968770  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.969018  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.969395  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.969868  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.970033  1681 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.971406  1677 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.968407  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.962236  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.972379  1600 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:02.972669  1682 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.963174  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.927255  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:02.965487  1533 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:02.894366  4799 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:01:02.967132  1678 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:02.933426  4854 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.969470  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:02.913950  4320 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:02.973827  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:02.931424  4855 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.975662  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:02.987973  1676 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.927552  4868 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.982544  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.986804  1679 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:02.983413  1683 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:02.991894  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:02.992527  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58614.6us
I20260709 13:01:02.993467  1678 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:02.950467  4654 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:02.995503  2254 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:02.967336  4661 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:03.015127  1682 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:03.024405  1680 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:03.025758  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.976123  4880 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:02.996174  4679 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:03.031219  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.047215  1532 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:03.032797  1681 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:02.971442  4700 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.063894  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.064181  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.064657  1680 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:03.065546  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.068202  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:03.062901  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49050us
I20260709 13:01:03.026496  4867 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.079876  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:02.984045  4829 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:03.026695  4868 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:02.996649  4855 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.036136  4679 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.997380  4854 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.088761  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:03.109505  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.075680  4722 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:03.085083  4685 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.088822  4863 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:01:03.090130  4879 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:03.118673  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.122203  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:03.142915  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60406us
I20260709 13:01:03.088807  4869 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.087957  4867 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:03.153467  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:03.144263  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60278.5us
I20260709 13:01:03.154836  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.156512  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.090801  4679 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.055652  4880 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.164875  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.162711  2259 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:03.035437  4567 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.183817  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.184664  2259 raft_consensus.cc:2376] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8. Re-sending same reply.
I20260709 13:01:03.090206  4739 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.195725  1531 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:03.197418  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.221825  2254 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:03.221939   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:03.202797  4731 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:03.209102  4881 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:03.211956  4869 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.212659  4868 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.213567  4872 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.214912  4700 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.214702  4867 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.217310  4829 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:03.166934  4701 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.162210  4685 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.228927  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.229512  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:03.227975  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.245777  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:03.229463  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76117.8us
I20260709 13:01:03.173292  4799 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:03.164566  4761 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:03.238431  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.249927  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.221235  4871 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.228579  4731 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.247398  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.226542  4875 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8.
I20260709 13:01:03.250303  2258 raft_consensus.cc:2368] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9.
I20260709 13:01:03.250555  2254 raft_consensus.cc:2376] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8. Re-sending same reply.
W20260709 13:01:03.251231  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94790.2us
I20260709 13:01:03.265792  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.226809  4893 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:03.274426  1681 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:03.276857  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:03.253820  4871 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.316497  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.316675  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:03.316255  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56707.2us
I20260709 13:01:03.330694  1531 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:01:03.256026  4731 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.330260  1532 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 5: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.332000  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.333877  2259 raft_consensus.cc:2376] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5. Re-sending same reply.
I20260709 13:01:03.335726  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.341554  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:03.380784  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 498550us
I20260709 13:01:03.256470  4872 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:01:03.395927  1681 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:03.267071  4869 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:01:03.334270  4871 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.267135  4799 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.414310  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:03.405635  4320 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:03.438584  4894 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:01:03.423676  4870 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.454836  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:03.456650  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 120961us
W20260709 13:01:03.438764  4889 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:01:03.431712  4855 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:03.398489  4722 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:01:03.464166  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.462364  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 131519us
I20260709 13:01:03.407409  4683 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:01:03.473642  4799 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.474251  4799 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.474884  4799 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.476745  4910 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:03.478176  4910 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:03.478565  4910 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:03.478730  4904 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.479195  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.480188  2252 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:03.470570  4880 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.482470  4703 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:03.483518  4890 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:01:03.484804  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.486213  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.487753  4701 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:03.488245  4701 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.488741  4701 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.487848  4855 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.463701  4661 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:03.495960  4885 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:01:03.498183  4701 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.502374  4701 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.508875  4910 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.510790  4910 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.504509  4739 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:03.520881  4777 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.003s
I20260709 13:01:03.521373  4777 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.523694  4777 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.504822  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:03.525841  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51752us
W20260709 13:01:03.514526  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49188.8us
I20260709 13:01:03.526582  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.527683  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.468165  4887 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.535470  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.536912  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:03.533106  4701 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:03.540915  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.538931  4701 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.538843  4870 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:03.533712  4887 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:03.551996  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 210597us
I20260709 13:01:03.552700  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.553716  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.554848  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.546348  4869 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:03.563516  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.557240  4572 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:03.556623  4870 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.541072  4898 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:03.559043  4912 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.547386  4739 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:03.551158  4701 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.573053  3955 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.586398  1498 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:03.579627  4825 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:03.573159  4572 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:03.578207  4887 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.592088  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:03.592551  4887 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.592199  4572 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.593214  4909 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:03.595826  3955 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.557467  4703 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:03.583254  4679 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.597568  4703 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:03.598004  4703 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:03.598855  4679 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.599000  4703 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.600559  4685 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.601872  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 520) took 1030 ms. Trace:
I20260709 13:01:03.574231  4799 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.603598  1600 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:03.574589  4870 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.561200  4731 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.572259  4871 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.596887  4825 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:03.615686  4825 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.573638  4893 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.596403  4739 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:03.618593  4893 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.621860  4893 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.623211  4854 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.602243  1527 rpcz_store.cc:276] 0709 13:01:02.571756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.571880 (+   124us) service_pool.cc:224] Handling call
0709 13:01:02.572219 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.684501 (+112282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.601633 (+917132us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002670d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:03.601813 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254678784}
I20260709 13:01:03.630203  1600 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:03.646721  1604 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:03.647867  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.649638  1498 leader_election.cc:400] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9.
I20260709 13:01:03.614634  4731 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:03.661592  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:03.662266  1602 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:03.663223  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 208837us
I20260709 13:01:03.664381  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.665743  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.660326  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.666270  4722 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:03.666905  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:03.667637  4840 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.665814  4914 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:03.670399  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.614732  4871 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:03.636531  4703 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.675028  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.676815  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.679505  1533 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:03.656455  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.682857  1600 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:03.684612  1602 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:03.686748  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:03.687485  1608 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.690214  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.690266  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.693019  1525 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:03.694077  1530 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.694512  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.697737  4913 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:01:03.698184  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.699142  4913 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.673429  4887 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.699625  4913 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:03.702536  4873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.002s	sys 0.021s
W20260709 13:01:03.703049  4873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.002s	sys 0.022s
I20260709 13:01:03.704926  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.705237  4913 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.706964  4870 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.707651  4913 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.692469  4799 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:03.711776  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.716233  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.781747  2253 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:01:03.717233  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.782912  2260 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:03.718402  2252 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:03.719022  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.720669  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.619570  4739 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:03.680473  4869 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.699481  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.736545  4887 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:03.737133  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 699163us
I20260709 13:01:03.786705  1608 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:01:03.747193  4862 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.101s	user 0.002s	sys 0.003s
I20260709 13:01:03.748167  4764 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.727047  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.807798  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:03.751047  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.755048  1527 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:01:03.696686  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:03.765365  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 192217us
I20260709 13:01:03.766515  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.809489  2256 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.766739  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.777395  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:03.778038  2259 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:03.784780  2258 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:03.788758  2261 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:01:03.697079  4825 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:03.795883  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:03.796617  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:03.797137  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.825534  1675 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.820034  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.820097  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:03.826642  2261 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.820974  1528 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.797243  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.835995  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.836709  1600 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:03.838757  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.839540  1676 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:03.840286  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:03.840512  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.841053  1602 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:03.841384  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.842374  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:03.843073  1681 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.853854  2254 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:03.855803  1533 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:03.851037  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.857064  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:03.863286  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.864249  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:03.883582  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.885183  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:03.806363  4914 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.890758  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:03.821983  4825 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:03.890604  4914 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.891407  4825 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.886734  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:03.888567  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:03.893362  1602 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:03.911695  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.914100  1601 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:03.889451  2261 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:03.889614  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:03.926510  1600 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:03.890703  1604 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:03.855753  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:03.927927  4855 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:03.928581  4855 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:03.929607  4855 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:03.931519  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75849.4us
I20260709 13:01:03.937547  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:03.784377  4701 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:03.941783  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.949900  1533 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:03.861217  4799 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:03.951920  1682 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:01:03.948273  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 281408us
I20260709 13:01:03.953711  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.932192  4758 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:03.944828  1602 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:03.823392  4764 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:03.954260  4862 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:03.972592  1529 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.995936  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:03.986708  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:03.960714  4722 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.011025  1682 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:03.961658  4799 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:04.023608  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 214840us
I20260709 13:01:03.968779  4778 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:04.124663  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.034376  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:03.971782  4758 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.008723  4840 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:04.027640  4872 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.136780  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.137490  1602 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:01:04.082093  4869 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.055651  4891 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:04.056411  4918 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:01:04.056708  4897 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:01:04.065086  4917 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:04.071887  4870 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.087885  2256 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
W20260709 13:01:04.090658  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.087970  1674 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:01:04.093499  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 136849us
I20260709 13:01:04.124168  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:04.156777  1682 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:04.089836  4919 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:01:04.128679  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.132658  4567 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.158718  1604 raft_consensus.cc:2410] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:04.129868  1600 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:04.131552  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 244874us
W20260709 13:01:04.133055  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 98761.3us
I20260709 13:01:04.159606  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.054663  4825 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.141260  4572 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:04.146379  1601 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:04.138535  4885 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:01:04.138375  4881 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:04.161171  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:04.131523  4701 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.175246  1682 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:04.123157  4661 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.172930  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:04.156661  4924 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:04.181792  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:04.183431  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.184247  1533 raft_consensus.cc:2368] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6.
I20260709 13:01:04.184381  1682 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:01:04.181357  4764 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.156988  4903 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:04.192695  1682 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:04.168541  4722 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.199178  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.187522  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.195825  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.197203  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.148101  4869 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.206239  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:04.177547  4870 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:04.209669  2254 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:04.175182  4887 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.186420  4925 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.265003  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:04.266299  2255 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:04.269661  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:04.270277  1604 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.275733  1533 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:04.169167  4567 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.191054  4572 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:04.186120  4661 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.181342  4895 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:01:04.289047  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 107312us
I20260709 13:01:04.291404  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.234274  4870 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:04.265251  4701 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.265019  4872 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.271988  4925 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:04.232731  4778 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:04.281376  4821 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.209789  4903 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.227728  4932 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.259536  4722 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.198758  4840 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.208963  4799 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.311699  4925 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:04.339020  4929 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:01:04.360242  4825 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.338687  4932 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.362010  4932 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.363816  4925 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.320905  4934 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.365163  4934 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.365563  4934 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:04.365978  4938 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:04.366935  4661 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.367152  4935 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.364691  4927 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:01:04.367676  4935 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.369771  4935 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.371351  4945 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.371845  4945 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.372162  4945 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.372768  4572 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:04.376407  4923 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:01:04.376075  4934 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.377873  1525 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:04.379120  4931 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:01:04.382577  4903 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:04.383345  4893 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.002s
I20260709 13:01:04.383180  4903 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:04.384418  4870 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.384729  4925 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.377475  4940 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.386725  4940 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.387146  4940 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:04.387852  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 224878us
I20260709 13:01:04.394994  4722 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.395779  4722 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:04.381963  4934 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.385679  4870 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:04.312098  4703 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
I20260709 13:01:04.400199  1608 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
W20260709 13:01:04.411244  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 110085us
I20260709 13:01:04.405268  1604 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:04.405077  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:04.425444  1530 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.426419  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:04.426550  1574 leader_election.cc:400] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6.
I20260709 13:01:04.427469  1574 leader_election.cc:403] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.429540  4948 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.430276  4948 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.383766  4893 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.305930  4872 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.377427  4869 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.309067  4701 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:04.435142  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 210655us
W20260709 13:01:04.404896  4913 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.623s	user 0.000s	sys 0.010s
I20260709 13:01:04.461645  1534 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:04.436967  4903 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.475059  4960 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.456916  4282 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.446175  4895 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 5. Current term is 6.
I20260709 13:01:04.517565  1604 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:04.518059  1604 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:04.518684  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:04.519245  1603 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:04.472532  4903 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.518854  1604 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:04.527559  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.473853  4679 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.530525  1604 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.506021  4897 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.514497  4764 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.475694  4960 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.521795  4799 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.535499  4903 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.582101  1604 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:01:04.582582  1604 pending_rounds.cc:85] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
I20260709 13:01:04.543085  4778 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.582839  1604 pending_rounds.cc:107] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:01:04.591193  1604 raft_consensus.cc:2889] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.520476  4282 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:04.589357  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51374us
I20260709 13:01:04.583593  4869 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.546353  4679 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.608232  4778 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.626415  4955 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.624929  4948 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.627009  4955 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.628657  4778 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.606056  4950 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.628906  4944 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:01:04.629298  4950 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:04.631547  4954 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:04.631754  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:04.632774  4964 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:01:04.634246  1682 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.634620  4945 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.635736  1682 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:04.632859  1526 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:04.637264  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.637925  1526 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:04.638952  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:04.611686  4567 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.619128  4963 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.625725  4869 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.640779  4567 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.644439  4567 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.646401  4893 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:04.640990  4968 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:04.641247  1682 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.640270  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.575014  4764 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:04.641584  4952 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:01:04.644218  4869 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.575233  4897 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:04.583798  4799 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.660359  4872 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.728823  4945 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.729367  4955 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.731884  4940 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.734841  1674 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:04.736267  4940 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.730899  4897 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:04.740478  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55026.2us
I20260709 13:01:04.750466  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.753019  4757 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:04.753165  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:04.753578  4757 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:04.753940  2255 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:04.754563  4757 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.757112  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1905) took 1083 ms. Trace:
I20260709 13:01:04.757587  1529 rpcz_store.cc:276] 0709 13:01:03.674022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.674973 (+   951us) service_pool.cc:224] Handling call
0709 13:01:03.691279 (+ 16306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.973035 (+281756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.756795 (+783760us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400304dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:04.757037 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646426880}
I20260709 13:01:04.759037  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:04.753952  4932 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.762872  4955 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.763051  4932 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.763423  4955 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.741046  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:04.766273  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.766469  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.766911  1675 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:04.747220  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:04.767086  1683 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:04.747861  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:04.748508  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:04.767969  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.768335  2253 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.768654  1683 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:04.733085  4960 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.738864  4903 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.771525  4903 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.773715  1680 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:04.768282  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:04.778236  1529 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:04.772197  1602 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:04.766675  2258 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 6: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:04.781657  4893 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.782199  4893 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.784361  4914 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.767846  2254 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:04.786223  4947 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.786348  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.786689  4947 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:04.786882  4955 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.787406  1529 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:04.779412  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:04.667672  4701 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.767840  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:04.790206  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.790757  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:04.791029  4799 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.790159  1675 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:04.641512  4963 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.792522  4868 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:04.793114  4868 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:04.793846  4963 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:04.794024  4868 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.795195  4956 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:04.796025  4683 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:04.798810  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.799539  4920 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.725s	user 0.003s	sys 0.000s
I20260709 13:01:04.802031  4897 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.699791  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.803630  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.714015  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:04.791345  4893 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:04.804055  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.787679  4947 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.805153  1529 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:04.805557  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.806154  1530 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:04.808533  4764 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:04.811180  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.811803  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:04.812790  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:04.813201  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.813817  1607 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:04.812662  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:04.817589  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:04.819077  1525 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.819952  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:04.823241  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.803942  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:04.828044  1675 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:04.867681  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.868511  1680 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:04.869403  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:04.870078  1680 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:04.870748  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.871174  1680 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:04.871342  1675 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
W20260709 13:01:04.873437  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60743.3us
I20260709 13:01:04.874254  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:04.874818  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70953.1us
I20260709 13:01:04.874925  1526 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.867738  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.877969  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:04.880245  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.875751  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.875391  4572 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.884829  4764 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.885270  4764 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:04.885650  4764 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.805505  4947 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.816356  4872 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.889909  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:04.818742  4855 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.888142  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.903892  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.892699  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.890146  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:04.894331  1683 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:04.909461  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.912432  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:04.908797  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.914956  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:04.915649  1681 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.915382  1680 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:04.918203  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.922012  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:04.923890  4932 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.926250  4932 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:04.929082  1675 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:04.929687  4955 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.879864  4870 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:01:04.931624  1574 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.538s (SENT)
I20260709 13:01:04.907321  4778 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.934495  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.906302  4701 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.912335  4761 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.902752  4872 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.943749  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.930290  4932 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:04.944943  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.945745  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.946522  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.909565  4855 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:04.913511  4893 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:04.941915  4910 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.937177  4701 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:04.941674  4903 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.948877  4960 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.950736  4945 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.961988  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:04.971241  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.983716  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:04.987831  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:04.990535  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.991300  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.992163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.976889  1526 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:04.997716  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:04.954377  4799 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.999832  3955 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.002513  1607 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:04.957664  4910 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.004422  3955 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:04.960325  4840 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.947739  4875 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:04.966518  4701 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.009184  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.014955  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.972682  4915 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.010128  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.017020  4948 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:04.999557  4974 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.016239  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:04.966917  4969 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.034780  4969 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.035197  4969 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.042629  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.043615  4945 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.044095  4945 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.044571  4945 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.044847  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:04.966777  4975 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.046000  4975 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.046368  4975 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.017609  3955 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.029107  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:05.029904  4978 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:05.029659  4962 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:05.031376  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.031383  4974 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.032682  1601 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:05.087131  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.088625  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.034128  4282 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:05.089615  4282 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.008347  4910 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.058394  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.010058  4951 raft_consensus.cc:2764] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:01:05.085696  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:05.089778  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 181065us
I20260709 13:01:05.107923  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.024459  4903 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.113425  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.110031  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.118543  1681 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:05.026064  4932 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:01:05.112504  4868 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.139061  1526 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:05.113103  4282 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.141077  4282 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.118606  4962 consensus_queue.cc:1243] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:05.116732  4895 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:05.146270  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1923) took 1379 ms. Trace:
I20260709 13:01:05.146713  1531 rpcz_store.cc:276] 0709 13:01:03.767281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.823280 (+ 55999us) service_pool.cc:224] Handling call
0709 13:01:03.858851 (+ 35571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.859151 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.859178 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.811619 (+952441us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b2c00031358. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:04.811991 (+   372us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.057595 (+245604us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.057635 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.057709 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.145968 (+ 88259us) raft_consensus.cc:1685] finished
0709 13:01:05.145988 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.146207 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":23154,"spinlock_wait_cycles":7582464,"thread_start_us":245220,"threads_started":1,"wal-append.queue_time_us":304654}
I20260709 13:01:05.147382  4764 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.148679  4990 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:05.149108  4990 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:05.149369  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.149991  4990 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.150655  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.151403  4990 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.151322  1606 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:05.155779  1531 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:05.158712  4527 raft_consensus.cc:1064] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:01:05.159082  4989 raft_consensus.cc:1064] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:01:05.161666  4840 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.162242  4840 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.162705  4969 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.163240  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1771) took 1337 ms. Trace:
I20260709 13:01:05.086030  4915 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:01:05.168812  4950 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.163190  4895 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:05.117882  4903 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:05.163690  1674 rpcz_store.cc:276] 0709 13:01:03.825564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.735801 (+910237us) service_pool.cc:224] Handling call
0709 13:01:04.736178 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.736591 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.736617 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.738751 (+  2134us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.979623 (+240872us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:05.089545 (+109922us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.090053 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.090260 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.163027 (+ 72767us) raft_consensus.cc:1685] finished
0709 13:01:05.163043 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.163183 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131416,"raft.queue_time_us":29464,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":216,"spinlock_wait_cycles":44608640,"thread_start_us":321586,"threads_started":2,"wal-append.queue_time_us":372710}
I20260709 13:01:05.178370  4903 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.108906  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.157384  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:05.154923  4868 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.089838  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:05.164244  4840 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.189309  4868 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:05.192261  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 100148us
I20260709 13:01:05.168942  4945 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.173455  4895 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.195806  4983 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:05.193840  4986 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.199774  4872 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:05.219355  4764 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.229121  2261 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:05.229417  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:05.230031  1529 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.231657  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.232664  1607 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:05.234102  1607 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:05.239171  1529 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:05.243196  1683 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:05.246716  4970 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.599s	user 0.002s	sys 0.000s
I20260709 13:01:05.250069  2259 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:05.250633  2259 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:05.266129  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1906) took 1591 ms. Trace:
I20260709 13:01:05.266621  1534 rpcz_store.cc:276] 0709 13:01:03.674320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.676382 (+  2062us) service_pool.cc:224] Handling call
0709 13:01:03.689960 (+ 13578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.471394 (+781434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.265873 (+794479us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54002cc754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:05.266059 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768854400}
I20260709 13:01:05.269479  1531 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:05.269906  1531 pending_rounds.cc:85] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 7
I20260709 13:01:05.270139  1531 pending_rounds.cc:107] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:05.270361  1531 raft_consensus.cc:2889] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.236224  1607 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:05.251658  2259 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.292038  1601 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:05.294188  4993 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:05.297842  4945 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.298756  4527 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.216192  4983 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.303328  4983 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.305361  4969 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.307897  4701 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:01:05.309659  4961 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.662s	user 0.000s	sys 0.005s
I20260709 13:01:05.316819  1683 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:05.320140  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:05.320928  1674 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.325843  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.326284  2259 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.326609  1681 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:05.344172  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:05.310621  4701 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:05.197402  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.204546  4855 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:05.088649  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43873us
I20260709 13:01:05.210889  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.190814  4758 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:05.194538  4974 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.346962  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 593) took 1140 ms. Trace:
I20260709 13:01:05.197230  4975 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:05.347946  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 150638us
I20260709 13:01:05.311206  4953 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.196406  3955 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:05.386396  1530 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
W20260709 13:01:05.389535  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.396106  3955 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.384835  2256 rpcz_store.cc:276] 0709 13:01:04.206113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.206232 (+   119us) service_pool.cc:224] Handling call
0709 13:01:04.206529 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.273382 (+ 66853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.273412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.292371 (+ 18959us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.473490 (+181119us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:04.520838 (+ 47348us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.521140 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.521219 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.309039 (+787820us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:05.345366 (+ 36327us) raft_consensus.cc:1685] finished
0709 13:01:05.346729 (+  1363us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.346899 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9529,"prepare.queue_time_us":44505,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":6615,"raft.queue_time_us":118544,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":36162,"spinlock_wait_cycles":7555840,"thread_start_us":151849,"threads_started":1,"wal-append.queue_time_us":345904}
I20260709 13:01:05.391687  4870 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.347182  4910 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.387285  4934 raft_consensus.cc:2764] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:05.381919  4840 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.345707  4926 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.334342  4764 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.423220  4764 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.424449  4868 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.425619  4764 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:05.426200  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.426754  4868 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.334221  4969 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.427428  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.427551  4969 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.388230  4990 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:01:05.413312  4701 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.450412  4990 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:05.395380  4661 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.415786  4870 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.451473  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1756) took 2486 ms. Trace:
I20260709 13:01:05.451258  4661 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.445657  4935 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.451758  2252 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:05.399297  4953 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.454176  4956 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:05.454643  4953 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.387107  4758 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.440687  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:05.459860  2259 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:05.461679  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:05.462535  1604 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:05.437345  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1919) took 1749 ms (client timeout 1783 ms). Trace:
W20260709 13:01:05.464354  1528 rpcz_store.cc:269] 0709 13:01:03.687975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.694251 (+  6276us) service_pool.cc:224] Handling call
0709 13:01:05.437076 (+1742825us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003a6bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:05.437240 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288117120}
I20260709 13:01:05.468269  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:05.469416  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79189us
I20260709 13:01:05.469480  2256 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.472469  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.400259  1674 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
W20260709 13:01:05.402223  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.474535  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:05.398650  3955 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.405213  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.405684  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:05.410581  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.413122  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.474009  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.381126  4966 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.382890  4978 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:05.421106  4840 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.422147  4926 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.452973  4870 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.473250  1607 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:05.476044  1681 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:05.476501  1680 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.493122  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.509302  3955 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.483536  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:05.451885  1677 rpcz_store.cc:276] 0709 13:01:02.965018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.986416 (+ 21398us) service_pool.cc:224] Handling call
0709 13:01:03.008902 (+ 22486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.117667 (+108765us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:03.243765 (+126098us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.581008 (+337243us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.581784 (+   776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.581830 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:03.581871 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.451214 (+1869343us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:05.451260 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.451384 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28766,"prepare.queue_time_us":54216,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":29487,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":249617664,"thread_start_us":390974,"threads_started":2,"wal-append.queue_time_us":445009,"wal-append.run_cpu_time_us":1559,"wal-append.run_wall_time_us":1029655}
I20260709 13:01:05.510524  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:05.436043  4947 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.000s
I20260709 13:01:05.430562  4975 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.449611  4934 raft_consensus.cc:1064] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:01:05.482124  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:05.476217  1675 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:05.519101  1681 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.325974  4912 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:01:05.521073  2253 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:05.521499  2253 pending_rounds.cc:85] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 6
I20260709 13:01:05.521716  2253 pending_rounds.cc:107] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:05.521929  2253 raft_consensus.cc:2889] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.510617  1649 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:05.511296  2254 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:05.442097  4910 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.414219  4945 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:01:05.442482  4679 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.491683  4948 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.514389  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:05.479841  4966 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.517460  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:05.526525  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44495.8us
I20260709 13:01:05.450564  4701 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.474895  4758 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.468679  4990 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:05.475066  4935 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.489910  2256 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:05.538326  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.539099  1674 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.534149  2259 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:05.541671  1680 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:05.586058  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.587567  4910 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.590122  4978 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.592998  4990 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.594430  4990 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:05.596714  4972 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:01:05.596937  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.587641  1675 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:05.601208  4926 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.608469  4998 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:05.609107  4998 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.609452  4998 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.607954  4661 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.612430  4757 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.614637  4983 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.619427  4701 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:05.621466  4935 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.584658  4947 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.622423  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:05.622658  4947 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:05.624881  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86889.6us
I20260709 13:01:05.488762  4953 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:05.625739  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1764) took 2635 ms. Trace:
I20260709 13:01:05.625931  4731 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.626571  4731 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:05.627169  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 88966.7us
I20260709 13:01:05.628229  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:05.625761  4910 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:05.627661  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1931) took 1432 ms (client timeout 1688 ms). Trace:
I20260709 13:01:05.627534  4731 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.628513  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1807) took 1337 ms. Trace:
W20260709 13:01:05.629509  1533 rpcz_store.cc:269] 0709 13:01:04.195400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.195541 (+   141us) service_pool.cc:224] Handling call
0709 13:01:05.627448 (+1431907us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54000d43d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:05.627604 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171060096}
I20260709 13:01:05.629693  4910 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:05.636611  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.631084  1608 rpcz_store.cc:276] 0709 13:01:04.290890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.291051 (+   161us) service_pool.cc:224] Handling call
0709 13:01:05.628353 (+1337302us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:05.628458 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248366976}
I20260709 13:01:05.638893  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.640336  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:05.630432  1678 rpcz_store.cc:276] 0709 13:01:02.990379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.994159 (+  3780us) service_pool.cc:224] Handling call
0709 13:01:02.994418 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.223644 (+229226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.223704 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.227360 (+  3656us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.437345 (+209985us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.459160 (+ 21815us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.459398 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.624658 (+2165260us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b18003a94e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419
0709 13:01:05.625442 (+   784us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001d9054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:05.625489 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.625534 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:05.625545 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.625678 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9996,"prepare.queue_time_us":24556,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":73710,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":4217,"spinlock_wait_cycles":308098816,"thread_start_us":251763,"threads_started":2,"wal-append.queue_time_us":229327,"wal-append.run_cpu_time_us":2139,"wal-append.run_wall_time_us":1004480}
I20260709 13:01:05.641093  1608 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:05.642307  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59568.8us
I20260709 13:01:05.645898  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:05.504868  4875 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:05.655088  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:05.642992  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:05.652421  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:05.653312  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:05.653911  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:05.631367  4996 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
I20260709 13:01:05.723969  2256 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:05.661307  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.724854  2254 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:05.726341  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:05.484479  4956 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.162s
I20260709 13:01:05.560019  4966 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.746134  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:05.749781  2259 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.659229  2260 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:05.745595  1674 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:05.748795  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92223.9us
I20260709 13:01:05.749409  2257 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:05.753191  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:05.753782  2256 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:05.733457  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.540025  4895 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.656997  4904 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:05.657334  4950 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.537523  4948 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.626788  4821 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:01:05.724479  4926 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:05.763155  2255 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:05.651861  4945 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.776582  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:05.784657  4799 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:05.725499  4661 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.792662  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 157660us
I20260709 13:01:05.657496  4962 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:05.651238  4758 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:01:05.821827  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:05.809592  4910 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.825732  4910 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:05.826145  4840 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:05.800894  4952 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:01:05.827262  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.774328  4904 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.873328  1608 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:05.826745  4840 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.641238  4975 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:01:05.886901  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.801864  4948 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.761617  4572 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:01:05.763743  4895 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.880388  2259 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:05.807524  4918 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.887368  1528 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:05.897603  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:05.935672  1608 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.886190  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:05.807957  4945 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.871708  4950 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:05.937986  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 454506us
I20260709 13:01:05.826151  4910 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.825181  4661 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.892133  4904 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:05.899216  4996 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:05.896721  4947 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.932230  4895 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.827255  4799 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:05.903469  4983 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:05.823621  4926 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.003553  4945 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.037006  1608 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:05.900396  4840 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.048404  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:06.046375  1608 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:06.055737  1608 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:06.056941  5001 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:01:06.066179  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 1937) took 1189 ms. Trace:
I20260709 13:01:06.066684  1526 rpcz_store.cc:276] 0709 13:01:04.876980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.109763 (+232783us) service_pool.cc:224] Handling call
0709 13:01:06.065928 (+956165us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b54001abb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:06.066103 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3814656}
I20260709 13:01:06.076596  1532 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:06.077486  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1918) took 1893 ms. Trace:
I20260709 13:01:06.077862  1532 rpcz_store.cc:276] 0709 13:01:04.183702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.183802 (+   100us) service_pool.cc:224] Handling call
0709 13:01:04.184094 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.076285 (+1892191us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b54001589a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:01:06.077184 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.077419 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7938432}
I20260709 13:01:06.033126  4947 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.891175  4962 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.095556  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47256.8us
I20260709 13:01:06.104856  2258 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:06.027232  4953 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:01:06.096163  5000 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 13:01:06.106127  5007 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:06.100929  4320 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:06.005364  4918 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.133858  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:06.134523  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:06.136866  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:06.140834  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:06.136413  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:06.167986  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:06.170047  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.105660  4947 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.135576  4936 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.184839  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1769) took 2359 ms. Trace:
I20260709 13:01:06.185302  1682 rpcz_store.cc:276] 0709 13:01:03.825066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.653394 (+828328us) service_pool.cc:224] Handling call
0709 13:01:04.653728 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.661414 (+  7686us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:04.941431 (+280017us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.180293 (+238862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.190222 (+  9929us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.190370 (+   148us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:05.193987 (+  3617us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.194224 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.194313 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.630721 (+436408us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:06.184577 (+553856us) raft_consensus.cc:1685] finished
0709 13:01:06.184611 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.184774 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":362282,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":9328,"raft.queue_time_us":75550,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":13897,"spinlock_wait_cycles":22697344,"thread_start_us":507469,"threads_started":2,"wal-append.queue_time_us":231575}
I20260709 13:01:06.137020  4891 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:06.128655  4685 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:01:06.171412  4320 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:06.256405  4903 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.077s	user 0.008s	sys 0.004s
I20260709 13:01:06.257172  4903 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.259893  4903 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.260565  1606 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.268169  4913 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.296973  4913 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.300026  1533 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:06.299695  4913 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:06.270804  4757 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.658s	user 0.004s	sys 0.004s
I20260709 13:01:06.302052  1603 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:06.302539  4950 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.271790  4799 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.273346  4947 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.303164  4950 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.305737  4998 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 13:01:06.306236  4998 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.275004  4926 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.306535  4945 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.275414  4930 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 2.145s	user 0.005s	sys 0.010s
I20260709 13:01:06.276947  4918 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.277858  4840 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:06.278566  4661 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:06.328297  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.336038  1605 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:06.303910  4567 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:06.279709  4962 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:06.279461  4966 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.003s
I20260709 13:01:06.283488  4904 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.208014  4936 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.294628  4910 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.273558  4320 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:06.311123  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.012s
W20260709 13:01:06.307556  4990 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.000s
I20260709 13:01:06.278228  4895 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.314690  4986 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:06.335840  4731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.023s
I20260709 13:01:06.301501  4948 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:06.346764  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.012s
W20260709 13:01:06.349718  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 597302us
I20260709 13:01:06.350971  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:06.347141  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.017s
I20260709 13:01:06.352938  1607 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:06.356454  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.011s	sys 0.017s
W20260709 13:01:06.358023  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 704128us
I20260709 13:01:06.362505  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:06.391763  1530 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:06.350350  4731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.023s
I20260709 13:01:06.396267  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:06.392516  2227 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:06.398324  4895 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.398715  4998 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:06.345134  4966 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.349444  4986 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.398144  4799 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:06.400885  4799 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:06.401221  4966 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.400473  4840 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.396037  4661 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.395804  4962 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.403266  4962 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.403616  4962 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.399483  4904 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.402009  4986 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.404898  4799 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.408478  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.399567  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.404101  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:06.350622  4960 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.412883  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:06.414296  2253 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.414922  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:06.414937  2259 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:06.352492  4990 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.415789  2260 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.419248  2261 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:06.439867  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:06.441490  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.442414  1682 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:06.443742  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:06.444346  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.444368  1532 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.445297  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.446503  2261 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.446641  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.448040  2255 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:06.448025  1674 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.398142  4910 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:06.447302  1647 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.006s	sys 0.014s
W20260709 13:01:06.450493  1647 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.006s	sys 0.014s
W20260709 13:01:06.450562  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.452171  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 869104us
I20260709 13:01:06.453887  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.458505  4567 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:06.459251  4567 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.465822  1675 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:06.451161  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 346985us
I20260709 13:01:06.450736  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.468935  2255 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.469745  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.470878  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.471081  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.471948  2260 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:06.468664  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:06.473562  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.473839  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.474341  1678 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:06.475274  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.426069  4895 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.415572  4661 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.501356  4945 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.415629  4960 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:06.481837  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.482117  2261 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:06.483927  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:06.481271  4897 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.489923  4936 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.488987  1534 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:06.468439  4722 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.424002  4840 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:01:06.488998  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:06.412545  4758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.025s	sys 0.013s
I20260709 13:01:06.445259  4990 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.503410  2260 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:06.504103  1674 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:06.543524  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1825) took 1452 ms. Trace:
I20260709 13:01:06.512122  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.559366  1678 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.509814  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.531955  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.560916  1677 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:06.519117  2255 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:06.562853  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:06.511368  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1839) took 1047 ms. Trace:
I20260709 13:01:06.563723  2257 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:06.511893  1532 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:06.563999  1604 rpcz_store.cc:276] 0709 13:01:05.463465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.476871 (+ 13406us) service_pool.cc:224] Handling call
0709 13:01:05.477141 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.477332 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:06.011653 (+534321us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.510954 (+499301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.511019 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.511065 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.511154 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.511296 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33941,"prepare.queue_time_us":175300,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":30240,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":973603,"threads_started":2}
I20260709 13:01:06.566267  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:06.566838  1604 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.559091  1609 rpcz_store.cc:276] 0709 13:01:05.091061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.239369 (+148308us) service_pool.cc:224] Handling call
0709 13:01:05.239719 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.239970 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.239993 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.073702 (+833709us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b2c00001158. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:06.074249 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.353976 (+279727us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.354011 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.354077 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.543202 (+189125us) raft_consensus.cc:1685] finished
0709 13:01:06.543223 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.543436 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79839488,"thread_start_us":279285,"threads_started":1,"wal-append.queue_time_us":453668}
I20260709 13:01:06.572525  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:06.573163  1609 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:06.449793  4757 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.576946  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.577850  1674 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:06.449731  4903 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:06.497009  4978 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:06.581832  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.036s
I20260709 13:01:06.582640  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:06.584452  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.020s	sys 0.036s
I20260709 13:01:06.587453  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:06.589136  1677 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.518632  4945 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.531934  4975 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:06.591559  4934 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.571420  5015 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.592551  4897 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:06.576812  4722 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.593130  5013 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:06.593925  4948 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.619022  1604 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:06.600076  1678 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:06.530493  5022 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.614516  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.624338  1677 raft_consensus.cc:2368] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:06.529155  4904 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:01:06.602545  4935 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:06.626709  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.586691  4903 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.615669  4897 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.632046  1674 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:01:06.643167  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2095) took 1656 ms (client timeout 1605 ms). Trace:
I20260709 13:01:06.633210  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:06.609043  5015 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.637810  4962 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.620108  5013 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.709098  1603 rpcz_store.cc:269] 0709 13:01:04.986622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.997413 (+ 10791us) service_pool.cc:224] Handling call
0709 13:01:06.642993 (+1645580us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001bcbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:06.643101 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2988268928}
I20260709 13:01:06.585863  4757 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.643472  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:06.665683  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 270406us
I20260709 13:01:06.717882  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:06.705641  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 72509.2us
I20260709 13:01:06.640156  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1824) took 1554 ms. Trace:
I20260709 13:01:06.720873  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.725039  2257 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:06.719424  1600 rpcz_store.cc:276] 0709 13:01:05.085612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.236976 (+151364us) service_pool.cc:224] Handling call
0709 13:01:05.237281 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.237679 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:05.237707 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.297441 (+1059734us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b2c00001158. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:06.297877 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.597426 (+299549us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:06.597459 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.598278 (+   819us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.639823 (+ 41545us) raft_consensus.cc:1685] finished
0709 13:01:06.639844 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.640091 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":85461760,"thread_start_us":299229,"threads_started":1,"wal-append.queue_time_us":336275}
I20260709 13:01:06.642302  4903 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:06.734184  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.748824  1600 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:01:06.749356  1600 pending_rounds.cc:85] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
I20260709 13:01:06.749640  1600 pending_rounds.cc:107] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:06.749903  1600 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.751029  4320 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:06.712993  4978 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:06.642264  4897 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:06.713176  5004 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:06.765489  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.730737  4895 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:06.752064  4703 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.757131  5017 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:06.756155  4990 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:06.771737  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 296527us
I20260709 13:01:06.781138  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.754261  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:06.783409  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.789346  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.727746  4945 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:06.764731  4320 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.818238  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.771651  4978 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:06.753769  4963 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:06.763809  5012 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:06.771243  4897 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:01:06.837314  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:06.818315  4679 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.816361  4990 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:06.838033  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84665.4us
I20260709 13:01:06.776401  4701 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:06.818827  4778 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:06.847911  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:06.848752  1600 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:06.849925  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:06.770191  5004 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.844849  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:06.774991  5036 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:01:06.852415  1600 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:06.857138  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:06.784622  4703 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.858525  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:06.819103  4904 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:01:06.856665  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1834) took 1508 ms. Trace:
I20260709 13:01:06.868367  1600 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:06.790017  5017 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.869064  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 86361us
I20260709 13:01:06.845127  4758 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.863472  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:06.872943  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.872547  1609 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:06.873126  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:06.872880  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:06.874200  2257 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:06.842737  4722 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:06.860829  1601 rpcz_store.cc:276] 0709 13:01:05.347918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.387601 (+ 39683us) service_pool.cc:224] Handling call
0709 13:01:05.387944 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.468012 (+ 80068us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:05.650464 (+182452us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.034173 (+383709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.034225 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.034266 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.851931 (+817665us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400337054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:06.851984 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.856602 (+  4618us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57851,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":21675,"raft.queue_time_us":87089,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":18249,"spinlock_wait_cycles":183510272,"thread_start_us":542338,"threads_started":2,"wal-append.queue_time_us":525392}
I20260709 13:01:06.876593  2255 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:06.872262  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:06.852224  4936 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.878044  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:06.855800  4990 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.884884  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:06.885845  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.830076  4895 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.908043  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.908483  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:06.914467  2255 raft_consensus.cc:2376] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6. Re-sending same reply.
I20260709 13:01:06.914980  2257 raft_consensus.cc:2376] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9. Re-sending same reply.
I20260709 13:01:06.876294  4758 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:06.884572  4840 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.917197  1679 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:06.916545  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.908010  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:06.921458  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.870433  4679 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:06.924345  1676 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:06.888149  4661 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.858521  4778 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.919967  5018 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.941195  5018 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.942466  5017 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.943277  5013 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.943876  5018 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:06.927224  4840 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:06.920805  4897 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.944631  4840 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.911342  4978 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:06.949433  4897 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:06.907407  4936 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:06.954826  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.931742  4661 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:06.938153  5033 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:06.915544  5028 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:06.940614  4778 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:06.944243  5029 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:01:06.952008  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77185.9us
I20260709 13:01:06.924611  4758 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.967976  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:06.959883  5028 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:06.958652  5042 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 13:01:06.913869  4722 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:06.933095  5015 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.975312  1682 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:01:06.960099  4921 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 2.931s	user 0.005s	sys 0.001s
I20260709 13:01:06.931097  4962 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:06.950773  5047 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.957653  5018 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.019627  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:06.963150  4661 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.021061  1683 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:07.030056  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 122150us
I20260709 13:01:07.020382  5018 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.040050  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.040934  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.042430  1600 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:07.043339  1675 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:07.030076  4990 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:07.043704  1675 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:07.044929  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.052170  4703 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:07.054107  5050 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:07.055177  5050 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:07.055550  5050 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:07.058173  4683 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:07.059312  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 523) took 1438 ms. Trace:
I20260709 13:01:07.059819  1607 rpcz_store.cc:276] 0709 13:01:05.621184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.621387 (+   203us) service_pool.cc:224] Handling call
0709 13:01:05.621725 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.354446 (+732721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.058985 (+704539us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54004380d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:07.059236 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678636288}
W20260709 13:01:07.062216  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 524) took 1424 ms (client timeout 1734 ms). Trace:
W20260709 13:01:07.062744  1605 rpcz_store.cc:269] 0709 13:01:05.637373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.638563 (+  1190us) service_pool.cc:224] Handling call
0709 13:01:07.062004 (+1423441us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:07.062160 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596661632}
I20260709 13:01:07.038666  5015 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.044420  5018 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.047821  1675 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.112784  1675 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:07.115522  5044 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:01:07.081238  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.116278  4840 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.082271  4914 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.117429  4914 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:07.117763  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 872) took 1464 ms (client timeout 1605 ms). Trace:
I20260709 13:01:07.108016  4936 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:07.118253  2258 rpcz_store.cc:269] 0709 13:01:05.652992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.653105 (+   113us) service_pool.cc:224] Handling call
0709 13:01:07.117590 (+1464485us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54007378d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:07.117707 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812353792}
I20260709 13:01:07.119509  4914 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.082443  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:07.084061  4949 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 2.605s	user 0.006s	sys 0.003s
I20260709 13:01:07.120849  2252 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:07.122670  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1924) took 3353 ms. Trace:
W20260709 13:01:07.085261  4980 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.967s	user 0.005s	sys 0.003s
I20260709 13:01:07.123175  1527 rpcz_store.cc:276] 0709 13:01:03.769765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.822989 (+ 53224us) service_pool.cc:224] Handling call
0709 13:01:03.861886 (+ 38897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.088953 (+227067us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:04.139044 (+ 50091us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.305864 (+166820us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.309991 (+  4127us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.310142 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:04.310177 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.310246 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.083352 (+2773106us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:07.122294 (+ 38942us) raft_consensus.cc:1685] finished
0709 13:01:07.122411 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.122596 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3522,"prepare.queue_time_us":41149,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":46,"raft.queue_time_us":162438,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":7145,"spinlock_wait_cycles":63237376,"thread_start_us":364715,"threads_started":2,"wal-append.queue_time_us":284838}
I20260709 13:01:07.090314  4960 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.094019  5028 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:07.128702  4999 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.595s	user 0.014s	sys 0.017s
I20260709 13:01:07.129498  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.095356  5050 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.096256  4989 raft_consensus.cc:1068] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Unable to promote non-voter 9b6586a864a94c019cae2d8e2987a7af: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }.
  Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.045375  4320 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.044102  5021 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:07.128770  4960 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.994444  4897 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.131384  5021 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.106544  5015 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.136897  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.137423  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1822) took 2074 ms. Trace:
I20260709 13:01:07.137887  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.137851  1606 rpcz_store.cc:276] 0709 13:01:05.063445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.155534 (+ 92089us) service_pool.cc:224] Handling call
0709 13:01:05.155804 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.295753 (+1139949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.137187 (+841434us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400206f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:07.137366 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2540155264}
I20260709 13:01:07.139432  4722 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:07.139950  4722 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:07.140472  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.109988  4969 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.140894  4722 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.139940  1675 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:01:07.094492  5035 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:01:07.148108  4962 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.067227  5004 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.157718  1574 leader_election.cc:400] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:07.158104  1574 leader_election.cc:403] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.111385  4661 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.147069  1683 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:01:07.156893  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 120343us
I20260709 13:01:07.160889  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.166416  4994 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.166927  4994 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.166584  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:07.167758  1681 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:07.169914  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.173282  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:07.173913  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.174991  2252 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:07.177099  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.118439  4840 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.137619  5015 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.175839  5004 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.179358  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.176210  4778 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.175789  4703 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.182001  4778 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.182356  4703 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.176071  4759 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:07.184738  4759 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:07.170833  4962 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.186642  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1952) took 1052 ms. Trace:
I20260709 13:01:07.187081  1530 rpcz_store.cc:276] 0709 13:01:06.134036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.135011 (+   975us) service_pool.cc:224] Handling call
0709 13:01:06.135318 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.392325 (+257007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.186382 (+794057us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540042d1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:07.186572 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589300608}
I20260709 13:01:07.167375  4994 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.180830  4661 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.179349  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.193899  1675 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:07.194787  4950 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.178661  4935 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.196959  4935 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.185684  4759 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.197165  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:07.199744  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.181295  5004 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.200721  5004 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.200031  4703 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.205181  4758 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.205780  4821 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.206393  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.206521  4821 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.207388  4758 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.207635  4950 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.208119  4978 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.208714  4978 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.236646  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:07.239786  2252 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11.
I20260709 13:01:07.240453  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.241261  1675 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:07.226553  4974 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:07.208164  4950 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.244220  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:07.245783  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.246490  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:07.219188  4758 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.253258  5054 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:07.248168  4989 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:01:07.253726  5054 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:07.251327  4950 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.258081  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.259598  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:07.219720  4934 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:07.254557  5054 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.269649  5054 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.270756  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1935) took 1384 ms. Trace:
I20260709 13:01:07.262290  4759 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.262372  4960 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.272696  4960 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.272814  4821 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.273095  4960 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.278616  4757 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.280782  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.250501  5028 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.261251  4758 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.266503  5010 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:07.263621  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.282713  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.297289  1530 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:07.297509  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.284508  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:07.298141  1680 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.299713  1680 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:07.294173  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.301291  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.296785  1609 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:07.271198  1531 rpcz_store.cc:276] 0709 13:01:05.886288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.900235 (+ 13947us) service_pool.cc:224] Handling call
0709 13:01:06.011405 (+111170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.175895 (+164490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.175931 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.176448 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.340809 (+164361us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:06.340860 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.270303 (+929443us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002cd654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:07.270356 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.270407 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:07.270422 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.270686 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5559,"raft.queue_time_us":6098,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":22358,"spinlock_wait_cycles":370723712,"thread_start_us":163378,"threads_started":1,"wal-append.queue_time_us":321578}
I20260709 13:01:07.293502  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.294292  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.295008  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.290387  1606 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:07.302014  5010 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:07.308287  5010 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.309455  4282 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:07.309921  4282 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.310257  4282 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.292279  4759 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.312398  4778 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.313228  4759 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.320983  4759 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.316645  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.318730  4974 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:07.321141  4934 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:07.326453  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1813) took 2805 ms (client timeout 2069 ms). Trace:
I20260709 13:01:07.323194  1608 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:07.326961  1602 rpcz_store.cc:269] 0709 13:01:04.517233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.518429 (+  1196us) service_pool.cc:224] Handling call
0709 13:01:07.322756 (+2804327us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003840d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:07.322906 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581003136}
I20260709 13:01:07.308202  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:07.331161  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50470.8us
I20260709 13:01:07.338555  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.339329  1602 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:07.341545  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.343348  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.306947  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.264024  4978 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:07.318572  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55525.5us
I20260709 13:01:07.345768  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:07.351156  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 52577.1us
W20260709 13:01:07.356266  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 62221.1us
W20260709 13:01:07.351878  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.304237  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:07.295940  5028 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.356837  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.358695  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.361074  1605 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.260442  5018 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.364200  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60071.2us
I20260709 13:01:07.359673  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.359015  1601 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:07.362128  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.366708  1532 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:07.362586  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:07.358054  4951 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.371960  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.369642  1647 leader_election.cc:400] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11.
I20260709 13:01:07.320132  4962 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:07.370414  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.326848  4934 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:07.358037  4963 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:07.376806  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77046.7us
I20260709 13:01:07.376295  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:07.312254  4935 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:07.382858  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.383024  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:07.326921  4897 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:07.394912  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:07.397984  1530 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.398241  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.383464  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.400213  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.401635  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:07.375837  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.385898  2259 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:07.363797  5028 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.360275  5036 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.391932  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.360462  5015 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:07.392746  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:07.393822  1525 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.383711  5017 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:07.374958  4764 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.371426  4951 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.374351  5055 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.404716  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.451879  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:07.451973  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47339.2us
I20260709 13:01:07.388227  4854 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:07.407779  1604 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:07.373386  4821 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.392550  1526 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:07.410060  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.413302  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.415272  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.360849  4778 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.417922  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.418076  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.408743  5054 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:07.385426  4840 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.418833  4799 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.381705  4989 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:07.388422  4825 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.419886  1525 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:07.450664  4951 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.426936  1677 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:07.455837  5055 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.461441  4974 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:07.455998  1682 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:07.374624  4661 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:07.404979  5004 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:07.503587  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 112816us
I20260709 13:01:07.460661  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.508437  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.461561  1530 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:07.462296  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.457870  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.472234  4969 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:07.511981  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.388365  4904 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:01:07.422199  4963 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.427573  4764 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.480225  5052 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:07.478376  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.425725  1676 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:07.528573  1528 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:07.451421  5015 consensus_queue.cc:1243] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:07.448961  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.453639  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.457118  5017 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:07.501549  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.382004  4895 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:07.512823  1603 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:07.418720  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.535065  1527 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:07.513549  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 137642us
I20260709 13:01:07.516212  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.472594  4778 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.464262  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.522881  1602 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.478672  4840 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.530550  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77084.8us
I20260709 13:01:07.500736  4974 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:07.500216  5055 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.469312  4821 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.475683  5054 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:07.550136  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 167185us
W20260709 13:01:07.555404  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.517261  4969 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.559943  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.559944  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.523921  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.495630  4825 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.631563  4825 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:07.536969  4918 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:07.637185  4918 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:07.638257  4918 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.640229  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.641422  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:07.641768  4758 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.642472  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:07.458472  4934 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.610729  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.611399  4969 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.644364  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.644901  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.645424  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.612218  1609 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:07.646399  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.613850  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.651365  1676 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:07.614585  4960 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.616855  1605 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:07.655594  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.653473  4974 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.656291  1605 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:07.481179  4799 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.598789  5017 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.598302  5004 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.606138  4778 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:07.534504  5052 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.528549  4764 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.528929  4963 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.575946  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.676944  1607 raft_consensus.cc:2368] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10.
I20260709 13:01:07.579959  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:07.662547  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57925.9us
W20260709 13:01:07.590739  5059 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:01:07.608999  4935 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:07.661490  5060 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:01:07.599004  5067 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:07.671821  5063 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 13:01:07.686427  1602 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:07.695310  4950 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.690460  5067 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:07.691653  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.706810  4739 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:07.656836  5018 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.697199  5054 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.703179  4799 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.742884  4910 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:07.705406  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 590) took 1203 ms. Trace:
I20260709 13:01:07.743633  2259 rpcz_store.cc:276] 0709 13:01:06.502279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.503762 (+  1483us) service_pool.cc:224] Handling call
0709 13:01:07.082277 (+578515us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:07.705216 (+622939us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400408654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:07.705351 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622040192}
I20260709 13:01:07.694834  4282 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.745041  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.740072  4896 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:07.709678  5010 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.746084  4282 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.749325  4960 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.715794  2256 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:01:07.741976  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.745275  1681 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:07.746249  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:07.753841  1678 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:07.732993  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.672083  4994 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.745191  4903 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.764863  4903 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:07.765436  4963 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:07.741088  4949 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:07.758473  5054 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:07.765844  5052 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:07.768816  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 232317us
W20260709 13:01:07.769673  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 150338us
I20260709 13:01:07.777170  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.763705  5050 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.764586  4950 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.763489  4840 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:07.763051  5021 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:07.791640  1678 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:07.792866  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.774941  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:07.840145  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.746258  4896 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.862717  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67390.3us
I20260709 13:01:07.865485  4896 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:07.863571  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:07.867496  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:07.762586  4969 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:07.869719  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 154707us
I20260709 13:01:07.870571  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.872542  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:07.871515  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.875219  1605 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.872148  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.875779  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.876137  1604 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:07.874774  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:07.869220  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 162999us
I20260709 13:01:07.885252  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.885962  1680 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:07.796885  4951 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.790525  4661 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.888835  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:07.891916  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.896605  1605 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:07.897833  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:07.760408  5055 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.899909  1529 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:07.888741  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:07.913197  2259 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:07.901795  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:07.907563  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:07.873930  4974 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:07.908900  4887 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:07.874577  4825 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:07.909472  5047 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:01:07.910943  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:07.788678  5018 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:01:07.765764  4903 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.917281  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:07.936925  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.903921  4282 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:08.067361  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 169554us
I20260709 13:01:07.919996  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:08.080987  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:08.013485  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111769us
W20260709 13:01:08.070242  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 153029us
I20260709 13:01:08.077770  1679 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:07.997126  2252 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:08.084393  1649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.501s (SENT) [suppressed 16 similar messages]
W20260709 13:01:07.983582  5051 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:01:07.963564  5041 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:07.912221  5004 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:08.093101  5004 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:08.093557  5004 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.093361  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.094515  1531 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:08.095383  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.093359  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.096669  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.097047  1534 raft_consensus.cc:2368] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:08.097337  1530 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:08.093729  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:07.918586  5079 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.090940  1526 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.964059  5080 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.980005  4761 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.996287  4951 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.090615  4903 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.982405  4825 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:08.193020  1678 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:07.903517  4936 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 13:01:08.100512  1600 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:08.090060  4661 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:08.276681  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.293915  4994 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.295970  5004 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.298058  5093 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.298254  5004 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.286572  4990 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.299291  4990 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.242906  5010 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.300890  5010 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.303397  5010 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.202579  5079 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.305637  5079 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.306174  5079 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.306608  5079 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:07.912364  5067 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.246452  5082 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.312726  5082 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.313131  5082 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:08.317008  5051 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:08.199201  5084 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.320688  5055 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:08.322434  1534 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:08.322721  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.323482  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.202876  5080 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.335671  5080 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.337159  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 882) took 1092 ms. Trace:
I20260709 13:01:08.337667  2258 rpcz_store.cc:276] 0709 13:01:07.244834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.245682 (+   848us) service_pool.cc:224] Handling call
0709 13:01:07.245992 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.246389 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:07.323826 (+ 77437us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.793203 (+469377us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:07.860456 (+ 67253us) log.cc:844] Serialized 52 byte log entry
0709 13:01:07.860600 (+   144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:07.873312 (+ 12712us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.244834 (+371522us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.245151 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.245269 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.296158 (+ 50889us) raft_consensus.cc:1685] finished
0709 13:01:08.296182 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.337058 (+ 40876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37980,"prepare.queue_time_us":171156,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":28009,"raft.queue_time_us":270356,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":109584,"spinlock_wait_cycles":3280256,"thread_start_us":778496,"threads_started":3,"wal-append.queue_time_us":687564}
I20260709 13:01:08.300114  4974 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:08.550915  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 639974us
I20260709 13:01:08.375990  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:08.668619  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 386322us
W20260709 13:01:08.669178  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 293269us
W20260709 13:01:08.669576  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.670590  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:08.567788  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 486846us
I20260709 13:01:08.373378  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.406081  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 883) took 1161 ms. Trace:
I20260709 13:01:08.674336  2256 rpcz_store.cc:276] 0709 13:01:07.245100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.245230 (+   130us) service_pool.cc:224] Handling call
0709 13:01:07.715557 (+470327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.752576 (+ 37019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.405808 (+653232us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400408650. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:08.405989 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080883968}
I20260709 13:01:08.674955  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.673557  1678 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:08.288167  5028 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.003s
I20260709 13:01:08.677999  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:08.677026  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:08.586227  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.015s
W20260709 13:01:08.624734  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.009s
I20260709 13:01:08.373440  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.668244  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.672785  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:08.678218  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.676082  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:08.673190  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:08.682293  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.001s	sys 0.016s
W20260709 13:01:08.680222  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.011s
I20260709 13:01:08.678959  2258 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:08.379949  5050 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:01:08.676014  1528 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:08.693324  1528 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:08.697507  4897 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.698109  4897 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:08.690909  5077 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:08.394158  4825 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.703035  4897 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:08.681931  4895 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.701777  5077 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.703850  5077 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.685536  4761 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.572670  5082 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.374642  5079 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.569998  4990 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.704674  5077 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.705557  4895 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.706236  5077 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.707511  4895 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.709769  5082 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:08.710654  5087 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:01:08.688050  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:08.712949  5034 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.686432  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:08.714986  5034 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:08.715762  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.716023  5034 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:08.716396  5034 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.715293  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:08.717391  4897 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:08.717170  5034 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.718066  4897 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.374402  5010 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.719002  5010 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.688980  2256 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.690371  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:08.399474  4764 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.001s
I20260709 13:01:08.720710  2258 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:08.721485  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1966) took 1328 ms. Trace:
I20260709 13:01:08.721817  2258 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:08.722307  5010 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.719013  4897 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.718348  5034 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.715075  4821 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.721838  1526 rpcz_store.cc:276] 0709 13:01:07.393460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.470424 (+ 76964us) service_pool.cc:224] Handling call
0709 13:01:07.470759 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.194773 (+724014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.721257 (+526484us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003426d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:08.721416 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425795328}
I20260709 13:01:08.726965  4998 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:08.727838  4761 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:08.728214  4761 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.728572  4703 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.723346  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.729053  4761 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.730278  4761 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.732230  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1846) took 2843 ms. Trace:
I20260709 13:01:08.732631  1608 rpcz_store.cc:276] 0709 13:01:05.888522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.057641 (+169119us) service_pool.cc:224] Handling call
0709 13:01:07.322885 (+1265244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.327092 (+  4207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.731999 (+1404907us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003840d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:08.732143 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909081856}
I20260709 13:01:08.733968  5048 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:08.677834  4903 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.734340  5048 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.734992  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:08.340898  5093 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.728709  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1823) took 1012 ms. Trace:
I20260709 13:01:08.734750  4903 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.735210  5048 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.735698  5080 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.676715  5021 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.372011  4994 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.714954  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.740954  1601 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:08.369427  4722 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.773519  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.743155  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.775537  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.700652  4567 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.686712  5028 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.745069  1604 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:08.744975  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.777455  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.778174  1605 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:08.745452  1609 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:08.746119  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.779079  1602 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:08.779946  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.747668  1606 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:08.781145  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.781564  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.781502  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.782184  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.782367  1605 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:08.782718  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.751369  1683 rpcz_store.cc:276] 0709 13:01:07.716461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.717016 (+   555us) service_pool.cc:224] Handling call
0709 13:01:07.743155 (+ 26139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.743512 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.743549 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.743974 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.900912 (+156938us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.900961 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.901036 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.710024 (+808988us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:08.728382 (+ 18358us) raft_consensus.cc:1685] finished
0709 13:01:08.728403 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.728646 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":276,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":55582464,"thread_start_us":156614,"threads_started":1,"wal-append.queue_time_us":628261}
I20260709 13:01:08.756443  2256 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:08.762451  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 89343.1us
I20260709 13:01:08.687667  4974 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.764626  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78270.9us
I20260709 13:01:08.765715  1525 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:08.707402  4990 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.752769  5093 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.785585  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.788832  1606 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:08.787313  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:08.788280  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.782752  1604 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:08.783293  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.755240  4978 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.778469  1601 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:08.720652  4764 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.755642  5010 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.807884  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:08.818104  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:08.818594  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.810680  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.819325  1601 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:08.805622  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.813911  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:08.678960  1678 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:08.812678  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.841387  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.781530  5082 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:08.842998  1604 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.808249  1533 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:08.809775  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.811800  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.848237  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:08.849268  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.843037  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:08.850232  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.851401  1609 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:08.852687  4895 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:08.853180  4895 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.853816  4895 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.854072  4764 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:08.846172  5010 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.801075  4567 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:08.856710  5096 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:08.857237  5096 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.857908  5096 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.818780  1602 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:08.780987  5048 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.818815  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:08.854916  5082 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:08.856621  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.858801  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:08.859350  1602 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:08.857370  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.859951  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:08.859967  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:08.861223  1682 raft_consensus.cc:2368] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10.
I20260709 13:01:08.861961  1608 raft_consensus.cc:2410] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:01:08.803462  5017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.015s
I20260709 13:01:08.807148  4703 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:08.803567  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.004s	sys 0.017s
W20260709 13:01:08.907976  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.005s	sys 0.017s
W20260709 13:01:08.806102  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110464us
I20260709 13:01:08.805169  5018 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.863022  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:08.771481  5080 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.927358  2256 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:08.927709  2256 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 7
I20260709 13:01:08.927906  2256 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:08.928599  4567 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:08.929723  4567 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:08.930055  4567 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:08.930866  4567 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.779632  4994 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:08.928123  2256 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.938896  1683 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:08.959662  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:08.961227  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:08.819166  4990 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.806809  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:08.901602  5017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.012s	sys 0.020s
I20260709 13:01:08.932260  4567 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.923293  4764 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.924957  5018 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.807387  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:08.991362  1606 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.857144  5010 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.988988  5017 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:08.989180  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.029011  1529 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:09.028874  5017 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.030308  1529 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:09.031140  5017 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.031961  5017 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.032137  5080 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.941110  4703 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.034581  4703 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:08.920099  5099 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.990356  4990 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.034494  1606 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:09.043313  4990 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.044016  4990 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.984371  1603 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:08.868247  4950 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.000869  1604 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:09.062282  1604 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:01:08.986361  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83331.9us
I20260709 13:01:09.010660  4994 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:09.012912  5103 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:01:09.014636  5018 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:08.996054  5100 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:01:09.012230  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:09.046546  1606 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:01:08.839717  4978 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.808363  4974 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:09.052378  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 245618us
I20260709 13:01:08.868669  5077 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:09.060655  4912 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.782807  4722 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.007087  1609 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:09.059384  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:08.989500  4764 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:09.087500  1605 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.088297  4764 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.089543  4764 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.094002  4978 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.064610  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:08.863953  5052 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.191s
I20260709 13:01:09.068555  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:08.989547  5067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.009s	sys 0.014s
I20260709 13:01:09.073553  1526 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.075358  4683 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:01:09.097151  5077 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:08.940815  5082 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.076104  4903 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.058036  5010 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.103332  1605 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:09.109416  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:09.115689  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47239.9us
W20260709 13:01:09.116143  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.117177  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.119982  1526 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:09.123425  4703 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.123551  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.103653  5018 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.124954  5099 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:09.113274  5067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.010s	sys 0.014s
I20260709 13:01:09.126374  5077 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.127426  4983 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.130614  4974 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.103744  4912 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:09.083496  5105 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.133540  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 603) took 1337 ms. Trace:
I20260709 13:01:09.134143  2259 rpcz_store.cc:276] 0709 13:01:07.796230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.796405 (+   175us) service_pool.cc:224] Handling call
0709 13:01:09.133304 (+1336899us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b540040bfd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.133472 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19219200}
I20260709 13:01:09.135788  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.139120  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:09.145551  5090 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.752s	user 0.004s	sys 0.003s
I20260709 13:01:09.069726  4950 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:01:09.150804  4950 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.081691  5017 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.094350  4722 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.155203  2259 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:09.147068  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 551) took 1274 ms. Trace:
I20260709 13:01:09.104689  5052 consensus_queue.cc:1243] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:09.149050  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.162706  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 602) took 1366 ms. Trace:
I20260709 13:01:09.133723  5105 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.170671  5028 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.171595  5105 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.159343  5077 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:09.156497  1600 rpcz_store.cc:276] 0709 13:01:07.872172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.888478 (+ 16306us) service_pool.cc:224] Handling call
0709 13:01:09.146776 (+1258298us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540011dd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.146983 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430522240}
I20260709 13:01:09.165604  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.163163  2252 rpcz_store.cc:276] 0709 13:01:07.795910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.796056 (+   146us) service_pool.cc:224] Handling call
0709 13:01:09.162471 (+1366415us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005c0b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.162626 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245254400}
I20260709 13:01:09.132834  4912 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.167652  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.157303  5017 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:09.204341  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55344.6us
I20260709 13:01:09.222230  2259 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:09.225085  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 263942us
I20260709 13:01:09.225782  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:09.227644  2259 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.228296  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.229795  2258 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:09.222456  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.012s	sys 0.025s
I20260709 13:01:09.223299  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.206056  4840 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:09.231658  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.012s	sys 0.025s
I20260709 13:01:09.234748  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.239715  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:09.237566  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 422192us
I20260709 13:01:09.240432  2252 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:09.241570  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.221536  4722 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.222010  5105 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:09.245434  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.243022  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.232897  4840 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.234982  5028 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:09.248677  4722 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.236678  4897 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.247835  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.242369  2259 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:09.249585  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:09.235932  5077 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:09.221570  4895 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.256006  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 604) took 1459 ms. Trace:
I20260709 13:01:09.257373  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:09.294798  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.227095  5093 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.287814  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:09.292560  2257 rpcz_store.cc:276] 0709 13:01:07.796732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.796844 (+   112us) service_pool.cc:224] Handling call
0709 13:01:09.249434 (+1452590us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:09.255942 (+  6508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30795136}
I20260709 13:01:09.238148  5010 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:09.298976  5047 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.300169  5067 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.310946  5067 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.250043  4567 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.302227  4722 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.252192  5028 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:09.304893  1649 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.311367  5017 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.251928  4840 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.248294  5105 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.322899  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.324961  5067 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.326778  5096 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.287963  4764 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:09.330916  2252 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:09.311033  4778 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.243935  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:09.388290  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 144421us
I20260709 13:01:09.309038  5021 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:09.329563  5028 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.355401  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.395269  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:09.341770  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 522964us
I20260709 13:01:09.331523  5047 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:09.400839  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45529.8us
I20260709 13:01:09.312577  4978 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:01:09.401628  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.288472  4897 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.352687  4761 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.403867  2259 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:09.402256  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:09.404069  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:09.410185  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:09.408779  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.389364  4567 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:09.387878  4778 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:09.387360  5017 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:09.413829  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.432164  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.413900  1530 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:09.387580  4764 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:09.435597  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 172336us
I20260709 13:01:09.396533  4722 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:09.390900  5021 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:09.424650  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.008s
I20260709 13:01:09.402662  5034 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:09.463950  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 234480us
I20260709 13:01:09.466323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:09.468366  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.009s	sys 0.008s
I20260709 13:01:09.468276  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:09.473560  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 672088us
I20260709 13:01:09.430977  4990 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:09.413669  5048 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.470515  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.488775  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.492689  2253 raft_consensus.cc:2376] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10. Re-sending same reply.
W20260709 13:01:09.493315  2253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 608) took 1692 ms (client timeout 1717 ms). Trace:
I20260709 13:01:09.474678  4854 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.494716  4854 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.496935  5093 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.467667  4764 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:09.500824  5113 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:01:09.465688  5077 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.481326  5010 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.502556  5010 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.504844  4895 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.433444  4903 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:09.506599  4903 consensus_queue.cc:1243] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:09.508719  5105 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.471700  4869 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.509182  5096 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.509855  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.510574  1678 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:09.471837  5021 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.511418  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:09.500726  5108 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:09.511899  4854 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
W20260709 13:01:09.493703  2253 rpcz_store.cc:269] 0709 13:01:07.800468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.800607 (+   139us) service_pool.cc:224] Handling call
0709 13:01:09.488599 (+1687992us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:09.493248 (+  4649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30205824}
I20260709 13:01:09.514830  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.433579  4950 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:09.517498  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 103753us
I20260709 13:01:09.471618  4722 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:09.521754  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.525350  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 423654us
I20260709 13:01:09.515606  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1820) took 2096 ms. Trace:
I20260709 13:01:09.518893  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.512037  1678 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:09.520404  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.438341  4567 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.504760  5010 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.528401  1677 rpcz_store.cc:276] 0709 13:01:07.419190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.481343 (+ 62153us) service_pool.cc:224] Handling call
0709 13:01:07.481809 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.482186 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.482212 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.021822 (+1539610us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800293920. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a
0709 13:01:09.023065 (+  1243us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b2c0012ecf8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:09.023698 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.331673 (+307975us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:09.331711 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.331799 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.515353 (+183554us) raft_consensus.cc:1685] finished
0709 13:01:09.515379 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.515530 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":463,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7485,"spinlock_wait_cycles":33699968,"thread_start_us":307566,"threads_started":1,"wal-append.queue_time_us":488720}
I20260709 13:01:09.533740  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.431600  4761 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.537091  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.529912  5096 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.537868  4990 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:09.538300  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:09.540849  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.544023  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 73599.4us
I20260709 13:01:09.519399  4918 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.549108  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.544725  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:09.546072  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.550235  1678 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:09.546324  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.546674  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.521380  4994 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.527663  4722 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.551330  1677 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:09.471087  5017 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.575594  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:09.576437  1677 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:09.553913  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.532454  4567 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.557217  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.523605  5112 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:09.545595  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.583630  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.585556  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.593205  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.593322  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:09.597445  1678 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:09.597990  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:09.599854  2254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 605) took 1802 ms (client timeout 2183 ms). Trace:
W20260709 13:01:09.606745  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 61248.3us
I20260709 13:01:09.607702  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.547729  5015 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:09.604940  2254 rpcz_store.cc:269] 0709 13:01:07.797003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.797120 (+   117us) service_pool.cc:224] Handling call
0709 13:01:09.593039 (+1795919us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:09.599787 (+  6748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30188288}
W20260709 13:01:09.612990  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.616092  1608 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:09.528350  4950 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.587235  5105 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.528017  4869 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.626129  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:09.595500  5115 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.663368  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.611420  4821 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.577557  4854 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:09.580847  4903 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.589589  5047 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:09.660254  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.608480  5093 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.614724  5067 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:09.657567  1530 raft_consensus.cc:2368] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:09.629668  4994 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.574266  5096 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.544255  4778 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.618098  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.581048  4918 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.704288  5028 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.705505  4918 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.644873  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.693286  5067 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:09.706670  5028 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.707242  5067 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.708287  5017 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.708869  4903 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.694375  5093 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:09.599624  5112 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:09.718914  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 100927us
W20260709 13:01:09.718828  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 543) took 2426 ms (client timeout 2079 ms). Trace:
W20260709 13:01:09.719807  1607 rpcz_store.cc:269] 0709 13:01:07.292671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.293221 (+   550us) service_pool.cc:224] Handling call
0709 13:01:09.718592 (+2425371us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001bcbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.718750 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859471104}
I20260709 13:01:09.721406  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.722441  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 606) took 1925 ms. Trace:
I20260709 13:01:09.689103  5101 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:09.649823  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:09.726884  1678 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:09.688651  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 13:01:09.676062  4990 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.722599  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:09.720024  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:09.729406  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.614514  5104 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:01:09.746290  1607 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:09.746696  1607 pending_rounds.cc:85] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:01:09.746908  1607 pending_rounds.cc:107] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:09.747128  1607 raft_consensus.cc:2889] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.747323  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.732232  4950 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.667305  5105 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:09.751093  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 143491us
I20260709 13:01:09.685360  4854 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.718519  4994 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.739158  4869 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:09.739554  4722 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.741132  2253 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:09.744220  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.732992  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.755430  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:09.723102  2255 rpcz_store.cc:276] 0709 13:01:07.797308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.797418 (+   110us) service_pool.cc:224] Handling call
0709 13:01:09.137868 (+1340450us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:09.138156 (+   288us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:09.138711 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.138747 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:09.139494 (+   747us) log.cc:844] Serialized 78 byte log entry
0709 13:01:09.463191 (+323697us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:09.670022 (+206831us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.721127 (+ 51105us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.721759 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.721935 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.722180 (+   245us) raft_consensus.cc:1685] finished
0709 13:01:09.722199 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.722372 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43271,"raft.queue_time_us":65566,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":3569024,"thread_start_us":501211,"threads_started":2,"wal-append.queue_time_us":412952}
I20260709 13:01:09.762945  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:09.700875  4897 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:09.776572  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.686846  5047 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.759389  5115 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.743125  5048 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.785777  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:09.868156  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.869138  1676 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:09.869266  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:09.845206  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:09.869994  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.863644  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.777588  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1982) took 2017 ms. Trace:
I20260709 13:01:09.764114  4821 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.871244  1675 rpcz_store.cc:276] 0709 13:01:07.760650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.409972 (+649322us) service_pool.cc:224] Handling call
0709 13:01:09.776850 (+1366878us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:09.777033 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.777230 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.777257 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.777300 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:09.777334 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.777388 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.777516 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3372928}
I20260709 13:01:09.872888  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.873965  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.874523  1675 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:09.875325  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.876020  1675 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:09.609947  4895 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:01:09.863085  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:09.877588  4895 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:09.880339  5047 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:09.868485  4950 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:09.881453  4950 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.881845  4950 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.884341  4854 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:09.885154  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.886445  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.886108  5105 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.887615  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.889000  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.889869  1676 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 5.
I20260709 13:01:09.890918  5021 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.764209  4978 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.894011  4764 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.897768  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.898908  1529 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:09.899917  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.901230  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:09.902423  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.768872  5110 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:01:09.904572  1675 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:09.905577  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.890868  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.907377  1676 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:09.908262  5036 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:09.910835  5036 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:09.911752  5036 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.912864  5036 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.918066  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 620) took 1119 ms. Trace:
I20260709 13:01:09.918640  2252 rpcz_store.cc:276] 0709 13:01:08.798351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.245166 (+446815us) service_pool.cc:224] Handling call
0709 13:01:09.917767 (+672601us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b54003a1e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.917982 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193039104}
I20260709 13:01:09.908475  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.921415  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1835) took 1226 ms. Trace:
I20260709 13:01:09.921697  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.921872  1683 rpcz_store.cc:276] 0709 13:01:08.694516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.859757 (+165241us) service_pool.cc:224] Handling call
0709 13:01:09.921121 (+1061364us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54001d9f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.921308 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84432128}
I20260709 13:01:09.922370  1676 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:09.923382  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:09.923902  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 435) took 2638 ms (client timeout 1862 ms). Trace:
W20260709 13:01:09.924331  1681 rpcz_store.cc:269] 0709 13:01:07.285493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.286880 (+  1387us) service_pool.cc:224] Handling call
0709 13:01:09.923650 (+2636770us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54000eced4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:09.923796 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015254784}
I20260709 13:01:09.925351  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.920051  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:09.927037  2252 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.923288  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:09.908867  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.768579  5017 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.743767  5015 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:01:09.939348  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.864198  5099 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.964531  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.965749  1675 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:09.981470  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:09.988138  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1883) took 1209 ms. Trace:
I20260709 13:01:09.988687  1602 rpcz_store.cc:276] 0709 13:01:08.778435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.907051 (+128616us) service_pool.cc:224] Handling call
0709 13:01:08.907541 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.151863 (+244322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.151900 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.157094 (+  5194us) log.cc:844] Serialized 564 byte log entry
0709 13:01:09.524916 (+367822us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.524951 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.987745 (+462794us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400207e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:09.987795 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.987842 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:09.987855 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.988069 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560602880,"thread_start_us":367499,"threads_started":1,"wal-append.queue_time_us":544625}
I20260709 13:01:09.964267  4567 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:09.958357  5093 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:09.995895  4764 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:10.025902  4896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.727s	user 0.008s	sys 0.013s
I20260709 13:01:09.993393  4895 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:09.906950  5112 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.058221  1602 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:10.061069  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.071821  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.092988  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.094240  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:10.094905  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.088563  1677 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:10.054778  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 391461us
I20260709 13:01:10.075686  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 891) took 1288 ms. Trace:
I20260709 13:01:10.075062  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1889) took 1232 ms. Trace:
I20260709 13:01:10.099014  2259 rpcz_store.cc:276] 0709 13:01:08.787737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.287526 (+499789us) service_pool.cc:224] Handling call
0709 13:01:10.075479 (+787953us) spinlock_profiling.cc:243] Waited 99.5 ms on lock 0x7b5400740254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.075624 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228765056}
I20260709 13:01:10.092983  1675 raft_consensus.cc:2410] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:10.099562  1609 rpcz_store.cc:276] 0709 13:01:08.842778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.095493 (+252715us) service_pool.cc:224] Handling call
0709 13:01:09.316012 (+220519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.316211 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.316241 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.316283 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.316337 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.316395 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.074847 (+758452us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003f2fd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.074992 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506228608}
I20260709 13:01:10.078495  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 615) took 1392 ms. Trace:
I20260709 13:01:10.065495  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:10.101907  2256 rpcz_store.cc:276] 0709 13:01:08.686121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.789296 (+103175us) service_pool.cc:224] Handling call
0709 13:01:08.789582 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.949849 (+160267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.073852 (+1124003us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540039ba54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:10.078411 (+  4559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315995904}
W20260709 13:01:10.102514  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.101325  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.103978  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:10.101325  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:10.075491  2252 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:10.104526  1681 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.097126  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1890) took 1253 ms. Trace:
I20260709 13:01:10.155591  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.155228  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:10.155843  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.157668  1675 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:10.004683  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.158725  1678 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:10.158666  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.160892  1675 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:10.162358  1675 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: [9.11-9.11]
W20260709 13:01:10.055687  5126 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:01:10.078087  4896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.796s	user 0.012s	sys 0.015s
W20260709 13:01:10.056182  5137 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:10.168471  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.054785  4722 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.105274  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.056730  4761 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.101774  5067 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.185415  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:10.186878  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:10.176564  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:10.173520  1604 rpcz_store.cc:276] 0709 13:01:08.843507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.171459 (+327952us) service_pool.cc:224] Handling call
0709 13:01:09.171793 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.172040 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:09.463491 (+291451us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.096746 (+633255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.096804 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:10.096849 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.096940 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.097068 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161275,"prepare.queue_time_us":76800,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":163043,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":53875,"thread_start_us":732528,"threads_started":2}
I20260709 13:01:10.175400  2259 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:10.172510  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.098135  5018 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.030764  4950 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.105110  4989 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:10.155058  5082 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:10.203537  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.223559  2252 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.204365  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:10.204615  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.102111  5010 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:10.206208  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 106449us
I20260709 13:01:10.207150  1678 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:10.207228  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.213711  1675 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:01:10.241693  1675 pending_rounds.cc:85] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 7
I20260709 13:01:10.242012  1675 pending_rounds.cc:107] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:10.242297  1675 raft_consensus.cc:2889] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.214200  2256 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:10.216869  4950 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.218828  4969 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.225443  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.180338  4994 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.174232  5146 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.237547  2252 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:10.220899  5082 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.242403  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:10.269824  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:10.245483  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:10.264024  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.264782  2259 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.206650  4933 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.274621  1678 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.476377  1683 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:01:10.508543  1683 pending_rounds.cc:85] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 9
I20260709 13:01:10.242677  1675 pending_rounds.cc:107] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:10.219770  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:10.503259  4903 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:01:10.521447  1530 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:10.521960  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2135) took 1772 ms (client timeout 2156 ms). Trace:
I20260709 13:01:10.468338  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1833) took 2580 ms. Trace:
W20260709 13:01:10.286607  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 162479us
I20260709 13:01:10.525754  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 629) took 1046 ms. Trace:
I20260709 13:01:10.526304  2253 rpcz_store.cc:276] 0709 13:01:09.479476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.529031 (+ 49555us) service_pool.cc:224] Handling call
0709 13:01:10.525248 (+996217us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54005c2e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.525488 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442857344}
I20260709 13:01:10.527994  1602 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:10.273284  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.530479  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.531442  1675 raft_consensus.cc:2889] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.238121  1604 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:10.533277  4854 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.534250  4854 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.534639  4978 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.534818  4761 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.535677  4761 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.509043  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.539121  5036 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.540385  5036 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.542707  5111 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.543196  5036 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.543565  5111 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:10.534262  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.545563  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.546072  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.547165  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.535593  4978 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.522609  1680 rpcz_store.cc:276] 0709 13:01:07.887175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.679800 (+792625us) service_pool.cc:224] Handling call
0709 13:01:08.680195 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:08.680714 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.680746 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:08.681453 (+   707us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.680585 (+999132us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b1800356080. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:01:09.938768 (+258183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.168932 (+230164us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.181539 (+ 12607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.181620 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.467219 (+285599us) raft_consensus.cc:1685] finished
0709 13:01:10.467473 (+   254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.467949 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36895,"prepare.queue_time_us":36222,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":18760,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":25528,"spinlock_wait_cycles":76596096,"thread_start_us":452063,"threads_started":2,"wal-append.queue_time_us":1480148}
I20260709 13:01:10.544134  5105 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:10.544198  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 442) took 3045 ms (client timeout 1524 ms). Trace:
I20260709 13:01:10.533303  5101 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:01:10.554641  4903 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.530411  2252 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:10.477391  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1956) took 2103 ms. Trace:
W20260709 13:01:10.314033  4840 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.002s
I20260709 13:01:10.555799  4903 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.556572  4840 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.555825  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 896) took 1080 ms. Trace:
I20260709 13:01:10.553032  5105 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.550886  4978 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.295766  4567 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.558903  5105 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.561074  1531 rpcz_store.cc:276] 0709 13:01:08.373679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.373780 (+   101us) service_pool.cc:224] Handling call
0709 13:01:09.152509 (+778729us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:09.152769 (+   260us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.153166 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.153195 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.153838 (+   643us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.556177 (+402339us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:09.556244 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.556596 (+   352us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.476563 (+919967us) raft_consensus.cc:1685] finished
0709 13:01:10.476611 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.477136 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1413,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8847,"spinlock_wait_cycles":32314240,"thread_start_us":326035,"threads_started":1,"wal-append.queue_time_us":792687}
I20260709 13:01:10.555053  5111 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:10.478013  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 543) took 2864 ms (client timeout 2161 ms). Trace:
I20260709 13:01:10.238006  4825 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:10.564718  4825 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.558688  2252 rpcz_store.cc:276] 0709 13:01:09.475480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.272973 (+797493us) service_pool.cc:224] Handling call
0709 13:01:10.555730 (+282757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.567262  4825 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.289973  4933 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.570436  1604 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:01:10.570785  4933 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.231940  4989 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:10.471479  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 235231us
I20260709 13:01:10.571334  4934 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:10.572539  1533 rpcz_store.cc:269] 0709 13:01:07.356443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.356583 (+   140us) service_pool.cc:224] Handling call
0709 13:01:10.220564 (+2863981us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003a6bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.220698 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3327994240}
I20260709 13:01:10.479470  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:10.237804  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:10.477814  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:10.274237  5018 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:10.577447  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 99990.4us
I20260709 13:01:10.577755  5018 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:10.273257  5082 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.490502  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2112) took 3075 ms. Trace:
I20260709 13:01:10.578394  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:10.578893  1603 rpcz_store.cc:276] 0709 13:01:07.414850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.533800 (+118950us) service_pool.cc:224] Handling call
0709 13:01:07.534159 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.056053 (+1521894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.489642 (+1433589us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400207454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:10.490184 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3334662528}
W20260709 13:01:10.553222  1682 rpcz_store.cc:269] 0709 13:01:07.498578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.501225 (+  2647us) service_pool.cc:224] Handling call
0709 13:01:10.543699 (+3042474us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540024aed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.543927 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3053907712}
I20260709 13:01:10.580240  4933 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.580725  4933 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.581082  1682 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.581184  4933 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.578923  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.578394  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.583292  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:10.583803  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.585196  1604 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: [6.8-10.10]
I20260709 13:01:10.585714  4950 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.577467  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1817) took 3166 ms. Trace:
I20260709 13:01:10.586962  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2003) took 1124 ms. Trace:
I20260709 13:01:10.587157  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.587402  1677 rpcz_store.cc:276] 0709 13:01:09.462916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.597745 (+134829us) service_pool.cc:224] Handling call
0709 13:01:10.586502 (+988757us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54003296d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.586752 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112997120}
I20260709 13:01:10.585592  5112 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.542912  4778 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.588691  5112 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.589263  5112 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.589325  4895 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.589887  4895 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.590278  4895 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.567909  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.595037  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 633) took 1105 ms. Trace:
I20260709 13:01:10.595427  2252 rpcz_store.cc:276] 0709 13:01:09.494312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.567550 (+1073238us) service_pool.cc:224] Handling call
0709 13:01:10.594959 (+ 27409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.578387  4320 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.596895  4320 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.597352  4320 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.554653  4761 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.601092  1682 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.588132  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.586704  1674 rpcz_store.cc:276] 0709 13:01:07.410468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.410584 (+   116us) service_pool.cc:224] Handling call
0709 13:01:07.453467 (+ 42883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.313107 (+1859640us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:09.578029 (+264922us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.223708 (+645679us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.223998 (+   290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.224047 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.224088 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.532715 (+308627us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b18004c31e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e67a0558f 00007f7e60a44571 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd
0709 13:01:10.576934 (+ 44219us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003291d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:10.576982 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.577223 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46160,"prepare.queue_time_us":647366,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":46137,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":15422,"spinlock_wait_cycles":4288146048,"thread_start_us":848416,"threads_started":3,"wal-append.queue_time_us":413317}
I20260709 13:01:10.606735  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 893) took 1818 ms. Trace:
I20260709 13:01:10.607261  2253 rpcz_store.cc:276] 0709 13:01:08.788207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.605382 (+1817175us) service_pool.cc:224] Handling call
0709 13:01:10.605971 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.606349 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.606372 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.606412 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.606467 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.606535 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.606661 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.369292  5048 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.276355  5021 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.651836  5021 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.652750  5021 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:10.653342  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 383456us
I20260709 13:01:10.654299  5015 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.655323  5015 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:10.321014  5078 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 2.258s	user 0.008s	sys 0.000s
I20260709 13:01:10.502491  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 888) took 2641 ms. Trace:
I20260709 13:01:10.483294  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:10.356987  5153 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:10.339679  5139 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:01:10.270685  5146 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:10.356289  5148 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260709 13:01:10.657029  2258 rpcz_store.cc:276] 0709 13:01:07.860493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.723497 (+863004us) service_pool.cc:224] Handling call
0709 13:01:08.724028 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.230227 (+506199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.501704 (+1271477us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54001ecb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:10.502195 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155488000}
I20260709 13:01:10.509075  1683 pending_rounds.cc:107] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:01:10.667784  1683 raft_consensus.cc:2889] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.668498  2258 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.669162  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 614) took 1872 ms. Trace:
I20260709 13:01:10.657840  5015 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.670097  1683 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:10.659258  4956 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:10.671968  4956 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:10.518828  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.672773  2260 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.659554  4869 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:01:10.674153  4869 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:10.674556  4869 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:10.225016  1528 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:10.662360  1527 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:10.665923  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1888) took 1840 ms. Trace:
I20260709 13:01:10.659698  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.303881  2259 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:10.665443  5146 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.560520  2257 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 11. Ops: []
I20260709 13:01:10.680301  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 615) took 1883 ms. Trace:
I20260709 13:01:10.295406  4969 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.680815  2259 rpcz_store.cc:276] 0709 13:01:08.797159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.678814 (+1881655us) service_pool.cc:224] Handling call
0709 13:01:10.679364 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.679742 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.679771 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.679828 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:10.679863 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.679935 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.680096 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.574849  4989 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.576553  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.662230  5153 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.596952  2252 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:10.363507  5096 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:10.496732   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:10.683121  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 616) took 1885 ms. Trace:
I20260709 13:01:10.669504  2258 rpcz_store.cc:276] 0709 13:01:08.796845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.667637 (+1870792us) service_pool.cc:224] Handling call
0709 13:01:10.668112 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.668926 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.669100 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.685420  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 892) took 1897 ms. Trace:
I20260709 13:01:10.672420  4956 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:10.677279  1606 rpcz_store.cc:276] 0709 13:01:08.825596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.074111 (+248515us) service_pool.cc:224] Handling call
0709 13:01:09.074471 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.100960 (+ 26489us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:09.491182 (+390222us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.761355 (+270173us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.779040 (+ 17685us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.779233 (+   193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:09.779272 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.779355 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.665512 (+886157us) raft_consensus.cc:1685] finished
0709 13:01:10.665545 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.665748 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25851,"prepare.queue_time_us":141888,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":26947,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":15102,"thread_start_us":510864,"threads_started":2,"wal-append.queue_time_us":452862}
I20260709 13:01:10.682888  5153 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.675678  4869 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.649535  4683 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:10.690712  1603 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.650592  1678 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:10.367985  5099 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:10.761750  2255 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:10.763525  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 618) took 1160 ms. Trace:
W20260709 13:01:10.522496  1605 rpcz_store.cc:269] 0709 13:01:08.749433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.783084 (+ 33651us) service_pool.cc:224] Handling call
0709 13:01:10.521466 (+1738382us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54003b8dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.521740 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631385984}
I20260709 13:01:10.659979  5021 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.764072  1607 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:10.559666  4840 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.682509  1600 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:10.753733  1432 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.684864  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 890) took 1897 ms. Trace:
I20260709 13:01:10.765682  2257 rpcz_store.cc:276] 0709 13:01:08.787466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.312600 (+525134us) service_pool.cc:224] Handling call
0709 13:01:09.312947 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.680695 (+1367748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.684201 (+  3506us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004eaa54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:10.684784 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868097920}
I20260709 13:01:10.692512  4869 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.687379  4956 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.768062  1675 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:10.768575  4956 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.769472  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.683650  2259 rpcz_store.cc:276] 0709 13:01:08.797403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.681986 (+1884583us) service_pool.cc:224] Handling call
0709 13:01:10.682426 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.682755 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.682788 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.682839 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:10.682878 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.682941 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.683060 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.773151  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.775671  1678 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:10.685796  2252 rpcz_store.cc:276] 0709 13:01:08.787971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.596110 (+1808139us) service_pool.cc:224] Handling call
0709 13:01:10.596675 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.685115 (+ 88440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.685338 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.781983  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 622) took 1983 ms. Trace:
I20260709 13:01:10.782410  2252 rpcz_store.cc:276] 0709 13:01:08.798796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.780870 (+1982074us) service_pool.cc:224] Handling call
0709 13:01:10.781280 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.781622 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.781659 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.781716 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:10.781746 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.781804 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.781925 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.712677  5015 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.784053  5015 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.784618  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.716668  4989 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.785513  4989 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.785787  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.787431  4994 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.721076  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:10.787834  4994 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.788337  4994 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.788959  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 456) took 1238 ms. Trace:
I20260709 13:01:10.789438  1676 rpcz_store.cc:276] 0709 13:01:09.550872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.923171 (+372299us) service_pool.cc:224] Handling call
0709 13:01:10.788732 (+865561us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540007d0d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.788891 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832384896}
I20260709 13:01:10.767346  2257 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.792497  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 618) took 1994 ms. Trace:
I20260709 13:01:10.792951  2257 rpcz_store.cc:276] 0709 13:01:08.797874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.766633 (+1968759us) service_pool.cc:224] Handling call
0709 13:01:10.766997 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.792180 (+ 25183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.792418 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.794708  2257 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:10.739845  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 300) took 30681 ms (client timeout 15000 ms). Trace:
I20260709 13:01:10.644115  4854 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.745208  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.789067  2253 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:10.748260  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:10.748725  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.749270  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.752713  2254 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:01:10.690857  4683 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.763972  2255 rpcz_store.cc:276] 0709 13:01:09.602731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.862786 (+260055us) service_pool.cc:224] Handling call
0709 13:01:10.763229 (+900443us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54007ae254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.763442 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034461056}
I20260709 13:01:10.586177  4950 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:10.766815  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.767335  1607 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:10.773437  1675 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.656253  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:10.773447  2259 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:10.785779  5143 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.796624  5015 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.798501  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.798760  2252 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:10.729955  4903 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.802879  4994 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:10.806100  1431 rpcz_store.cc:269] 0709 13:00:40.058313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.064498 (+  6185us) service_pool.cc:224] Handling call
0709 13:01:10.739570 (+30675072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:01.516856 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:01.688034 (+171178us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:01.688090 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:01:01.688110 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:01.698228 (+ 10118us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:01.698315 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:01.698344 (+    29us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:01.700085 (+  1741us) tablet.cc:701] Row locks acquired
0709 13:01:01.700135 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:01.753276 (+ 53141us) write_op.cc:270] Start()
0709 13:01:01.790245 (+ 36969us) write_op.cc:276] Timestamp: P: 1783602061700242 usec, L: 0
0709 13:01:01.818525 (+ 28280us) op_driver.cc:348] REPLICATION: starting
0709 13:01:01.927086 (+108561us) log.cc:844] Serialized 8311 byte log entry
0709 13:01:02.378243 (+451157us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2ce28 00007f7e67567581 00007f7e67566d58 00007f7e6756b9f1 00007f7e6756b9a9 00007f7e6756b939 00007f7e6756b901 00007f7e6756ab2d 000000000038f354 000000000038f199
0709 13:01:02.650985 (+272742us) op_driver.cc:464] REPLICATION: finished
0709 13:01:02.847216 (+196231us) write_op.cc:301] APPLY: starting
0709 13:01:02.847358 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:02.847980 (+   622us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:02.848061 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:03.198737 (+350676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:03.199393 (+   656us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:01:03.199449 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:03.199957 (+   508us) log.cc:844] Serialized 145 byte log entry
0709 13:01:03.200167 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:03.220654 (+ 20487us) write_op.cc:454] Released schema lock
0709 13:01:03.232935 (+ 12281us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:03.261129 (+ 28194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:03.268011 (+  6882us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":190779,"apply.run_cpu_time_us":9098,"apply.run_wall_time_us":400710,"num_ops":21,"prepare.queue_time_us":223604,"prepare.run_cpu_time_us":29593,"prepare.run_wall_time_us":912013,"raft.queue_time_us":237034,"raft.run_cpu_time_us":18816,"raft.run_wall_time_us":156544,"replication_time_us":832299,"spinlock_wait_cycles":33647872,"thread_start_us":483328,"threads_started":4,"wal-append.queue_time_us":64116,"wal-append.run_cpu_time_us":23883,"wal-append.run_wall_time_us":2217418}]]}
I20260709 13:01:10.810053  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:10.810348  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65518.9us
I20260709 13:01:10.810818  4854 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:10.746959  2260 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:10.787782  4989 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.835902  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 626) took 2008 ms. Trace:
I20260709 13:01:10.837918  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 894) took 2023 ms. Trace:
I20260709 13:01:10.837651  4950 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.838308  5143 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:10.860707  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 279907us
I20260709 13:01:10.861043  5143 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:10.861490  1681 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.009s
I20260709 13:01:10.861975  1681 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:10.864746  5153 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:10.865279  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 209175us
I20260709 13:01:10.866268  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.867254  5153 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.845927  1602 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.859282  4994 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:10.868556  5101 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.846271  5015 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.869762  5015 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:10.870247  5015 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.715963  5146 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.860464  2253 rpcz_store.cc:276] 0709 13:01:08.790500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.788364 (+1997864us) service_pool.cc:224] Handling call
0709 13:01:10.788779 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.813981 (+ 25202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.814215 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.872723  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:10.873144  2255 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:10.873838  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 897) took 1397 ms. Trace:
I20260709 13:01:10.874265  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.874616  5146 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:10.864630  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 609) took 3063 ms (client timeout 1724 ms). Trace:
W20260709 13:01:10.877177  2260 rpcz_store.cc:269] 0709 13:01:07.800950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.802835 (+  1885us) service_pool.cc:224] Handling call
0709 13:01:10.503149 (+2700314us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:10.864517 (+361368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24355072}
I20260709 13:01:10.864951  2258 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:01:10.846760  1603 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:10.847525  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 621) took 2049 ms. Trace:
I20260709 13:01:10.880587  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 620) took 1268 ms. Trace:
W20260709 13:01:10.845983  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47638.8us
I20260709 13:01:10.852777  5018 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.853963  4895 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.887250  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:10.718808  4320 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.874770  5095 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.880883  2259 rpcz_store.cc:276] 0709 13:01:08.798565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.772648 (+1974083us) service_pool.cc:224] Handling call
0709 13:01:10.773106 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.840881 (+ 67775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.847460 (+  6579us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:10.876578  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.868064  5153 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:10.889808  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.890292  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.857859  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 627) took 2038 ms. Trace:
I20260709 13:01:10.890865  2252 rpcz_store.cc:276] 0709 13:01:08.799936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.797903 (+1997967us) service_pool.cc:224] Handling call
0709 13:01:10.798360 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.838368 (+ 40008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.838568 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.886411  2257 rpcz_store.cc:276] 0709 13:01:08.799724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.793792 (+1994068us) service_pool.cc:224] Handling call
0709 13:01:10.794209 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.804948 (+ 10739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.808061 (+  3113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.874177  2255 rpcz_store.cc:276] 0709 13:01:09.476792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.840763 (+1363971us) service_pool.cc:224] Handling call
0709 13:01:10.872711 (+ 31948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.873582 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.873780 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.867915  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:10.881018  2254 rpcz_store.cc:276] 0709 13:01:09.611852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.644553 (+ 32701us) service_pool.cc:224] Handling call
0709 13:01:10.880209 (+1235656us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.880505 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404770688}
I20260709 13:01:10.899868  4320 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.901153  1609 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:10.805483  5105 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.908075  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:10.912040  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 617) took 2114 ms. Trace:
I20260709 13:01:10.912560  2258 rpcz_store.cc:276] 0709 13:01:08.797639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.685383 (+1887744us) service_pool.cc:224] Handling call
0709 13:01:10.859904 (+174521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:10.879413 (+ 19509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.908213 (+ 28800us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54004eb6d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:10.911962 (+  3749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400254720}
I20260709 13:01:10.915522  2254 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:10.895241  1432 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 5, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:10.924537  1680 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:10.858464  5112 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:10.927014  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:10.928171  1600 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.903931  4683 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:10.938014  1603 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:01:10.938611  1603 pending_rounds.cc:85] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:01:10.938879  1603 pending_rounds.cc:107] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:01:10.939103  1603 raft_consensus.cc:2889] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.941560  2257 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:10.948477  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.949381  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:10.950256  1681 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:10.952739  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 85009.4us
I20260709 13:01:10.919521  4778 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.913872  5153 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.963690  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:10.965114  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:10.965938  2252 pending_rounds.cc:85] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 6
I20260709 13:01:10.967062  2252 pending_rounds.cc:107] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:10.967401  2252 raft_consensus.cc:2889] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.967334  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60069.3us
I20260709 13:01:10.971467  1602 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:10.965726  4854 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.984702  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:10.986661  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:10.910120  5095 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.992000  4683 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:10.999984  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:10.963258  4933 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.009035  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:11.018765  5082 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:10.998458  4854 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.021878  1532 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:11.022912  5112 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:11.024940  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.025123  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2014) took 1060 ms. Trace:
I20260709 13:01:11.025521  1674 rpcz_store.cc:276] 0709 13:01:09.964976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.605881 (+640905us) service_pool.cc:224] Handling call
0709 13:01:10.606386 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.606997 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.607023 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.607669 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.921470 (+313801us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:10.921515 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.921591 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.024900 (+103309us) raft_consensus.cc:1685] finished
0709 13:01:11.024923 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.025064 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1278,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":29390,"thread_start_us":299805,"threads_started":1,"wal-append.queue_time_us":415008}
I20260709 13:01:11.027006  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.032749  2257 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:11.033460  2253 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:11.034375  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.035179  2254 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.035298  2260 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:11.035940  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 628) took 1556 ms. Trace:
I20260709 13:01:11.036233  2260 rpcz_store.cc:276] 0709 13:01:09.479206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.878431 (+1399225us) service_pool.cc:224] Handling call
0709 13:01:10.887795 (+  9364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.035059 (+147264us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540040c7a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:01:11.035702 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.035890 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106396544}
I20260709 13:01:11.045535  5077 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:11.033516  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:11.000867  4903 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.992374  4998 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.055130  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.025359  4933 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.037634  4956 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.067076  1607 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:11.050143  5112 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:10.996876  4778 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.075426  1604 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.076889  4934 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.079675  1601 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:11.080629  4840 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.081566  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.081964  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:11.086951  5105 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:11.101022  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.089015  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:11.023132  4854 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.052887  4895 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.053764  4903 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:11.087852  4956 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.016006  4950 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.093422  4934 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.123466  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:11.122710  1605 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
W20260709 13:01:11.122491  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 94333.3us
I20260709 13:01:11.126783  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.120456  4956 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.119645  4903 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.132175  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:11.136214  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.138824  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.150341  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.151006  1683 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.136662  5105 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.153798  4994 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.154527  1528 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:11.153687  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.157840  1528 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.175516  1605 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:11.180822  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.182528  4761 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.184965  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.186561  4761 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:11.165293  5010 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.008s
I20260709 13:01:11.178792  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.160173  4994 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:11.199707  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 637) took 1450 ms. Trace:
I20260709 13:01:11.200404  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:11.186941  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.200204  5010 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.171918  5105 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:11.200130  2256 rpcz_store.cc:276] 0709 13:01:09.749272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.529845 (+780573us) service_pool.cc:224] Handling call
0709 13:01:11.199466 (+669621us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54003a1e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:11.199648 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350402816}
I20260709 13:01:11.206636  1527 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.190702  5077 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.211771  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2013) took 1250 ms. Trace:
I20260709 13:01:11.187027  4761 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:11.221318  4761 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.221693  1432 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 7, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:11.213996  1527 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:11.215575  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 117280us
I20260709 13:01:11.220772  5146 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.218523  1682 rpcz_store.cc:276] 0709 13:01:09.960910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.603387 (+642477us) service_pool.cc:224] Handling call
0709 13:01:10.603999 (+   612us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:10.643599 (+ 39600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.643631 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.665144 (+ 21513us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.900501 (+235357us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.918398 (+ 17897us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.920003 (+  1605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.920116 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.207794 (+287678us) raft_consensus.cc:1685] finished
0709 13:01:11.207815 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.211701 (+  3886us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17622,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":12669,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":5587,"thread_start_us":234895,"threads_started":1,"wal-append.queue_time_us":442532}
I20260709 13:01:11.197304  4994 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:11.224258  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51169.8us
I20260709 13:01:11.226476  5048 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.227172  1527 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.227753  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.228691  1676 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [6.6-7.7]
I20260709 13:01:11.230371  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 1991) took 3379 ms. Trace:
I20260709 13:01:11.230798  5162 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 13:01:11.231106  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.231573  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 623) took 1572 ms. Trace:
I20260709 13:01:11.228533  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.231935  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.228468  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:11.223506  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 549) took 3806 ms (client timeout 1556 ms). Trace:
I20260709 13:01:11.238852  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:11.238407  2252 rpcz_store.cc:276] 0709 13:01:09.659102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.902234 (+1243132us) service_pool.cc:224] Handling call
0709 13:01:10.921849 (+ 19615us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:10.994618 (+ 72769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.994652 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:11.011961 (+ 17309us) log.cc:844] Serialized 78 byte log entry
0709 13:01:11.173418 (+161457us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:11.173459 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.173524 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.231332 (+ 57808us) raft_consensus.cc:1685] finished
0709 13:01:11.231352 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.231491 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":12272,"thread_start_us":140563,"threads_started":1,"wal-append.queue_time_us":196702}
I20260709 13:01:11.232486  4320 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:01:11.239240  1532 rpcz_store.cc:269] 0709 13:01:07.417436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.417848 (+   412us) service_pool.cc:224] Handling call
0709 13:01:11.204766 (+3786918us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:11.223439 (+ 18673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8185206144}
I20260709 13:01:11.227289  1432 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.269595  5105 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.187732  5021 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:11.225214  5077 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:11.277011  1674 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:11.236510  5112 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:11.287595  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.252971  4778 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.290047  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:11.237811  1679 rpcz_store.cc:276] 0709 13:01:07.792567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.190873 (+398306us) service_pool.cc:224] Handling call
0709 13:01:08.191198 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.198630 (+  7432us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:08.198665 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.199135 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.549432 (+2350297us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b180038fe60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:01:10.909768 (+360336us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.920768 (+ 11000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.925664 (+  4896us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.155101 (+229437us) raft_consensus.cc:1685] finished
0709 13:01:11.155282 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.171385 (+ 16103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6987,"raft.queue_time_us":7105,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":45753,"spinlock_wait_cycles":4781312,"thread_start_us":287948,"threads_started":1,"wal-append.queue_time_us":2757261}
I20260709 13:01:11.295475  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.296393  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:11.218611  5143 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.299402  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.297892  1605 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:11.285097  5077 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.299060  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:11.303217  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.304659  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.277498  5048 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:11.272535  4933 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:01:11.254182  4869 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:01:11.281868  1528 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.311210  5179 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.311028  4572 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:01:11.233024  4934 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.311064  2252 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.304651  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:11.320737  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:11.332648  1432 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 1 to 5, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:11.337848  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.335608  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80110.5us
I20260709 13:01:11.304126  4998 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:11.309442  4950 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.301841  5021 consensus_queue.cc:1243] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:11.353183  1528 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.301697  4989 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:11.355880  4934 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:11.362439  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61236.8us
I20260709 13:01:11.357348  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:11.332690  5112 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:11.393083  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 116916us
I20260709 13:01:11.403846  5146 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.404410  4869 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.404930  4869 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.404410  5146 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:11.405952  4869 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.407294  4869 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.407087  5146 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.408603  5146 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.409519  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63740us
I20260709 13:01:11.409742  5095 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.410604  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:11.411237  1574 leader_election.cc:400] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:11.412093  4572 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.412424  5175 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:11.413208  5175 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.413532  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:11.408608  5098 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:11.415494  5098 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.415665  5175 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.416888  5098 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.418335  5018 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:11.418812  5098 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.421644  5153 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.422284  5153 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:11.412571  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.429481  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 630) took 1942 ms. Trace:
I20260709 13:01:11.413007  4572 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.430414  5190 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:11.432600  5172 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:11.437278  5082 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.437291  5190 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:01:11.413091  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57440us
I20260709 13:01:11.427248  1432 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 6, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 6 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:11.437119  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:11.443239  1527 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.413154  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.447208  2252 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.412458  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:11.429368  5173 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:11.416970  5174 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:01:11.458221  1528 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:01:11.458822  1528 pending_rounds.cc:85] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 7
I20260709 13:01:11.459139  1528 pending_rounds.cc:107] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:01:11.459707  1528 raft_consensus.cc:2889] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.458495  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.462016  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.461133  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.464071  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:11.461463  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 117309us
I20260709 13:01:11.465405  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:11.466598  2256 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.439608  2259 rpcz_store.cc:276] 0709 13:01:09.488355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.893703 (+1405348us) service_pool.cc:224] Handling call
0709 13:01:10.925004 (+ 31301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.039654 (+114650us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:11.183880 (+144226us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.287282 (+103402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:11.287329 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:11.287364 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.428038 (+140674us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b18000f9ee0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419
0709 13:01:11.429171 (+  1133us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:11.429231 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.429382 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4608,"prepare.queue_time_us":175952,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":4751,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10707,"spinlock_wait_cycles":125305088,"thread_start_us":179301,"threads_started":2}
W20260709 13:01:11.484025  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.449966  5175 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.470023  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:11.483757  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 192672us
I20260709 13:01:11.497789  2255 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:11.362387  4998 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.511950  2253 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:01:11.461903  5143 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.468526  4933 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.514034  2253 pending_rounds.cc:85] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 6
I20260709 13:01:11.517453  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.482795  5181 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.519285  2253 pending_rounds.cc:107] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:01:11.419003  5018 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.520496  2253 raft_consensus.cc:2889] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:11.523824  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 86807.5us
I20260709 13:01:11.500562  5175 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:11.526795  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 114409us
W20260709 13:01:11.528115  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 207479us
I20260709 13:01:11.530558  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:11.547640  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.524415  5179 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:11.529695  5175 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:11.558612  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.565426  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 124000us
W20260709 13:01:11.566704  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46989.8us
I20260709 13:01:11.574561  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.581626  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.582335  1674 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:11.584661  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.584865  5179 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:11.588640  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63110us
I20260709 13:01:11.590656  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.591514  4778 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.593861  1683 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:11.595041  4998 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:11.595350  4840 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.598416  5184 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.598954  5184 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.535352  4572 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:01:11.600968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.573599  5101 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.604583  1675 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:11.606316  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.607709  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:11.607908  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.608392  1675 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.609011  4683 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.621824  4778 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.622040  4683 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.593909  5153 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.622071  5018 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:11.623092  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.622784  4778 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.623996  4683 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.625560  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 607) took 3827 ms. Trace:
I20260709 13:01:11.621632  5082 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:01:11.623248  5196 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.611018  5101 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.616654  5188 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:11.599881  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:11.627228  5196 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.621423  5021 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:11.631626  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 87244.5us
I20260709 13:01:11.632202  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:11.622382  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84004.5us
I20260709 13:01:11.642283  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:11.642525  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.600838  5186 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:11.652760  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.625694  4683 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.659300  1528 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.516783  5048 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.663173  1533 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:11.627555  5188 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:11.628719  2261 rpcz_store.cc:276] 0709 13:01:07.797600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.869089 (+ 71489us) service_pool.cc:224] Handling call
0709 13:01:09.920552 (+2051463us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b58000e3a98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:10.528477 (+607925us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:10.966600 (+438123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.966631 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.991732 (+ 25101us) log.cc:844] Serialized 52 byte log entry
0709 13:01:11.121186 (+129454us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:11.121231 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.125457 (+  4226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.576999 (+451542us) raft_consensus.cc:1685] finished
0709 13:01:11.577018 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.625147 (+ 48129us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54005c2e50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:11.625285 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38670,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":235,"spinlock_wait_cycles":1415164416,"thread_start_us":562169,"threads_started":2,"wal-append.queue_time_us":240092}
I20260709 13:01:11.669400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.670200  1680 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:11.630754  5021 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:11.683079  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.650876  4840 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.661397  5186 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.630100  4956 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.658358  5101 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:01:11.693260  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 115455us
I20260709 13:01:11.695045  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.599859  5184 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.723181  1678 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:11.669473  5188 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.682230  5196 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.746097  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
W20260709 13:01:11.747006  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83170.1us
I20260709 13:01:11.747920  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.749104  1529 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:11.698344  4840 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:11.772432  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46339.4us
W20260709 13:01:11.766188  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114061us
W20260709 13:01:11.776569  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50624.4us
W20260709 13:01:11.767095  4761 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.003s
I20260709 13:01:11.775725  4320 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.773357  5015 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.003s
I20260709 13:01:11.722265  5018 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:11.697499  5077 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.750172  4950 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:11.766563  5146 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.796634  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.801892  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:11.803560  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.805486  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:11.802742  1525 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
W20260709 13:01:11.821442  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 155877us
I20260709 13:01:11.822228  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:11.820063  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 245681us
I20260709 13:01:11.825301  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:11.834316  1681 raft_consensus.cc:2410] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:11.844453  4320 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.804508  4998 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:11.816725  5098 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.802112  5192 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.789652  4761 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.800127  5015 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:11.865612  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62115.3us
I20260709 13:01:11.868023  4320 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:11.865343  4998 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.870411  5054 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.871919  5179 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.872469  5189 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:11.873167  5098 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:11.874364  4956 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.874284  1527 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:11.857697  5195 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:11.897369  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75224.8us
I20260709 13:01:11.817078  5095 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:01:11.858605  4903 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
W20260709 13:01:11.891115  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 72516.1us
W20260709 13:01:11.894657  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 78897us
I20260709 13:01:11.895526  4320 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:11.886684  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:11.862969  5181 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.897831  1527 pending_rounds.cc:85] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 6
I20260709 13:01:11.821964  4950 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.918097  1527 pending_rounds.cc:107] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:11.803864  4840 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.810220  5021 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.918504  1527 raft_consensus.cc:2889] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:11.910223  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45364.9us
I20260709 13:01:11.929311  5185 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:01:11.930575  5077 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.918788  4903 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.933226  4903 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.934067  4998 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:11.935465  5202 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:11.918012  5146 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.936559  5146 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.936951  5146 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.802343  5194 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:11.940469  5204 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.941149  5204 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:11.941587  5204 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.944967  5098 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.946929  5208 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.947695  5208 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.950058  4950 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.950424  5208 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:11.951587  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 126390us
W20260709 13:01:11.953084  4994 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.004s
I20260709 13:01:11.952803  5207 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.916709  5054 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.956921  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.957551  5054 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:11.953541  4994 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:11.803102  5186 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:11.969681  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.956897  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:11.972589  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49898.1us
I20260709 13:01:11.986774  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:11.972452  4320 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:11.972362  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:11.972219  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46753.4us
I20260709 13:01:11.988895  2261 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.991973  1682 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:11.991796  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:11.991838  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:11.993005  2255 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.998497  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.930847  5162 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.952180  5015 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.018047  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:12.018675  4934 consensus_meta.cc:287] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.002s
I20260709 13:01:11.976348  4903 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:12.020555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:11.969514  5220 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.022782  1678 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:11.973407  5184 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.024250  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:11.972015  5021 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.026985  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:12.015969  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:12.032284  5195 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.033043  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.037209  1609 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.039445  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:12.040297  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.040666  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.049909  1602 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:11.974274  4761 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:11.974504  5181 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.044013  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.015098  5162 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:12.063858  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:11.978082  4895 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:11.978292  5179 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:12.069576  1608 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.055450  5018 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.029258  5220 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:12.077077  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:12.077405  5220 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.079311  5220 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.080719  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.081238  5018 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.081756  5018 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.081911  5054 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:12.081965  4934 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:12.083827  5018 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.084478  5095 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:12.084929  5095 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:12.085165  4934 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:12.085871  5095 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.086437  5054 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:12.086863  5054 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:12.087280  5095 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.087700  5054 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.064942  4998 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.089284  4998 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.089730  5054 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.092708  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:12.079349  4869 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.093477  5082 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.971946  5212 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
W20260709 13:01:12.104367  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44987.2us
I20260709 13:01:12.105294  1606 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:12.095031  1605 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:12.105655  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:12.109913  5195 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.113688  4998 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.116042  5209 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:12.116582  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.116915  5218 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.151711  4869 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:12.079447  5197 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.152463  4869 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.121616  4956 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:12.153355  4956 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:12.154269  4956 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.154804  4869 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.107236  4320 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:01:12.069696  5015 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:12.137569  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 121737us
I20260709 13:01:12.107057  4854 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.147794  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:12.149871  1527 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.150473  1532 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:12.129299  1680 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:12.157856  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.136870  4778 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:12.167785  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 362843us
I20260709 13:01:12.167737  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.171512  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.159698  4956 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.188516  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:12.175621  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.158473  5048 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.175119  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:12.173188  4994 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.160015  5209 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.170336  5208 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:12.096993  5181 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.230682  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.196229  5212 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:12.235232  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59703.4us
I20260709 13:01:12.222193  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:12.236047  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.194402  5048 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.196516  5190 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.153064  5197 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.260800  1605 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:12.173969  4778 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.231890  5082 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.261842  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.162499  5162 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.232738  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:12.264968  1528 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.285830  5190 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:12.286490  5112 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:12.286971  5190 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.286906  5112 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:12.289559  5222 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:12.291060  5181 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:12.293175  4683 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.002s
I20260709 13:01:12.295220  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:12.296183  2259 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:12.296551  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.297773  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.299477  1533 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:12.296204  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.301265  2254 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:12.223183  4903 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.302829  1532 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:12.285274  1606 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.257354  5048 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.323923  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.325191  2255 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:01:12.330658  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:12.338359  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:12.363308  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:12.366536  1681 pending_rounds.cc:85] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 5
I20260709 13:01:12.366888  1681 pending_rounds.cc:107] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:12.367105  1681 raft_consensus.cc:2889] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.258472  5208 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.381938  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:12.288499  5207 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.286851  5210 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.301797  4778 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.396440  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.396617  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:12.274024  5217 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.367071  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:12.261221  5212 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.391153  1606 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:12.393669  5239 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.397465  1605 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:12.314904  4840 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:12.288599  5112 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.407302  1527 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:12.380422  5095 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.283488  5082 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.401088  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:12.387512  4994 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.425801  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.450904  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.523910  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:12.426622  1532 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:12.412792  5018 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:12.529500  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 160168us
I20260709 13:01:12.530509  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.533238  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 130759us
W20260709 13:01:12.547230  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 141471us
I20260709 13:01:12.569998  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:12.571147  2260 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:01:12.572969  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 209720us
W20260709 13:01:12.581933  5194 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.003s
I20260709 13:01:12.521756  4761 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:01:12.426306  5095 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.587395  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.522491  5105 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:01:12.546298  5195 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.568714  4778 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:12.423635  5217 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.423653  4840 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.576388  5181 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.528033  4994 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.654865  4778 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:12.422775  5207 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.418974  5239 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.575054  5018 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:01:12.664927  5231 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:01:12.665300  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.662743  5200 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:12.666698  5209 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.683830  1676 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.680804  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
W20260709 13:01:12.666297  5232 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:01:12.666301  4778 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.667173  5210 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.666914  4994 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.720752  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.703274  5184 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.656s	user 0.006s	sys 0.006s
I20260709 13:01:12.678812  5248 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.703413  5195 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.727419  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.726745  5247 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.740589  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 191931us
W20260709 13:01:12.745852  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 171196us
I20260709 13:01:12.722232  5197 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.678462  5181 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.755651  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.759251  1534 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:12.763465  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.773288  1680 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.002s
I20260709 13:01:12.774474  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.775309  1526 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:12.763445  5208 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.746735  5195 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.766285  2255 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:12.832468  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:12.838456  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 90183.8us
I20260709 13:01:12.839695  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.853787  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:12.851629  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110079us
I20260709 13:01:12.854607  1526 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:12.873032  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.839818  5217 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.874954  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.877710  1526 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:12.870472  5241 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.877800  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:12.866919  5095 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:12.875999  5225 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:01:12.901357  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:12.904985  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:12.905841  1680 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:12.908584  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 327693us
I20260709 13:01:12.897634  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:12.881950  5226 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
W20260709 13:01:12.882366  5229 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 13:01:12.880573  5207 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.751822  5247 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.924412  5247 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.838267  5255 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:01:12.880100  5241 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.927706  5241 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:12.925259  5197 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.928639  5197 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.929728  5181 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.931007  5197 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:12.931660  5204 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.990s	user 0.012s	sys 0.001s
I20260709 13:01:12.932111  5204 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.934427  5204 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.935088  1675 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.885761  5249 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:12.936951  1676 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:01:12.909899  5146 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.973s	user 0.004s	sys 0.009s
I20260709 13:01:12.937798  5146 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.939903  5146 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:12.910961  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:12.912380  5188 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.137s	user 0.013s	sys 0.000s
W20260709 13:01:12.915624  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.961133  1534 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.965351  1525 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:12.915629  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:12.910120  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:12.910172  1526 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:12.913043  5239 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:12.898624  4840 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:12.967450  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57517.8us
W20260709 13:01:12.920269  5234 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:12.725010  5210 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:12.920475  5175 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.289s	user 0.015s	sys 0.011s
I20260709 13:01:12.969000  1680 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:12.735831  5248 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:12.974664  5253 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.006s
I20260709 13:01:12.982656  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:12.983542  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:12.940894  5082 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:12.978470  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 126972us
I20260709 13:01:12.972512  5197 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.988600  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:12.989226  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 99949.4us
I20260709 13:01:12.992383  1680 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.991645  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.993667  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:12.997670  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 570) took 1879 ms. Trace:
I20260709 13:01:12.995504  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:12.961066  5188 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:12.999243  1529 rpcz_store.cc:276] 0709 13:01:11.113661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.113845 (+   184us) service_pool.cc:224] Handling call
0709 13:01:12.992822 (+1878977us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400343ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:12.992973 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434313984}
I20260709 13:01:13.003331  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:12.980156  5175 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:12.995827  5241 raft_consensus.cc:2764] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:13.014267  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.020258  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1873) took 1368 ms. Trace:
I20260709 13:01:13.020702  1679 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:13.020874  1677 rpcz_store.cc:276] 0709 13:01:11.651506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.651625 (+   119us) service_pool.cc:224] Handling call
0709 13:01:11.665915 (+ 14290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.819380 (+153465us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:12.007883 (+188503us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.174113 (+166230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.192664 (+ 18551us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.192805 (+   141us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:12.192839 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.192909 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.020003 (+827094us) raft_consensus.cc:1685] finished
0709 13:01:13.020025 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.020188 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36707,"prepare.queue_time_us":195310,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":182747,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":36280,"thread_start_us":376532,"threads_started":3,"wal-append.queue_time_us":205512}
I20260709 13:01:13.022344  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.023690  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:13.011917  4956 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.825s	user 0.006s	sys 0.003s
I20260709 13:01:13.023932  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.026640  1677 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:12.990782  5270 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:01:13.039454  5210 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.040606  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.041821  5188 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:13.043220  5015 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.001s
W20260709 13:01:13.046983  4903 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.003s
I20260709 13:01:13.047535  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:13.049268  5263 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:13.015976  5220 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.936s	user 0.004s	sys 0.005s
I20260709 13:01:13.059011  5212 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:13.060124  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66557.9us
I20260709 13:01:13.060639  1526 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:13.061825  1533 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:13.016675  5248 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.064365  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 638) took 1040 ms. Trace:
I20260709 13:01:13.064807  2256 rpcz_store.cc:276] 0709 13:01:12.023802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.029444 (+  5642us) service_pool.cc:224] Handling call
0709 13:01:12.056178 (+ 26734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.056467 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:12.239245 (+182778us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.734212 (+494967us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.932094 (+197882us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.063973 (+131879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.064030 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:13.064081 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.064159 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.064277 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182088,"prepare.queue_time_us":498737,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":132,"raft.queue_time_us":177605,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13302,"spinlock_wait_cycles":3448576,"thread_start_us":783549,"threads_started":5,"wal-append.queue_time_us":178021}
I20260709 13:01:13.066780  4854 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:13.067312  4854 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.062374  5249 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:13.068162  5249 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:13.069267  5249 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.061729  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.073179  5195 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.073612  5270 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:13.074815  5021 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.021s	user 0.000s	sys 0.011s
I20260709 13:01:13.009572  4869 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:13.097762  1681 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:13.101634  4869 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:13.117381  4869 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:13.118184  5203 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.196s	user 0.001s	sys 0.004s
I20260709 13:01:13.043627  5015 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.119370  1605 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:13.124408  1534 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:12.995926  5269 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:01:13.102156  4903 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:13.180660  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119005us
W20260709 13:01:13.175895  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 188376us
I20260709 13:01:13.179586  1677 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:13.181313  1529 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:13.187780  1680 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:01:13.178396  5230 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
W20260709 13:01:13.187536  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.816s (SENT) [suppressed 29 similar messages]
I20260709 13:01:13.193070  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.197844  1526 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:13.186118  5112 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.200471  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.200989  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.200368  5265 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:13.204282  5268 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:01:13.176260  5243 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:13.216552  1607 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.187443  5175 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:13.192808  5048 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.005s
I20260709 13:01:13.221885  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.226639  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.227330  5243 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.230494  5243 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.231189  5048 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.232934  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.233827  5048 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.234963  1674 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:13.225059  5265 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.227375  1530 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:13.237972  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.238497  5265 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.236650  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.244269  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.238803  1530 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:13.249115  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.250456  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.250406  1607 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.251964  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.252240  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2171) took 1181 ms. Trace:
I20260709 13:01:13.252791  1602 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:13.249115  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.254213  1601 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:13.252585  1607 rpcz_store.cc:276] 0709 13:01:12.070828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.200732 (+1129904us) service_pool.cc:224] Handling call
0709 13:01:13.252176 (+ 51444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.267068  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.269160  1607 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:13.273944  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.254868  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.276437  1530 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:13.220539  4778 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.280866  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.282836  1603 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:13.283987  1606 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:13.286260  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.286931  1526 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:13.287743  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.288228  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.285233  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.271461  5175 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:13.293841  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.295459  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.295529  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.297719  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:13.297797  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.300868  1604 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:13.302693  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.299979  5015 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.305189  5015 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.307720  5015 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.304237  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.309616  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.310248  1530 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:13.310878  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.311570  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.315496  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.318368  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.317329  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.319279  1678 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:13.319695  4572 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.320061  4778 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.320350  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.320585  4934 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.321244  4934 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.321489  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.313817  5143 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.322335  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.322575  5195 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.322759  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.323091  5185 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.323509  5185 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.300227  5175 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.323880  5185 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.325124  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.326910  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 1976) took 1199 ms. Trace:
I20260709 13:01:13.327312  1531 rpcz_store.cc:276] 0709 13:01:12.127815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.127961 (+   146us) service_pool.cc:224] Handling call
0709 13:01:12.136552 (+  8591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.152371 (+ 15819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.152406 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.152468 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:12.152504 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.326648 (+1174144us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b540008d9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:13.326700 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.326823 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35790080}
I20260709 13:01:13.329767  5237 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:13.330385  5237 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.351287  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.339874  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.330480  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 580) took 1030 ms. Trace:
I20260709 13:01:13.356662  1533 rpcz_store.cc:276] 0709 13:01:12.302001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.323554 (+ 21553us) service_pool.cc:224] Handling call
0709 13:01:13.330275 (+1006721us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400266bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:13.330417 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694372096}
I20260709 13:01:13.356067  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.333719  5162 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.359138  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.332240  5185 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.359987  1533 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:13.360957  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.362251  5185 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.362416  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.333307  5220 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:13.363999  5220 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.364480  5246 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.357594  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.316644  4761 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:13.322255  5143 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:13.395012  5143 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.379683  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.364522  4933 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:13.377468  5246 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.340173  5195 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.387732  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 581) took 1145 ms. Trace:
I20260709 13:01:13.373487  4934 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:13.392899  5237 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.364645  5220 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:13.403297  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.315079  5015 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.414255  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.415163  1680 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:13.406222  1530 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:13.339107  5179 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.416600  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.413987  5220 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:13.411867  5195 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.410748  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.383265  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.410326  1608 rpcz_store.cc:276] 0709 13:01:12.250477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.144987 (+894510us) service_pool.cc:224] Handling call
0709 13:01:13.145516 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.175578 (+ 30062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.175612 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.198381 (+ 22769us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.282546 (+ 84165us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:13.282597 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.282663 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.387459 (+104796us) raft_consensus.cc:1685] finished
0709 13:01:13.387484 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.387662 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13097,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1874,"thread_start_us":54879,"threads_started":1,"wal-append.queue_time_us":165490}
I20260709 13:01:13.409385  5246 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.383229  4854 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.412102  4761 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:13.411739  4778 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:13.426311  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.427022  1604 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:13.410504  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.430857  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.431535  1606 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.431229  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 648) took 1092 ms. Trace:
I20260709 13:01:13.427085  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.432190  2260 rpcz_store.cc:276] 0709 13:01:12.338852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.339011 (+   159us) service_pool.cc:224] Handling call
0709 13:01:13.431071 (+1092060us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54008002d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:13.431180 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425562496}
I20260709 13:01:13.432792  1530 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.434190  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.435586  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:13.428247  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88469.2us
I20260709 13:01:13.429035  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.432657  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.439013  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.439127  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.440177  1604 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.425254  5246 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.441835  1531 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:13.442169  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.429021  5197 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.457063  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.457510  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.437536  5015 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.443545  5259 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.466812  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.472872  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.472908  1531 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:13.434262  4778 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.474762  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.477126  1680 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:13.476254  1605 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:13.472289  1606 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.443707  4933 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:13.484709  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.501463  1609 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:13.502558  1609 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.503829  1609 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:13.484825  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.485694  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.505041  1608 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.497468  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.509030  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:13.494216  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:13.496359  5240 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.765s	user 0.002s	sys 0.000s
I20260709 13:01:13.435144  5220 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.497917  4761 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.472998  5237 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.498492  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.488658  5289 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.515547  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.465322  5197 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.518756  1605 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.493988  5288 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.521059  1530 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:13.500228  4778 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.522369  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:13.511544  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72519us
I20260709 13:01:13.512002  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.511916  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.526087  1527 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:13.511770  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.527796  4934 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.528542  4934 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.529147  4934 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.530932  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:13.533226  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 914) took 1393 ms. Trace:
I20260709 13:01:13.533643  2253 rpcz_store.cc:276] 0709 13:01:12.140218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.140408 (+   190us) service_pool.cc:224] Handling call
0709 13:01:12.145199 (+  4791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.302128 (+156929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.302161 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.302199 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:12.302228 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.532956 (+1230728us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540039c6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:13.533020 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.533157 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360333696}
I20260709 13:01:13.513307  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:13.519780  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.536222  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.536428  5018 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.537504  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.542994  4934 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.545212  5259 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:13.549063  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:13.549714  5194 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:13.550100  5194 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:13.550838  5194 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.554893  5256 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.523077  1531 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:13.537335  4994 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:13.557366  1680 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.563675  1526 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:13.564203  1530 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:13.564762  1528 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:13.565965  1604 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.555475  5256 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:13.517741  5289 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.567982  5256 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:13.569408  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.569869  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.562760  5197 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.570843  5197 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.572391  5288 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:13.572896  5288 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.522405  5146 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:13.574965  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:13.575419  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.576040  5288 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.573029  1533 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:13.562784  4994 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:13.578812  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 917) took 1340 ms. Trace:
I20260709 13:01:13.575531  2257 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.579406  5272 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.573115  5197 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.580619  2252 rpcz_store.cc:276] 0709 13:01:12.238366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.238510 (+   144us) service_pool.cc:224] Handling call
0709 13:01:12.242132 (+  3622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.268445 (+ 26313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.268478 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.272872 (+  4394us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.568182 (+295310us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.568236 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.568383 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.495711 (+927328us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:13.578548 (+ 82837us) raft_consensus.cc:1685] finished
0709 13:01:13.578567 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.578757 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2971,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12045,"spinlock_wait_cycles":30610688,"thread_start_us":201589,"threads_started":1,"wal-append.queue_time_us":415567}
I20260709 13:01:13.574784  5146 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.552152  5194 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.570624  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.573429  5175 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.592062  1602 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:13.593545  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.579876  5272 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.579169  4994 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.595266  4994 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.596695  4933 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.597505  4933 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.598599  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1875) took 1643 ms. Trace:
I20260709 13:01:13.599025  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:13.598976  1675 rpcz_store.cc:276] 0709 13:01:11.955237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.958067 (+  2830us) service_pool.cc:224] Handling call
0709 13:01:11.958361 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.935509 (+977148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.598337 (+662828us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540007dad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:13.598539 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245801856}
I20260709 13:01:13.600652  5201 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:13.601043  5201 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:13.586433  5195 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.588029  4934 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.584009  4895 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.601828  5201 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.602636  4895 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.603963  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1879) took 1633 ms. Trace:
I20260709 13:01:13.604358  1679 rpcz_store.cc:276] 0709 13:01:11.970541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.971678 (+  1137us) service_pool.cc:224] Handling call
0709 13:01:11.971966 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.034145 (+1062179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.603736 (+569591us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003575d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:13.603903 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411434368}
I20260709 13:01:13.605101  4895 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.589411  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.605471  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:13.606071  1679 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.606551  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.607539  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.608490  4903 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.608780  5175 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.609015  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2035) took 1244 ms. Trace:
I20260709 13:01:13.608353  5181 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.612766  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.613505  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2029) took 1283 ms. Trace:
I20260709 13:01:13.613948  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:13.614163  2260 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:13.614779  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:13.615391  2256 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.621002  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.621944  2258 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:13.622550  2252 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.577786  4869 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:13.591017  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.568243  5289 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.623597  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.612689  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.609375  1674 rpcz_store.cc:276] 0709 13:01:12.364392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.569630 (+205238us) service_pool.cc:224] Handling call
0709 13:01:13.608791 (+1039161us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54003b97d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:13.608935 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526563712}
I20260709 13:01:13.614182  1676 rpcz_store.cc:276] 0709 13:01:12.330175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.330295 (+   120us) service_pool.cc:224] Handling call
0709 13:01:13.613361 (+1283066us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540032a5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:13.613454 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810283264}
I20260709 13:01:13.523556  5220 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.645020  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:13.645627  1676 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.643790  1604 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.650190  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:13.650441  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.654198  2253 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:13.635573  2256 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:13.637210  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.699466  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.593914  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.701097  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.637861  1530 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:13.657820  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.602813  5201 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.707988  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.708482  5266 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.708668  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.709143  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.709383  1528 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:13.710223  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.661399  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.712630  2260 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:13.713516  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.714262  1607 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:13.519680  5237 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.716276  5237 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.716836  1683 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:13.636564  4933 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.667048  2254 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:13.642880  5246 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.723673  5272 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:13.667977  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:13.636409  5270 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:13.643770  5162 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:13.732340  1679 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:13.736178  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.736896  1680 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.738164  1680 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:13.739126  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.672456  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.740023  1526 raft_consensus.cc:2368] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8.
W20260709 13:01:13.689482  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 90526.6us
I20260709 13:01:13.739984  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.685207  4572 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.741938  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.742372  1679 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:13.672631  5143 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:13.744377  2226 leader_election.cc:400] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8.
I20260709 13:01:13.684859  5288 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:13.744706  2226 leader_election.cc:403] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.739248  2257 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:13.671352  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:13.747870  5277 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.749199  5297 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:13.750824  5206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.006s	sys 0.007s
W20260709 13:01:13.751219  5206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.007s	sys 0.007s
W20260709 13:01:13.743788  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 286333us
I20260709 13:01:13.690521  5195 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.755564  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.756562  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:13.758487  2253 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:13.755010  5095 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.761641  5288 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.762128  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:13.761215  1526 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:13.764032  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:13.755458  5101 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.780061  1532 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:13.762655  5255 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.788811  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:13.783010  5101 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:13.792682  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:13.744875  5162 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.794802  1606 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:13.797369  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.740024  5270 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.758086  4572 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.804189  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.804924  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.809840  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.812539  1600 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.740288  5266 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.811240  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:13.815343  1607 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.811888  1534 raft_consensus.cc:2368] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:01:13.815847  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.791091  4950 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.790803  5101 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.819952  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:13.821353  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.797227  5293 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:13.800788  5195 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.820799  5256 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:13.836790  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.837299  1533 raft_consensus.cc:2376] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8. Re-sending same reply.
I20260709 13:01:13.826854  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.821017  4895 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:01:13.829717  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.831193  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.831563  5277 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:13.833461  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 243327us
I20260709 13:01:13.854866  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:13.834012  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 249395us
I20260709 13:01:13.834379  4854 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.834784  5188 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:13.835573  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 207527us
I20260709 13:01:13.844661  1531 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:13.851873  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.811599  5112 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:01:13.859457  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.897782  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.836126  5248 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.847405  1526 raft_consensus.cc:2376] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9. Re-sending same reply.
I20260709 13:01:13.898991  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.894042  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.901496  1607 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:13.903030  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.904881  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:13.875566  5292 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:13.905529  1526 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:13.845752  5146 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.905128  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.913520  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:13.902518  5291 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:01:13.902674  5253 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:13.915207  1526 raft_consensus.cc:2376] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10. Re-sending same reply.
I20260709 13:01:13.917512  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:13.923615  1602 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:13.915126  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:13.925990  1532 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.926789  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:13.915304  5101 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:13.958295  5270 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.958839  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:13.959520  5101 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:13.855687  5293 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:13.960701  5301 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:01:13.961073  1674 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:13.962374  5293 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:13.965153  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.904429  4933 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.966326  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:13.957502  4903 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.914101  5175 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:13.912940  5077 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:14.000023  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 71535.3us
I20260709 13:01:14.052006  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:14.051376  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:14.003978  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56552.6us
I20260709 13:01:14.000259  1528 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:14.052956  1525 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:13.902594  5194 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:01:13.898226  5185 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:01:13.960181  5269 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.904501  5095 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:01:14.056751  1603 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:01:13.962301  5251 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.013197  4903 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.066013  1603 pending_rounds.cc:85] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 6
I20260709 13:01:13.914147  5248 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.062981  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:14.064759  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 208323us
I20260709 13:01:14.069965  1603 pending_rounds.cc:107] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:01:14.049422  4933 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:14.076576  1603 raft_consensus.cc:2889] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.076025  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:14.077049  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:14.056655  4934 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.083446  1525 raft_consensus.cc:2376] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7. Re-sending same reply.
I20260709 13:01:14.057670  5246 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.090183  1534 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:14.062958  5175 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:14.066516  5077 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:14.099697  1679 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:14.073777  4903 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.106771  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:14.110363  1525 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.114259  1533 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:14.076699  5269 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:14.101432  5188 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:14.151108  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 387522us
W20260709 13:01:14.147571  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 292753us
W20260709 13:01:14.068949  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 304997us
I20260709 13:01:14.162246  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:14.161319  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:14.157560  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:14.075201  5251 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.174579  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.175027  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:14.098860  4934 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.207435  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:14.208815  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:14.169919  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:14.121593  5162 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:14.205863  5308 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:01:14.205690  5303 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:01:14.149816  5188 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.228835  5246 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.147879  5288 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.203689  5082 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.251672  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:14.265116  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.121887  4761 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:01:14.270222  1528 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:14.248347  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.252539  5181 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.274737  2254 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:14.284701  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.268702  5238 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:14.279428  5304 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:01:14.291108  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.291817  5018 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.293826  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:14.291133  2253 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:14.285265  5298 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 13:01:14.277657  5188 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.226429  4933 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.281905  5181 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:14.300494  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.208920  5322 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:01:14.316109  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 217724us
I20260709 13:01:14.316249  1600 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:14.303572  4869 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:14.292397  5238 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:14.310163  5309 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:14.295467  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.297974  5316 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.307461  5181 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.274454  5077 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.302944  5321 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.346269  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:14.352401  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57120.6us
I20260709 13:01:14.303730  5146 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:14.351202  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.321707  5248 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.288687  5175 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.363925  1532 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:14.364867  5323 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:14.370369  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:14.369354  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 160498us
I20260709 13:01:14.351821  4869 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:14.376822  5244 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:01:14.377195  4869 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.378922  5329 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:14.284853  5269 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.377765  5244 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:14.360957  5018 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:14.355608  5321 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:14.391397  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 221569us
I20260709 13:01:14.395859  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:14.365270  5311 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:01:14.391181  5321 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.406054  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 1998) took 1218 ms. Trace:
I20260709 13:01:14.406494  1527 rpcz_store.cc:276] 0709 13:01:13.187829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.526856 (+339027us) service_pool.cc:224] Handling call
0709 13:01:13.727760 (+200904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.727976 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.728001 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.734850 (+  6849us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.934264 (+199414us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.934300 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.934372 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.404877 (+470505us) raft_consensus.cc:1685] finished
0709 13:01:14.404896 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.405806 (+   910us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54003052d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:14.405994 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461351296,"thread_start_us":171765,"threads_started":1,"wal-append.queue_time_us":357660}
I20260709 13:01:14.407656  5311 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.391080  4895 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:14.408290  5311 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.390399  5018 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.409250  4895 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.409793  5018 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.383615  5179 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:01:14.411288  5311 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.383566  5244 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:14.393442  5317 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:01:14.380174  5323 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:14.417598  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 212813us
I20260709 13:01:14.368795  5249 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:14.403163  5310 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.430728  1683 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:14.431454  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.434022  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.401540  5251 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.435992  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:14.444243  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 286774us
W20260709 13:01:14.450963  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.452608  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.453379  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:14.453601  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:14.454990  5326 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.455483  5326 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:14.455891  5326 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.460665  1527 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:14.446373  5265 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:14.462345  1603 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:14.445333  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69175.9us
I20260709 13:01:14.412524  4934 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.468060  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.468905  2257 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:01:14.469287  5315 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:01:14.470762  5320 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:01:14.472102  5325 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:01:14.472998  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 485) took 1138 ms. Trace:
I20260709 13:01:14.473186  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:14.473466  1681 rpcz_store.cc:276] 0709 13:01:13.334185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.611537 (+277352us) service_pool.cc:224] Handling call
0709 13:01:13.611931 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:13.834478 (+222547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.834521 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.835036 (+   515us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.050808 (+215772us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.050879 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.102357 (+ 51478us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.472756 (+370399us) raft_consensus.cc:1685] finished
0709 13:01:14.472773 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.472935 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222150,"raft.queue_time_us":229679,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14548,"thread_start_us":215193,"threads_started":1,"wal-append.queue_time_us":287351}
I20260709 13:01:14.475934  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2045) took 1164 ms. Trace:
I20260709 13:01:14.480180  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:14.485342  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.487110  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:14.494859  1679 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [6.6-7.7]
I20260709 13:01:14.476445  1678 rpcz_store.cc:276] 0709 13:01:13.311532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.577252 (+265720us) service_pool.cc:224] Handling call
0709 13:01:13.577529 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.832097 (+254568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.832128 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.832721 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.160913 (+328192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.160955 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.161037 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.475674 (+314637us) raft_consensus.cc:1685] finished
0709 13:01:14.475699 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.475864 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254210,"raft.queue_time_us":255463,"spinlock_wait_cycles":14834944,"thread_start_us":327820,"threads_started":1,"wal-append.queue_time_us":470375}
I20260709 13:01:14.505453  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:14.511046  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.512861  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:14.468520  5313 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 13:01:14.515722  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.516423  1603 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:14.442762  5310 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:14.523624  2254 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:14.518770  4934 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.561201  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:14.566238  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 391265us
W20260709 13:01:14.572598  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 174678us
I20260709 13:01:14.511507  4840 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:01:14.537181  5310 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:14.583249  5327 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:14.588552  5244 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.589511  5220 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:14.590085  5322 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.593912  5323 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:14.599328  5255 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.000s
I20260709 13:01:14.543503  5336 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.555001  5316 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.561183  4934 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.608767  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.608848  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.624706  1525 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:14.584224  4895 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.604749  4761 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:14.609434  5220 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:14.610452  5146 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.636708  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.644899  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:14.630865  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 260554us
I20260709 13:01:14.617049  5322 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:14.618520  5082 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.647068  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.619282  5238 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.650419  5238 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.650909  5077 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.651362  5238 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.651907  5238 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.650373  4933 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.657538  4933 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.652288  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:14.652299  5238 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.659906  5077 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.660298  5077 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.660741  5077 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.663666  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.667762  4933 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.668397  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.669085  5077 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.673065  5077 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:14.639636  4761 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:14.666512  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:14.704469  5306 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:14.704921  5077 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.630499  5255 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8.
I20260709 13:01:14.642869  5311 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.705231  5330 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.636919  4934 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.718796  5220 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.637274  5316 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.723119  5316 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:14.725852  5289 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.061s	user 0.010s	sys 0.001s
I20260709 13:01:14.726536  5289 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:14.727222  2260 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:14.727749  1529 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:14.728814  5018 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.730262  5322 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.731631  5322 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.676913  5146 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.734911  5077 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.730836  5018 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.734946  5146 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.751680  5321 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.754398  5321 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.755391  5289 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:14.760643  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 94186.8us
I20260709 13:01:14.764801  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.768994  1676 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:14.701560  4761 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.778869  1678 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:14.777349  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.780267  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:14.779723  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.803416  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.804358  1681 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:14.807307  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:14.812559  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:14.814772  1678 raft_consensus.cc:606] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.817911  1678 raft_consensus.cc:614] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:14.817834  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.782939  5077 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.822638  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.823755  1683 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:01:14.776214  5201 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.834489  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:14.774058  5329 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:14.813396  4903 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.001s
I20260709 13:01:14.851917  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:14.852856  1607 raft_consensus.cc:2368] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
I20260709 13:01:14.705757  5330 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.861829  1605 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:14.870267  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:14.863143  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:14.874605  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67332.4us
I20260709 13:01:14.870014  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:14.859473  5188 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
W20260709 13:01:14.879060  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 234215us
I20260709 13:01:14.886245  1601 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:14.890381  1677 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:14.846009  5342 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:14.901343  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83604.9us
I20260709 13:01:14.902184  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.899710  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:14.859790  5345 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.879755  5343 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.196s	user 0.003s	sys 0.000s
I20260709 13:01:14.913815  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:14.912214  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.915225  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.912644  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.860253  4903 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.864283  5238 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.899315  5256 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.874104  5334 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:14.918040  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.934623  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:14.935478  1601 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:14.895637  5188 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.935293  2252 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:01:14.938444  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:14.937621  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:14.939138  2252 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:14.940474  1682 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.944599  1602 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:14.899106  5326 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.904567  5212 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:14.951481  2255 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:14.920843  5311 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.908655  5353 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:14.957403  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55298.3us
I20260709 13:01:14.957509  2252 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:01:14.957269  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57644.8us
I20260709 13:01:14.958765  1649 leader_election.cc:400] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
I20260709 13:01:14.933884  5082 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.959141  1649 leader_election.cc:403] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:14.958899  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:14.960486  5342 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.961066  5345 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.962800  5266 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:14.963542  5331 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:14.965278  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
W20260709 13:01:14.968974  5348 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:14.965052  5212 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:15.009542  1601 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:14.974496  5201 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.950963  4895 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:14.978449  5188 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.979619  5237 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:14.980719  4934 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:14.943591  5181 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.004s
I20260709 13:01:14.940771  5328 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:14.989799  5326 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:14.941103  5329 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:14.993261  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:14.994968  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:14.995491  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.000365  1608 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:15.005051  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.013094  5212 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:15.005697  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:15.005640  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.007017  5330 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.000479  5345 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.008374  5344 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:14.973013  5349 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:01:14.936249  5321 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:01:14.992547  5210 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.017643  1674 raft_consensus.cc:606] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.059900  1674 raft_consensus.cc:614] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.007261  5238 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.014663  5331 consensus_queue.cc:1243] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:15.016480  4895 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:15.020788  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2021) took 1198 ms. Trace:
I20260709 13:01:14.999763  5322 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:15.010699  5194 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.973088  5255 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:01:15.029524  1604 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:15.019770  5237 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:15.039553  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46381us
I20260709 13:01:15.040354  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:15.018882  4950 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:15.055092  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:15.013581  4761 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.024843  5181 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.057624  5294 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:15.058140  1574 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.674s (SENT)
W20260709 13:01:15.115229  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57131.3us
I20260709 13:01:15.028000  5251 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.061340  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.061473  1683 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:15.053611  5188 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.045941  5345 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.065797  1533 rpcz_store.cc:276] 0709 13:01:13.822315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.902441 (+ 80126us) service_pool.cc:224] Handling call
0709 13:01:15.020591 (+1118150us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540008ded4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.020727 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401700608}
I20260709 13:01:15.132839  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.073575  5143 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.078153  5322 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.081561  4895 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.083552  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2027) took 1189 ms. Trace:
I20260709 13:01:15.085202  4934 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.086040  5212 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.086812  5269 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.088177  5112 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.093680  4956 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:15.097255  5220 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.102679  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1896) took 1634 ms. Trace:
I20260709 13:01:15.103353  5082 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.027006  5353 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:01:15.109067  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 68829.7us
I20260709 13:01:15.109117  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:15.073768  4903 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.132572  5326 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:15.062844  5339 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:15.077026  5336 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.114732  5294 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:15.113075  5048 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:15.119753  5237 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.108793  4950 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:15.120594  5310 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.004s
I20260709 13:01:15.122211  4761 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:15.144762  4956 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:15.113119  5356 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:15.123732  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2018) took 1315 ms (client timeout 1674 ms). Trace:
W20260709 13:01:15.186127  1534 rpcz_store.cc:269] 0709 13:01:13.808694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.819737 (+ 11043us) service_pool.cc:224] Handling call
0709 13:01:15.123536 (+1303799us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003a75d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.123665 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338110208}
I20260709 13:01:15.187238  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.187803  1534 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.128913  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.135298  1533 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:15.136729  1525 rpcz_store.cc:276] 0709 13:01:13.893826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.230143 (+336317us) service_pool.cc:224] Handling call
0709 13:01:14.274908 (+ 44765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.629614 (+354706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.083256 (+453642us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540042d1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:15.083483 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803945344}
I20260709 13:01:15.108489  5194 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.191601  5194 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.141075  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:15.192422  2252 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.131228  5188 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:15.196596  5188 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.146883  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:15.145944  1680 rpcz_store.cc:276] 0709 13:01:13.467966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.738806 (+270840us) service_pool.cc:224] Handling call
0709 13:01:13.841492 (+102686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.158636 (+317144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.158692 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.204728 (+ 46036us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.370311 (+165583us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.370367 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.370437 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.593705 (+223268us) raft_consensus.cc:1685] finished
0709 13:01:14.593726 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.102363 (+508637us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002242d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.102602 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3158,"raft.queue_time_us":43569,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7204,"spinlock_wait_cycles":235459840,"thread_start_us":410243,"threads_started":2,"wal-append.queue_time_us":285025}
I20260709 13:01:15.172770  4869 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:15.149896  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:15.103768  5248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.018s	sys 0.051s
W20260709 13:01:15.201303  5248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.018s	sys 0.052s
W20260709 13:01:15.164918  5366 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.177s	user 0.004s	sys 0.000s
I20260709 13:01:15.165351  5077 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.168654  4933 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.169181  5340 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.172101  2255 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.169664  4989 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.150504  5112 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.131696  5251 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.123016  1679 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:15.183701  5359 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:15.183319  4950 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:15.185441  5299 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.326s	user 0.004s	sys 0.000s
I20260709 13:01:15.151063  5143 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.151341  4895 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.214686  5077 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:15.248574  5077 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.204665  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:15.211760  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.250990  1604 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:15.213792  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.210896  5356 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:15.269045  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64479.5us
I20260709 13:01:15.269886  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.270975  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:15.217024  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70242us
W20260709 13:01:15.217144  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67317.5us
I20260709 13:01:15.272441  1648 leader_election.cc:400] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8.
I20260709 13:01:15.218791  1680 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:15.222626  5377 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:15.228423  5321 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.181646  5310 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.229050  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.171535  5212 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.215363  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.297960  1681 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:15.298228  1601 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:15.233987  1534 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:15.150746  5331 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:01:15.301980  5331 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.302667  5331 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.237841  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.303297  5310 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.303910  1608 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:15.304163  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.146870  5269 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.305261  2261 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:15.306094  5269 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.214753  5194 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.229560  5210 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.172477  5326 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.251587  1607 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:15.200896  4869 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:15.253476  5368 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:01:15.243875  5237 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.230150  5048 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.234638  4933 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.257381  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 655) took 1501 ms. Trace:
I20260709 13:01:15.258042  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.239429  4989 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.260186  5112 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.238632  5340 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.180284  5328 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:01:15.229833  5336 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.276327  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.299010  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.214075  2252 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:15.308856  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.341627  1609 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:15.245596  4950 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.344419  1600 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:15.344233  1603 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:15.312261  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 77084us
I20260709 13:01:15.316648  1675 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:15.317520  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.321393  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.323336  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.323128  2260 rpcz_store.cc:276] 0709 13:01:13.756207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.756339 (+   132us) service_pool.cc:224] Handling call
0709 13:01:15.257195 (+1500856us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54008002d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.257314 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203408256}
I20260709 13:01:15.323341  1531 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9. Re-sending same reply.
W20260709 13:01:15.328919  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 161778us
I20260709 13:01:15.335783  4933 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.313606  4994 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:15.339708  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.302124  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.307729  4903 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.347420  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 2020) took 1542 ms. Trace:
I20260709 13:01:15.348148  1682 raft_consensus.cc:2376] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9. Re-sending same reply.
I20260709 13:01:15.357332  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:15.357107  1531 rpcz_store.cc:276] 0709 13:01:13.805156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.964806 (+159650us) service_pool.cc:224] Handling call
0709 13:01:15.257929 (+1293123us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:15.347357 (+ 89428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3345280}
W20260709 13:01:15.366909  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45617.4us
I20260709 13:01:15.367738  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:15.373837  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.374635  1682 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:15.375370  4572 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.375658  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.377216  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.377801  1682 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:15.379151  5269 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:15.380519  4994 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:15.380951  5048 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:15.382087  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.381579  4994 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:15.386370  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.306857  5194 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.386204  5269 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:15.360433  5336 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.389937  5269 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.374930  4989 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.391603  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 642) took 1762 ms. Trace:
I20260709 13:01:15.391891  5336 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.363847  5181 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.381628  5356 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.394053  5375 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.313898  5210 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.363094  5112 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:15.403764  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.397609  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:15.408486  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.394491  5375 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:15.245584  5294 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:15.413815  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46158.3us
I20260709 13:01:15.394877  2258 rpcz_store.cc:276] 0709 13:01:13.629326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.643457 (+ 14131us) service_pool.cc:224] Handling call
0709 13:01:13.663028 (+ 19571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.835793 (+172765us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:14.059580 (+223787us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.311444 (+251864us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.321381 (+  9937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.321497 (+   116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.322571 (+  1074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.405016 (+ 82445us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b1800438d60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:15.391380 (+986364us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54005c2e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:15.391425 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.391539 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16403,"prepare.queue_time_us":28967,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":5392,"raft.queue_time_us":29792,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":20095,"spinlock_wait_cycles":383058176,"thread_start_us":458438,"threads_started":2,"wal-append.queue_time_us":357724}
I20260709 13:01:15.427870  1681 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:15.410677  4989 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:01:15.394981  4933 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.405649  5048 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:15.387252  5297 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:15.420495  5322 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.449770  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.450415  1602 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:15.453022  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.455742  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.457017  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.457592  1607 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:15.456646  1605 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:15.440163  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57414.5us
I20260709 13:01:15.424542  5112 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:15.462832  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2012) took 1657 ms (client timeout 2189 ms). Trace:
I20260709 13:01:15.421802  5375 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.461640  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.437918  5220 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:15.463289  1528 rpcz_store.cc:269] 0709 13:01:13.805846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.061351 (+255505us) service_pool.cc:224] Handling call
0709 13:01:15.462688 (+1401337us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400266bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.462780 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430366464}
I20260709 13:01:15.469027  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.474597  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:15.470264  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.453045  4895 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.451737  5048 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:15.456645  5294 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.435238  4933 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.473191  5220 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.519841  5220 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.520469  5112 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.501462  1602 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:15.446836  5379 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:15.499984  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:15.527129  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54142.6us
I20260709 13:01:15.514459  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.485508  4903 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:15.540712  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:15.524098  5376 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:01:15.546794  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:15.550895  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.554908  2254 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.529425  5297 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:15.492869  5345 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:15.570544  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 108991us
I20260709 13:01:15.565117  2260 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:01:15.529717  5379 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.491184  5342 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 13:01:15.580360  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 2017) took 1776 ms (client timeout 1707 ms). Trace:
W20260709 13:01:15.599654  1529 rpcz_store.cc:269] 0709 13:01:13.804394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.804586 (+   192us) service_pool.cc:224] Handling call
0709 13:01:15.580085 (+1775499us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54003426d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.580255 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104933632}
I20260709 13:01:15.515441  4895 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.545713  5251 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.572815  2260 pending_rounds.cc:85] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 10
I20260709 13:01:15.612708  2260 pending_rounds.cc:107] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:01:15.613656  2254 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:15.613014  2260 raft_consensus.cc:2889] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.615331  2254 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.619693  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:15.563450  4869 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.633112  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.632273  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:15.605477  5378 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:01:15.657986  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.655957  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:15.658902  2252 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:15.559206  5143 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:01:15.660678  1529 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:01:15.662125  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.662792  1529 raft_consensus.cc:2368] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
I20260709 13:01:15.598870  5297 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:15.576898  5379 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.666349  1526 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:15.613410  5175 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.663013  4869 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:15.659834  2227 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.667479  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.667754  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.681793  1531 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:15.668102  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.668723  5210 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.671339  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.672581  4933 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.673051  5331 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.622103  5220 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:15.676779  5344 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.004s
I20260709 13:01:15.678378  5188 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.672731  5345 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.651829  4572 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:15.684451  1529 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 6: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:15.650538  5194 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.709280  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.663529  5340 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.704818  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:15.701623  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.705714  1526 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:15.685045  5310 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.691401  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.712270  1605 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:15.710179  1527 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:15.714251  1527 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:15.545397  5387 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:01:15.716367  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:15.717361  1526 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:15.711967  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.718837  1529 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:15.699465  5344 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
W20260709 13:01:15.720109  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 311684us
I20260709 13:01:15.682155  5048 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:15.733017  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.716027  4933 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.752955  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.753194  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.753739  1604 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:15.754264  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.755951  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.720834  5340 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.752724  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 167151us
I20260709 13:01:15.723594  5294 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:15.796722  1648 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.105s (SENT)
I20260709 13:01:15.796569  5294 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.794678  1531 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:15.797304  5194 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:15.797904  5194 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.798738  5294 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.798738  1531 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:15.799439  5112 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.799893  5194 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.800076  5112 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.801007  5294 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.801527  5294 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.803483  5294 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.755275  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.811381  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.812219  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.812893  1608 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:15.729030  5251 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:15.756865  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.729923  5387 consensus_queue.cc:1243] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:15.817663  4895 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:15.817924  5296 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.906s	user 0.003s	sys 0.003s
W20260709 13:01:15.818531  5394 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:01:15.819397  5362 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.859s	user 0.002s	sys 0.000s
I20260709 13:01:15.824149  5188 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:15.826634  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.827256  1678 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
W20260709 13:01:15.827930  5212 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.000s
W20260709 13:01:15.830628  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75452.2us
I20260709 13:01:15.828200  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.831878  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:15.833529  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.834057  1648 leader_election.cc:400] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9.
I20260709 13:01:15.832985  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:15.835587  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.840791  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.843397  1679 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:15.839187  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:15.845286  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.845992  1678 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:15.847024  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.848899  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.852420  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:15.853837  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:15.857544  1680 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:15.860872  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.870514  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:15.868784  5237 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.871639  5194 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:15.872164  5329 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.873095  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:15.845845  5289 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.873787  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:15.804390  5388 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:15.850394  5371 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.765s	user 0.003s	sys 0.000s
I20260709 13:01:15.878012  1678 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:15.838341  5249 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.873550  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1914) took 1104 ms. Trace:
I20260709 13:01:15.885382  1677 rpcz_store.cc:276] 0709 13:01:14.769183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.800000 (+ 30817us) service_pool.cc:224] Handling call
0709 13:01:15.873362 (+1073362us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b540007d0d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:15.873496 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104800640}
I20260709 13:01:15.844939  5212 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.815111  5340 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.850639  5188 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.869017  4572 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.848606  5251 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:15.793704  4933 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.878996  5194 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.882426  5077 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.633s	user 0.004s	sys 0.006s
I20260709 13:01:15.872932  4934 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.894909  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.830367  5379 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.883425  5345 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:15.733861  5297 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.881647  5289 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.893082  4572 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.898387  5194 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:15.941326  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 236566us
I20260709 13:01:15.943635  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.900416  4934 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:15.884768  5388 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.946992  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:15.947839  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:15.948297  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.949597  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:15.950495  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:15.902812  5399 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.912685  4840 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.894668  5249 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.924190  5143 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.925372  4572 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.913725  5220 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.949791  4934 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.960112  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.925899  5345 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:15.961190  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:15.956674  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:15.911372  5289 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.969728  5345 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.972296  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:15.972949  2258 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:15.973652  4933 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.902271  5077 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:15.977833  5249 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.980928  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:15.981765  1532 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:15.982884  1677 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:15.966822  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 496) took 1179 ms. Trace:
I20260709 13:01:15.977874  5077 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:15.985327  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.985612  5388 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:15.988267  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.989452  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:15.990482  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:15.990737  4950 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.000s
I20260709 13:01:15.992599  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.992754  5143 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.993306  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.993942  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.994640  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:15.964389  5251 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:15.950343  5112 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:15.996562  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:15.983705  1676 rpcz_store.cc:276] 0709 13:01:14.787545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.804721 (+ 17176us) service_pool.cc:224] Handling call
0709 13:01:14.821963 (+ 17242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.900536 (+ 78573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.900575 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.910131 (+  9556us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.021428 (+111297us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.021476 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.092897 (+ 71421us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b540024b8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:15.092944 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.823813 (+730869us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:15.966619 (+142806us) raft_consensus.cc:1685] finished
0709 13:01:15.966640 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.966765 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77219,"raft.queue_time_us":45696,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6565,"spinlock_wait_cycles":129820288,"thread_start_us":78731,"threads_started":1,"wal-append.queue_time_us":141221}
W20260709 13:01:16.018375  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57276.6us
I20260709 13:01:16.014353  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:16.019495  1527 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.998113  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:16.005995  5312 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.564s	user 0.004s	sys 0.000s
I20260709 13:01:16.023638  1676 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:16.025663  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 186573us
I20260709 13:01:16.029033  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:16.027144  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:15.992520  5379 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.027146  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:16.031761  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.003151  5310 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:15.997707  5399 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:16.041364  1526 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:16.021371  5101 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.024060  5334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.004s	sys 0.013s
I20260709 13:01:15.996268  5143 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.022887  5197 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:16.052137  1527 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:16.048646  5269 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.048995  4761 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.045853  5112 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:16.050356  5249 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.048377  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.046357  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:15.982823  5375 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:16.096046  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.109548  2254 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:16.027944  5330 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:16.100098  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.998903  5289 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.106851  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:16.022714  5220 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:01:16.114667  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68371.4us
W20260709 13:01:16.116848  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.018s
W20260709 13:01:16.117179  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.013s	sys 0.018s
I20260709 13:01:16.117372  5375 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:16.117653  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 566787us
I20260709 13:01:16.112326  5330 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.118211  5330 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.121439  1607 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:16.072819  5334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.004s	sys 0.013s
W20260709 13:01:16.121326  5404 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:01:16.118397  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:16.106963  5400 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:01:16.111986  5356 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:16.034947  5048 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:01:16.107242  5269 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.052205  5336 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:01:16.130801  5395 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:01:16.144196  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 656) took 2387 ms. Trace:
I20260709 13:01:16.145538  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 594) took 1661 ms. Trace:
I20260709 13:01:16.126398  5220 consensus_queue.cc:1243] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:16.112776  5197 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:16.153980  1606 rpcz_store.cc:276] 0709 13:01:14.483909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.484484 (+   575us) service_pool.cc:224] Handling call
0709 13:01:14.484745 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.484949 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:14.514313 (+ 29364us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.004963 (+1490650us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b180036e800. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:01:16.135863 (+130900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.145241 (+  9378us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:16.145293 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.145362 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.145483 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22618,"prepare.queue_time_us":29211,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4046,"raft.queue_time_us":8170,"spinlock_wait_cycles":10715392,"thread_start_us":122567,"threads_started":1}
I20260709 13:01:16.158811  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:16.153843  2256 rpcz_store.cc:276] 0709 13:01:13.756602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.757107 (+   505us) service_pool.cc:224] Handling call
0709 13:01:13.757402 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.765136 (+  7734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.765166 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.785731 (+ 20565us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.172491 (+386760us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.172538 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.172612 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.005433 (+1832821us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:16.133770 (+128337us) raft_consensus.cc:1685] finished
0709 13:01:16.133794 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.144133 (+ 10339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13632,"raft.queue_time_us":7529,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11206,"spinlock_wait_cycles":70873472,"thread_start_us":349687,"threads_started":1,"wal-append.queue_time_us":582946}
I20260709 13:01:16.074834  5237 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:01:16.156823  4840 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.103535  5101 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.170832  5101 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:16.045113  5077 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:01:16.152532  4895 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:16.157930  5390 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
I20260709 13:01:16.173808  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:16.180876  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:16.143543  5269 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.221812  1603 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.152940  5188 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.048861  5402 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
W20260709 13:01:16.222975  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64837.7us
I20260709 13:01:16.073335  5399 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.152763  5388 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:16.228489  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54753.3us
I20260709 13:01:16.171806  4840 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.222626  5048 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:16.232556  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 181693us
I20260709 13:01:16.176427  5143 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.243893  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:16.230114  4895 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:16.238157  4840 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.252820  1606 pending_rounds.cc:85] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 6
I20260709 13:01:16.256554  1606 pending_rounds.cc:107] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:01:16.256956  1606 raft_consensus.cc:2889] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:16.253433  1526 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.223923  5194 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.265184  1526 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:16.240182  5048 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:16.241046  5356 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:16.259052  5375 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.278522  4895 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.287949  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.290835  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.291438  1532 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:16.258908  4994 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:16.293316  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.238899  5388 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.302201  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:16.305001  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.305823  1682 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:01:16.308583  5421 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:16.315351  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.283159  5375 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:16.296586  4994 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:16.320597  1532 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:16.304792  5406 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.327401  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.302556  5428 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:16.334722  1534 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:16.264490  5197 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:16.325932  5414 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:16.320199  5375 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:16.325507  5413 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:01:16.347936  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:16.329555  5406 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:16.355844  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 96434.9us
I20260709 13:01:16.366389  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:16.338860  5428 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.352169  5406 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.351285  5329 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.371078  5251 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.372924  2256 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:16.376366  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:16.354617  5410 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:01:16.386142  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:16.407266  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84100.6us
I20260709 13:01:16.412669  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:16.413511  1676 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.341831  5048 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.420233  5432 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.421345  5077 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:16.421764  5077 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.422086  5077 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.425690  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:16.426492  5220 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:16.427172  5396 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.598s	user 0.000s	sys 0.001s
I20260709 13:01:16.427188  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:16.342279  5356 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.352579  5330 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.410765  5430 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.366624  4572 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.354190  4994 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.444614  5194 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.445127  4994 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.434214  5195 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:01:16.432622  5220 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.454977  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 665) took 1329 ms. Trace:
I20260709 13:01:16.455487  2255 rpcz_store.cc:276] 0709 13:01:15.125354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.125758 (+   404us) service_pool.cc:224] Handling call
0709 13:01:15.126100 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.230472 (+104372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.454737 (+1224265us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54005ddc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:16.454914 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105351424}
W20260709 13:01:16.432876  5429 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:01:16.457049  5426 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:01:16.457496  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.412168  5387 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:16.429034  5421 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:16.367700  4934 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.432276  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.448657  1529 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.428591  5143 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:16.461562  1681 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:16.431167  5112 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.466693  1603 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:16.412070  5251 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:16.473245  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 93845.6us
I20260709 13:01:16.474351  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:16.475351  5248 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.476411  5248 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:16.478881  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.479884  1676 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:16.481092  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.482358  5256 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.481748  1676 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
I20260709 13:01:16.486462  5256 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:16.487360  5175 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:16.487731  5175 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:16.488546  5175 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.489696  5175 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.490379  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:16.491199  4933 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:16.491652  4933 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:16.485569  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.492458  4933 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.494278  1676 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:16.495496  5256 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:16.496409  5334 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:16.496781  5334 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:16.497524  5334 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.497961  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:16.428050  4761 consensus_queue.cc:1175] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:16.509351  1676 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:16.463966  5402 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.530821  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 503) took 1006 ms. Trace:
I20260709 13:01:16.511969  5334 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.468888  5143 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.521292  5424 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.461817  5387 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.468719  5112 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.552538  5444 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.561411  5444 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.570140  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.545482  5434 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:16.570968  2256 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:16.571888  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.571974  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.573137  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.570984  5434 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.551347  5399 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.551509  5424 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.577240  5424 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.575043  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 606) took 1107 ms. Trace:
I20260709 13:01:16.581900  1533 rpcz_store.cc:276] 0709 13:01:15.467679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.467859 (+   180us) service_pool.cc:224] Handling call
0709 13:01:15.468119 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.555686 (+ 87567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.555716 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.555755 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:15.555785 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.574798 (+1019013us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b54002cea54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:16.574851 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.574983 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200964864}
I20260709 13:01:16.581235  5101 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:16.596297  5101 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.596374  5379 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:16.598768  5379 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.597401  5220 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.599275  5297 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.599874  5220 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.601783  1681 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:16.604833  4956 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.608054  4572 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.601987  5220 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:16.613705  5367 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.637s	user 0.002s	sys 0.002s
I20260709 13:01:16.618273  1682 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:16.623026  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50480 (request call id 21) took 1658 ms. Trace:
I20260709 13:01:16.623543  1674 rpcz_store.cc:276] 0709 13:01:14.964439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.965148 (+   709us) service_pool.cc:224] Handling call
0709 13:01:16.622766 (+1657618us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b540032a5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2b853 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:16.622906 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16830848}
I20260709 13:01:16.628235  5353 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:16.629009  5353 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:16.630529  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.631067  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.637156  5411 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.410s	user 0.003s	sys 0.000s
I20260709 13:01:16.637967  1525 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:16.638785  5269 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.639760  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:16.641336  5326 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.641873  5326 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.642362  5326 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:16.643585  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:16.643265  5326 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:16.644464  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 43724.3us
I20260709 13:01:16.644958  1609 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:16.644855  5336 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:16.643867  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:16.642393  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:16.646936  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:16.647711  1525 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:16.650418  5388 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.651209  5101 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:16.651659  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.652127  5244 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.652390  1531 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:16.631187  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.653858  4989 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:16.654294  4989 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:16.655025  5353 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:16.657235  1683 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:16.658504  1683 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:01:16.659000  5269 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.659646  1683 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:16.660373  5082 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.660704  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.660864  5082 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:16.652330  5363 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.572s	user 0.001s	sys 0.001s
I20260709 13:01:16.664459  5251 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.666793  1601 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:16.670303  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.647023  5336 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:16.671325  5336 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:16.672127  5336 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.673302  5336 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.673487  5434 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.675486  5444 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:16.676285  5392 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.124s	user 0.003s	sys 0.000s
I20260709 13:01:16.655072  4989 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:16.678553  5112 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.665320  5330 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.681336  5340 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.681841  5143 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:16.680198  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.683544  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.683825  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:16.684190  2254 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:16.685448  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.685818  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.680374  5379 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:16.682538  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:16.690971  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 175118us
I20260709 13:01:16.691821  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.693236  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.678699  5406 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.711545  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2211) took 1020 ms. Trace:
W20260709 13:01:16.714911  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.719842  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.720963  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:16.729768  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.735590  1681 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:16.712044  1602 rpcz_store.cc:276] 0709 13:01:15.690918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.691052 (+   134us) service_pool.cc:224] Handling call
0709 13:01:15.708140 (+ 17088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.715581 (+  7441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.715611 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.725047 (+  9436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.026454 (+301407us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:16.026491 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.026554 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.636499 (+609945us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:16.694058 (+ 57559us) raft_consensus.cc:1685] finished
0709 13:01:16.694078 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.711467 (+ 17389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6357,"raft.queue_time_us":9605,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8391,"spinlock_wait_cycles":6599040,"thread_start_us":262811,"threads_started":1,"wal-append.queue_time_us":414887}
I20260709 13:01:16.760739  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.766549  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.778393  1526 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:16.678500  4989 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:16.779876  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 86716us
I20260709 13:01:16.784020  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.531473  1680 rpcz_store.cc:276] 0709 13:01:15.524274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.015234 (+490960us) service_pool.cc:224] Handling call
0709 13:01:16.018191 (+  2957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.018397 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:16.131402 (+113005us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.371765 (+240363us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.530399 (+158634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.530466 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:16.530513 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.530588 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.530746 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75713,"prepare.queue_time_us":132883,"raft.queue_time_us":149824,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":15306,"spinlock_wait_cycles":3666688,"thread_start_us":437753,"threads_started":4,"wal-append.queue_time_us":19643}
I20260709 13:01:16.782364  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:16.790635  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:16.792836  1603 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:16.792640  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78516.9us
I20260709 13:01:16.784435  1573 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:16.796562  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:16.797263  1532 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:16.809564  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.713150  5143 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.845048  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:16.848042  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53762.5us
I20260709 13:01:16.855664  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:16.856578  1602 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:16.783810  5345 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:16.783321  5444 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.784392  5409 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.835615  5256 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:16.885324  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:16.895638  1602 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:16.885560  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:16.797191  5179 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.778577  5434 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.834857  5272 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:16.900214  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.899266  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:16.850831  5328 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.910960  1681 raft_consensus.cc:606] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.911338  1681 raft_consensus.cc:614] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:16.854039  4956 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.783488  5388 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:16.915280  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:16.857334  5340 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.878304  5339 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.917726  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:16.927155  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:16.937042  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:16.939018  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53561.9us
I20260709 13:01:16.940680  2256 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:16.940734  2260 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:16.900022  5371 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:17.020982  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:17.021740  2252 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.023113  5333 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:17.024060  5326 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.024402  5339 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.024850  5446 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.851476  5018 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:01:16.864857  5323 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:01:16.877290  5249 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:17.048419  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 130775us
I20260709 13:01:16.939076  5388 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.032151  2252 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:16.946800  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:16.915995  5143 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:17.075613  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.092974  5433 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:01:17.096858  5457 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:01:16.916615  5438 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:17.083005  5439 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.126675  5406 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.916539  5077 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:17.128535  5454 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:01:17.129576  5339 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:17.129912  5455 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:17.095708  5398 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.093964  5445 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.902143  5256 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.976117  4934 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:17.126349  5439 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.083513  5341 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:17.116165  5387 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:17.154959  4994 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.005s
I20260709 13:01:17.130930  2254 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:17.160601  5334 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.002s
W20260709 13:01:17.140444  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.141824  5388 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:17.024612  5326 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.184828  5439 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:17.158779  5256 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.186170  5326 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:16.910270  5444 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.931345  5328 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.046624  5446 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:16.941154  5272 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.046957  5294 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.190254  5420 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.935s	user 0.000s	sys 0.002s
I20260709 13:01:17.149292  5048 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:17.150100  5375 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.798s	user 0.014s	sys 0.015s
I20260709 13:01:17.151686  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:17.201224  1602 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:17.153417  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:17.202242  1606 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:17.154078  4840 consensus_meta.cc:287] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.005s
I20260709 13:01:17.048373  5432 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:17.156533  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:17.077200  5210 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.204704  5432 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.205255  5432 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.893257  5345 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.136924  5248 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.210878  5248 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.211524  1606 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:17.212298  5345 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:17.213054  5248 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:16.970329  5340 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.204645  4840 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.215019  5340 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.154781  5018 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.215734  5018 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.216266  4840 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.204867  1681 raft_consensus.cc:606] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:17.218384  1681 raft_consensus.cc:614] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:17.130537  5077 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:17.158959  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 513788us
I20260709 13:01:17.216588  2258 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:17.188092  5444 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:17.219311  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:17.157455  5188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.027s	sys 0.105s
I20260709 13:01:17.157608  5406 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.124146  5143 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:17.245280  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44655.6us
I20260709 13:01:16.909729  5409 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.248498  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:17.250294  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:17.251360  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:17.190279  5294 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.175377  5341 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.275820  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.276404  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:17.440557  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:17.450084  1609 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:17.449887  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.275856  1527 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:17.218011  5432 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:17.451045  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:17.452751  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:17.453073  5432 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:17.219884  5326 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:17.454030  5326 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.456735  5326 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:17.457330  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:17.432427  5082 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.272737  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:17.278961  5297 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.324180  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:17.354215  5328 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.279064  5406 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:17.460005  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 187359us
I20260709 13:01:17.458822  1605 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:17.461753  1609 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:17.286389  5340 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.254702  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:17.335637  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.336182  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58535.7us
I20260709 13:01:17.354431  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.464021  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.450610  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.346184  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:17.461674  1530 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:17.465919  1602 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 5.
I20260709 13:01:17.446182  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.045332  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:17.810943  5451 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.556s	user 0.001s	sys 0.000s
W20260709 13:01:17.432343  5453 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:01:17.400949  5407 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.248s	user 0.000s	sys 0.003s
W20260709 13:01:17.451052  5448 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.898s	user 0.000s	sys 0.003s
I20260709 13:01:18.046203  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1966) took 1258 ms. Trace:
I20260709 13:01:18.106920  1605 rpcz_store.cc:276] 0709 13:01:16.787458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.458287 (+670829us) service_pool.cc:224] Handling call
0709 13:01:17.458550 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.518908 (+ 60358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.046137 (+527229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:17.253123  4572 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.198226  5249 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:17.739009  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.030s	sys 0.055s
W20260709 13:01:18.113373  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.038s	sys 0.077s
W20260709 13:01:18.037439  5399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.001s	sys 0.008s
W20260709 13:01:18.037022  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.001s	sys 0.008s
W20260709 13:01:18.119822  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.001s	sys 0.009s
I20260709 13:01:17.466086  5432 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.246569  5188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.027s	sys 0.105s
I20260709 13:01:17.347159  5464 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.271476  5018 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:17.243266  5375 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:17.242857  4934 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.366s
I20260709 13:01:17.422010  5446 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:17.460005  5294 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.424470  5272 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:17.337476  5444 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.363852  4989 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:01:18.087625  1527 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:18.054728  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 625) took 1274 ms. Trace:
I20260709 13:01:18.086740  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.172024  1526 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:18.045235  5326 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.111095  5143 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.111953  5409 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:18.165366  5018 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.188758  1528 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:18.189698  5201 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:18.190135  5256 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.004s	user 0.004s	sys 0.012s
I20260709 13:01:18.191197  5256 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:18.194407  5048 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.004s
I20260709 13:01:18.194583  4903 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:18.194965  4903 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:18.195518  5424 consensus_meta.cc:287] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.618s	user 0.010s	sys 0.009s
I20260709 13:01:18.195973  5424 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.144951  4572 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.048738  5356 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:18.202126  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2067) took 1926 ms. Trace:
W20260709 13:01:18.119552  5399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.001s	sys 0.008s
I20260709 13:01:18.170084  1601 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:18.171233  1609 rpcz_store.cc:276] 0709 13:01:16.780556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.455965 (+675409us) service_pool.cc:224] Handling call
0709 13:01:17.456205 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.054165 (+597960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.054662 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.195030  5048 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:18.140980  5249 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:18.134121  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 81588.6us
I20260709 13:01:18.052172  5297 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:18.202553  1676 rpcz_store.cc:276] 0709 13:01:16.276440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.513100 (+236660us) service_pool.cc:224] Handling call
0709 13:01:16.513447 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.532920 (+ 19473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.532953 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.551357 (+ 18404us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.912912 (+361555us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:16.912982 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.913065 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.201888 (+1288823us) raft_consensus.cc:1685] finished
0709 13:01:18.201912 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.202063 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15304,"raft.queue_time_us":15641,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9627,"thread_start_us":348244,"threads_started":1,"wal-append.queue_time_us":714388}
W20260709 13:01:18.196470  5466 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:01:18.190078  5201 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:18.241958  1500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.600s (SENT) [suppressed 14 similar messages]
W20260709 13:01:18.221891  5474 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:18.147004  5432 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.247560  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 609) took 2792 ms. Trace:
I20260709 13:01:18.248490  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2220) took 1879 ms. Trace:
I20260709 13:01:18.249348  1608 rpcz_store.cc:276] 0709 13:01:16.368841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.369115 (+   274us) service_pool.cc:224] Handling call
0709 13:01:16.369470 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.375851 (+  6381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.375888 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.376443 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.534422 (+157979us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:16.535276 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.535347 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.450286 (+914939us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:18.248084 (+797798us) raft_consensus.cc:1685] finished
0709 13:01:18.248108 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.248429 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4442,"raft.queue_time_us":95,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5490,"spinlock_wait_cycles":62944000,"thread_start_us":102140,"threads_started":1,"wal-append.queue_time_us":135442}
I20260709 13:01:18.249259  1600 rpcz_store.cc:276] 0709 13:01:15.455409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.456834 (+  1425us) service_pool.cc:224] Handling call
0709 13:01:15.457135 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.462603 (+  5468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.462631 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.496724 (+ 34093us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.908959 (+412235us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:15.909000 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.909070 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.172545 (+1263475us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:18.237622 (+1065077us) raft_consensus.cc:1685] finished
0709 13:01:18.237646 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.247478 (+  9832us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11942,"raft.queue_time_us":1740,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5552,"spinlock_wait_cycles":17875584,"thread_start_us":359252,"threads_started":1,"wal-append.queue_time_us":526528}
I20260709 13:01:18.220614  5048 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.196036  5272 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:18.176261  5444 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:18.286912  1677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1937) took 2448 ms (client timeout 1981 ms). Trace:
W20260709 13:01:18.287395  1677 rpcz_store.cc:269] 0709 13:01:15.838212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.944732 (+106520us) service_pool.cc:224] Handling call
0709 13:01:18.286666 (+2341934us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54003566d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:18.286828 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31559424}
I20260709 13:01:18.219924  5018 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.297814  1675 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:18.278244  5048 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.196059  4903 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.220830  5356 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:18.301241  5461 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.727s	user 0.001s	sys 0.016s
I20260709 13:01:18.298969  5445 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:18.328572  5445 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:18.317070  5297 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.329638  5445 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.303951  5201 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.332208  5375 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:18.332902  5375 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.332993  4956 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.355s	user 0.019s	sys 0.000s
I20260709 13:01:18.333453  5375 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.333920  5379 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.334569  5379 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.335778  5375 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:18.321501  5452 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.672s	user 0.001s	sys 0.016s
I20260709 13:01:18.339644  4956 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.340541  4956 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.342970  4956 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:18.343961  5467 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.350488  5467 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.353042  5432 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:18.345122  5424 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.355754  5406 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.357477  5249 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:18.359289  5469 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.359822  5469 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.361148  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 947) took 1542 ms. Trace:
I20260709 13:01:18.362002  5469 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.354276  5467 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:18.363263  5018 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.333698  4903 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.361610  2257 rpcz_store.cc:276] 0709 13:01:16.819108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.819250 (+   142us) service_pool.cc:224] Handling call
0709 13:01:16.819578 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:16.842664 (+ 23086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.842699 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:16.843311 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.194051 (+350740us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:17.194114 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.194197 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.360902 (+1166705us) raft_consensus.cc:1685] finished
0709 13:01:18.360923 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.361085 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22630,"raft.queue_time_us":23759,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":14513,"thread_start_us":288745,"threads_started":1,"wal-append.queue_time_us":524211}
W20260709 13:01:18.370442  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 1.1157e+06us
W20260709 13:01:18.372251  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 285084us
I20260709 13:01:18.374926  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:18.377280  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.378569  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:18.379187  1527 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.380085  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:18.380450  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:18.381067  1608 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.381268  1606 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:18.381444  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:18.382725  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:18.384256  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:18.378005  1526 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:18.389526  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 275312us
I20260709 13:01:18.396039  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.396901  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:18.329445  5256 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:18.408881  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.409652  1530 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
W20260709 13:01:18.389020  5476 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.052s	user 0.002s	sys 0.002s
W20260709 13:01:18.401094  5468 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:01:18.414649  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 608) took 1803 ms. Trace:
I20260709 13:01:18.389611  5406 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.425571  1530 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:18.415925  1533 rpcz_store.cc:276] 0709 13:01:16.611637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.657829 (+ 46192us) service_pool.cc:224] Handling call
0709 13:01:16.658158 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:16.712247 (+ 54089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.712281 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:16.778051 (+ 65770us) log.cc:844] Serialized 52 byte log entry
0709 13:01:16.936678 (+158627us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:16.936719 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.936808 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.414368 (+1477560us) raft_consensus.cc:1685] finished
0709 13:01:18.414394 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.414577 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53673,"raft.queue_time_us":120602,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":7635,"thread_start_us":73408,"threads_started":1,"wal-append.queue_time_us":414225}
I20260709 13:01:18.403203  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.404525  5478 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:18.434132  1608 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:18.407166  4956 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:18.436105  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.437517  1527 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:18.441515  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.443003  1527 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:18.445255  1527 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:18.402758  5018 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:01:18.451016  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.459857  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2047) took 1740 ms. Trace:
I20260709 13:01:18.465456  1534 rpcz_store.cc:276] 0709 13:01:16.719546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.719732 (+   186us) service_pool.cc:224] Handling call
0709 13:01:16.720097 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.844063 (+123966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.844097 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.441884 (+597787us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b2c00031358. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:17.442404 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.120229 (+677825us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:18.403811 (+283582us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.404255 (+   444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.404355 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.456358 (+ 52003us) raft_consensus.cc:1685] finished
0709 13:01:18.459600 (+  3242us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.459783 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123594,"raft.queue_time_us":144062,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":21652,"spinlock_wait_cycles":20385536,"thread_start_us":915636,"threads_started":2,"wal-append.queue_time_us":893699}
I20260709 13:01:18.468762  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:18.469830  1526 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.473433  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:18.475045  1530 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:18.454665  5467 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.430425  5406 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.482841  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:18.449944  4956 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.488896  1526 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:18.471379  5482 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.483543  5409 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.456163  5485 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:18.479478  5479 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:18.511186  5485 consensus_queue.cc:1243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:18.511787  5485 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:18.449753  5478 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.497905  5406 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.482028  5467 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.498736  5428 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:18.503585  1607 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:18.504079  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2055) took 3203 ms (client timeout 1925 ms). Trace:
W20260709 13:01:18.515513  1679 rpcz_store.cc:269] 0709 13:01:15.301037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.301841 (+   804us) service_pool.cc:224] Handling call
0709 13:01:18.503870 (+3202029us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54003561d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:18.503999 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886997248}
I20260709 13:01:18.516419  5478 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:18.517745  5386 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 2.167s	user 0.008s	sys 0.005s
I20260709 13:01:18.518296  5467 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.504439  1682 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:18.490222  5469 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:18.522703  5469 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.524879  5048 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.530241  5048 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:18.505699  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:18.506971  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.509258  5424 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.508900  5482 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.509027  5409 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.510587  5322 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.512140  5485 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:18.511317  5479 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.481122  5470 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:18.563264  5470 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.565511  5470 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:18.503423  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1960) took 1861 ms (client timeout 1600 ms). Trace:
W20260709 13:01:18.566097  1603 rpcz_store.cc:269] 0709 13:01:16.641988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.642134 (+   146us) service_pool.cc:224] Handling call
0709 13:01:18.503162 (+1861028us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001bc6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:18.503347 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335006976}
W20260709 13:01:18.556185  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.557822  5018 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:18.560699  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55095.9us
I20260709 13:01:18.558036  5469 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:18.509066  5487 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.562047  5485 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:18.570865  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:18.572162  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:18.567118  5322 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:18.682111  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 111311us
W20260709 13:01:18.683368  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.025s
W20260709 13:01:18.683760  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.017s	sys 0.025s
W20260709 13:01:18.690951  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 645684us
I20260709 13:01:18.691923  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:18.699278  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.709290  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 137216us
I20260709 13:01:18.710805  5401 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.715276  5470 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:18.771206  4934 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:18.838949  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 147136us
W20260709 13:01:18.840924  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 2.05494e+06us
I20260709 13:01:18.843034  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:18.839762  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2229) took 1696 ms. Trace:
I20260709 13:01:18.844015  1602 rpcz_store.cc:276] 0709 13:01:17.143513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.093738 (+950225us) service_pool.cc:224] Handling call
0709 13:01:18.114383 (+ 20645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.114584 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:18.303033 (+188449us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.677110 (+374077us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.839442 (+162332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.839495 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:18.839525 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.839578 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.839712 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135420,"prepare.queue_time_us":323899,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1169,"raft.queue_time_us":162186,"thread_start_us":559246,"threads_started":2}
I20260709 13:01:18.779139  5401 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.858319  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:18.807649  5428 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.809581  5329 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:18.709980  5487 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.838060  5472 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.810359  5470 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.846824  4903 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:18.841425  5143 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:18.857069  5401 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.943792  5471 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.781980  5484 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.278s
I20260709 13:01:18.846304  4934 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:18.943671  5486 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.062712  5406 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.067682  5470 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.948897  5428 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:18.949280  5329 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.064054  5256 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:01:19.151546  4934 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.062419  5472 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.154186  5481 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.226394  1531 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.041s	sys 0.077s
W20260709 13:01:19.250748  1531 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.041s	sys 0.077s
W20260709 13:01:19.235306  1533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.016s	sys 0.032s
I20260709 13:01:19.072891  4903 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.134316  5143 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:19.217191  5382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.008s	sys 0.038s
I20260709 13:01:19.205811  5322 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.292800  5428 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:19.276144  5382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.009s	sys 0.039s
I20260709 13:01:19.205595  5406 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:19.251899  1533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.016s	sys 0.032s
I20260709 13:01:19.267004  5479 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.285295  5409 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:19.308902  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 615) took 2669 ms (client timeout 1835 ms). Trace:
W20260709 13:01:19.331488  1528 rpcz_store.cc:269] 0709 13:01:16.639755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.660429 (+ 20674us) service_pool.cc:224] Handling call
0709 13:01:19.308657 (+2648228us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002a7954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:19.308804 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512285440}
I20260709 13:01:19.263619  5481 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.343184  5341 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.332194  5479 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.331247  5482 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:19.360213  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.008s	sys 0.032s
W20260709 13:01:19.361439  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.032s
I20260709 13:01:19.353420  5495 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.361795  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 651110us
I20260709 13:01:19.339881  5480 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:19.368017  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.368189  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.006s
W20260709 13:01:19.372828  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.005s	sys 0.006s
W20260709 13:01:19.369328  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 525853us
I20260709 13:01:19.372988  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:19.375968  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
W20260709 13:01:19.383029  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.399577  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.399900  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.030s
I20260709 13:01:19.398741  1679 raft_consensus.cc:606] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:19.436028  1679 raft_consensus.cc:614] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:19.406786  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.405100  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.358771  5479 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.362951  5341 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:19.433274  1573 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.018s
W20260709 13:01:19.435927  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.011s	sys 0.030s
I20260709 13:01:19.409240  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.445917  1525 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:19.438757  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.439585  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.442235  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:19.445072  1573 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.014s	sys 0.018s
I20260709 13:01:19.448556  1674 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:19.444896  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:19.448519  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 561775us
W20260709 13:01:19.450351  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.450839  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.451643  1528 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:19.399509  5353 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.375008  5428 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:19.415942  5482 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.399272  5077 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:19.450804  5432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.009s	sys 0.022s
I20260709 13:01:19.373782  5495 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.378319  5322 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:19.457641  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:19.464787  1677 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.407287  5356 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.461261  5256 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:19.456812  1681 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:19.460476  5494 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:01:19.464238   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:19.460594  5329 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.374711  5480 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.453504  5504 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.463984  5379 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:19.459259  5482 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.462324  5487 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.493860  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2057) took 2213 ms. Trace:
I20260709 13:01:19.461215  5428 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.467361  5472 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.465533  4903 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.458302  5341 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.467579  5256 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:19.497690  1531 rpcz_store.cc:276] 0709 13:01:17.280908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.089685 (+808777us) service_pool.cc:224] Handling call
0709 13:01:18.090290 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.402145 (+311855us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:19.262210 (+860065us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.493319 (+231109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.493377 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:19.493428 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.493495 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.493776 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28117,"prepare.queue_time_us":170476,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":89196,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19382,"thread_start_us":1338144,"threads_started":3}
I20260709 13:01:19.468739  5322 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.503916  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.461858  5500 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:19.454190  5506 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:19.463465  5353 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.499397  5482 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.511912  5501 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.513067  5479 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.539101  5289 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:19.539786  5244 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:19.540467  5244 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:19.540741  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.541378  1527 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:19.542666  5506 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:19.542970  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2074) took 3220 ms. Trace:
I20260709 13:01:19.543381  1682 rpcz_store.cc:276] 0709 13:01:16.322528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.619290 (+296762us) service_pool.cc:224] Handling call
0709 13:01:18.504014 (+1884724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.520554 (+ 16540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.542777 (+1022223us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54003561d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:19.542911 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4333677824}
I20260709 13:01:19.544241  5322 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.544901  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.546375  5244 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.547647  5244 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:19.550551  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.552662  5507 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:19.553442  5272 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:19.515045  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 666) took 2947 ms. Trace:
I20260709 13:01:19.554045  5272 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.554663  2255 rpcz_store.cc:276] 0709 13:01:16.568057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.569343 (+  1286us) service_pool.cc:224] Handling call
0709 13:01:16.569676 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.576297 (+  6621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.576351 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.576396 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:16.576426 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.514824 (+2938398us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:19.514874 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.514992 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14737280}
I20260709 13:01:19.555503  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 948) took 2664 ms. Trace:
I20260709 13:01:19.555935  2254 rpcz_store.cc:276] 0709 13:01:16.891116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.891299 (+   183us) service_pool.cc:224] Handling call
0709 13:01:16.891634 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.175529 (+283895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.555248 (+2379719us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400550354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:19.555442 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432662272}
I20260709 13:01:19.557135  5485 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.557462  5495 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.557998  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:19.513396  5428 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.466063  5077 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.527263  5502 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:19.571873  1683 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.508721  4903 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:19.529361  5048 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.530118  5467 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.000s
I20260709 13:01:19.530493  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:19.530891  5498 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:01:19.531008  5329 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:19.496114  5504 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.500248  5406 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.533347  5480 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.534580  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2065) took 3276 ms. Trace:
I20260709 13:01:19.536567  5481 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.537573  5501 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.553232  5507 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.560474  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.560702  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:19.617379  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.618491  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.561666  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.561626  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:19.595268  5495 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.563624  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.621269  1608 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:19.619426  1609 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:19.527245  5472 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.564586  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.559018  4895 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:19.566179  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.629030  1603 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:19.516628  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:19.567746  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:19.568639  5249 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:19.559167  5379 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:19.571179  5272 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:19.527773  5446 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.587322  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:19.590359  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59923.8us
I20260709 13:01:19.643951  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:19.572696  2227 connection.cc:256] RPC call timeout handler was delayed by -1.5333541910000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 13:01:19.572000  5018 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.653393  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:19.654217  1609 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.654762  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.655673  1603 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:19.579546  5256 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.587852  5506 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.508914  5487 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:19.594197  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 666) took 3230 ms. Trace:
I20260709 13:01:19.596028  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:19.677608  1674 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.677345  2258 rpcz_store.cc:276] 0709 13:01:16.363836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.364742 (+   906us) service_pool.cc:224] Handling call
0709 13:01:16.375404 (+ 10662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.219727 (+844323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.593886 (+2374159us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:19.594122 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933901568}
I20260709 13:01:19.603354  1675 rpcz_store.cc:276] 0709 13:01:16.258132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.330074 (+ 71942us) service_pool.cc:224] Handling call
0709 13:01:18.293458 (+1963384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.299675 (+  6217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.534391 (+1234716us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54003566d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:19.534521 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4502934784}
I20260709 13:01:19.562664  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.623852  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 620) took 2866 ms. Trace:
I20260709 13:01:19.623927  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:19.624759  5475 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.394s	user 0.004s	sys 0.017s
I20260709 13:01:19.625517  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2038) took 3371 ms. Trace:
I20260709 13:01:19.626336  5507 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:19.580869  5470 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.631755  1531 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:19.634992  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:19.638012  1683 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:19.639216  1525 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:19.645946  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:19.591703  4903 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.591895  5048 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.593317  5467 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:19.647337  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:19.592432  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 208310us
I20260709 13:01:19.725168  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:19.658010  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:19.588711  5502 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.621264  5495 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:19.661007  5501 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.641892  5406 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:19.702626  5244 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:19.665391  5341 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.718710  5256 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.743760  1678 raft_consensus.cc:2410] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2.
I20260709 13:01:19.667774  5481 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:19.674229  4934 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.633669  5484 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:19.754663  5484 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.601351  5329 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.647044  5446 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.602115  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.760794  1676 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:19.761855  5446 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.762001  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.763268  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.764444  5353 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.733314  4895 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:19.679726  1680 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:01:19.681979  1649 connection.cc:256] RPC call timeout handler was delayed by -1.1931115350000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:01:19.620498  5077 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.685053  1529 rpcz_store.cc:276] 0709 13:01:16.254754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.254986 (+   232us) service_pool.cc:224] Handling call
0709 13:01:16.255255 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.463485 (+208230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.625297 (+3161812us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540043c454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:19.625461 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444246912}
W20260709 13:01:19.685546  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 310054us
I20260709 13:01:19.686015  1609 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:19.687547  1603 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:19.679209  1601 rpcz_store.cc:276] 0709 13:01:16.757559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.757665 (+   106us) service_pool.cc:224] Handling call
0709 13:01:16.834223 (+ 76558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.217312 (+1383089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.620787 (+1403475us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400349ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:19.623789 (+  3002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071747840}
I20260709 13:01:19.690822  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:19.705178  2254 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:19.715637  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.716171  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:19.719203  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:19.719414  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:19.615728  5401 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.721488  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:19.723812  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:19.726753  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 160148us
I20260709 13:01:19.728183  2256 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.732296  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:19.732821  1677 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:01:19.641933  5249 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.639614  5472 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.734404  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.717056  5507 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.666963  5504 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:19.745153  2253 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:19.731642  5495 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.747488  5511 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.748821  5510 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:19.749243  5502 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.749456  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.750351  5048 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.751816  5470 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.753306  5467 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:19.678663  5018 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.744024  5244 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:19.758586  5143 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:19.927423  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.483883  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.485807  2252 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:20.486476  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:20.142284  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 399558us
W20260709 13:01:19.887084  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.478515  1674 consensus_meta.cc:287] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.000s
W20260709 13:01:20.489492  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.490029  1674 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
W20260709 13:01:20.007871  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 281895us
I20260709 13:01:20.509855  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:20.499228  1675 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.768781  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:20.514104  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 745353us
I20260709 13:01:20.099004  4895 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.516448  5511 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:20.517155  5511 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:20.528517  1605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.007s	sys 0.013s
W20260709 13:01:20.528926  1605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.007s	sys 0.013s
I20260709 13:01:20.532657  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:19.736825  5512 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:20.514213  5486 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:19.800002  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.766665  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:20.544059  1676 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:20.488524  2261 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:20.503623  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 516) took 1065 ms. Trace:
I20260709 13:01:20.545327  1677 rpcz_store.cc:276] 0709 13:01:19.438100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.438206 (+   106us) service_pool.cc:224] Handling call
0709 13:01:20.503525 (+1065319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:20.398026  5482 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.000s
I20260709 13:01:20.513582  1681 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:19.780750  5416 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.214s	user 0.015s	sys 0.041s
I20260709 13:01:20.550971  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:20.551409  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:20.552029  1680 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:20.552738  1676 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:19.765305  5424 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:19.753374  5402 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:20.391261  5329 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:20.335450  5491 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.556110  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:20.558286  2256 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:20.560283  1675 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:01:20.554046  5416 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.988s	user 0.038s	sys 0.087s
I20260709 13:01:20.093703  5195 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:20.556280  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.694914  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.410161  5521 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:19.740176  5406 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:20.482134  5506 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:20.485407  4903 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:19.746094  5513 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:20.568380  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.718581  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:20.569159  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:20.719097  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1967) took 1056 ms. Trace:
I20260709 13:01:20.719566  1681 rpcz_store.cc:276] 0709 13:01:19.663164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.692615 (+1029451us) service_pool.cc:224] Handling call
0709 13:01:20.718528 (+ 25913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.718721 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.718749 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.718791 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:20.718822 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.718912 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.719038 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:20.576084  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2224) took 3864 ms (client timeout 1965 ms). Trace:
W20260709 13:01:20.720866  1604 rpcz_store.cc:269] 0709 13:01:16.711562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.575814 (+3864252us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:20.576001 (+   187us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:19.765570  5481 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:20.098193  5379 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:20.579360  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:20.750385  1674 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:20.751021  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1966) took 1088 ms. Trace:
I20260709 13:01:20.751368  1674 rpcz_store.cc:276] 0709 13:01:19.662862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.549463 (+886601us) service_pool.cc:224] Handling call
0709 13:01:20.750947 (+201484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:20.581712  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:20.752420  1677 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:20.753008  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1963) took 1090 ms. Trace:
I20260709 13:01:20.753335  1677 rpcz_store.cc:276] 0709 13:01:19.662094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.553661 (+891567us) service_pool.cc:224] Handling call
0709 13:01:20.752937 (+199276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:20.110252  5484 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:20.688932  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.543071  5486 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.692770  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.561264  4934 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:20.560914  5424 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:20.754549  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2240) took 1102 ms. Trace:
I20260709 13:01:20.577970  5048 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.547995  5510 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.527946  5495 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:20.538460  5507 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.788051  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.859622  1604 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:20.793123  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 309491us
I20260709 13:01:20.795396  1605 rpcz_store.cc:276] 0709 13:01:19.652594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.653285 (+   691us) service_pool.cc:224] Handling call
0709 13:01:19.653868 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.654127 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:20.529301 (+875174us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.754159 (+224858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.754219 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:20.754269 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.754344 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.754487 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96438,"raft.queue_time_us":98074,"thread_start_us":967596,"threads_started":2}
I20260709 13:01:20.861016  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.562592  5482 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.837965  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2221) took 4145 ms. Trace:
I20260709 13:01:20.551621  5512 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:20.860158  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2247) took 1129 ms. Trace:
I20260709 13:01:20.929416  1604 rpcz_store.cc:276] 0709 13:01:19.730826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.787736 (+1056910us) service_pool.cc:224] Handling call
0709 13:01:20.860091 (+ 72355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:20.930471  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.871430  1607 rpcz_store.cc:276] 0709 13:01:16.692959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.693415 (+   456us) service_pool.cc:224] Handling call
0709 13:01:18.503328 (+1809913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.515034 (+ 11706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.804516 (+2289482us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54001bc6d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:20.837871 (+ 33355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4161604480}
I20260709 13:01:20.874892  1605 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:20.787820  5430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.014s	sys 0.018s
W20260709 13:01:20.899314  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.933658  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.794727  5486 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.593050  5402 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.941862  1680 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.938488  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.940590  1601 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:20.943517  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.944440  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2255) took 1196 ms. Trace:
I20260709 13:01:20.934401  5506 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:20.944818  1604 rpcz_store.cc:276] 0709 13:01:19.747935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.943273 (+1195338us) service_pool.cc:224] Handling call
0709 13:01:20.944385 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:20.945744  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.946316  1604 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:20.947110  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:20.947772  1604 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:20.949123  1606 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:20.856652  5333 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.954084  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 465434us
I20260709 13:01:20.955339  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2254) took 1207 ms. Trace:
I20260709 13:01:20.713094  5195 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:20.935449  5430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.019s
I20260709 13:01:20.705199  5521 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:20.970484  5516 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.579s	user 0.000s	sys 0.001s
I20260709 13:01:20.760491  5513 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:20.927819  4934 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:20.780037  5379 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:20.976065  1607 rpcz_store.cc:276] 0709 13:01:19.747640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.938188 (+1190548us) service_pool.cc:224] Handling call
0709 13:01:20.955218 (+ 17030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.047231  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:21.048415  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:21.049178  1607 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:21.049535  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1973) took 1019 ms. Trace:
I20260709 13:01:21.049821  1607 rpcz_store.cc:276] 0709 13:01:20.029849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.048163 (+1018314us) service_pool.cc:224] Handling call
0709 13:01:21.049487 (+  1324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.050594  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.976281  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:20.977329  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 408244us
I20260709 13:01:20.703146  5491 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.939618  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:20.855849  5048 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.058904  1607 raft_consensus.cc:2410] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:21.060071  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:21.061448  5249 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:21.061971  5532 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:21.062668  5472 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:20.980603  5527 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:20.966320  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 247814us
I20260709 13:01:20.978595  5329 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:21.053058  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:21.078306  5329 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:21.078860  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:21.055519  5244 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:20.981330  5333 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.083957  5472 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.084439  5472 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.084789  5472 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.086073  5333 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.088948  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:20.980810  5529 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:21.112586  1600 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:21.114355  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2252) took 1367 ms. Trace:
I20260709 13:01:21.114909  1607 rpcz_store.cc:276] 0709 13:01:19.747054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.050368 (+1303314us) service_pool.cc:224] Handling call
0709 13:01:21.114279 (+ 63911us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:21.053020  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76829.8us
I20260709 13:01:21.035706  5523 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:21.091840  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:21.128396  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:21.053754  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:21.073722  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:21.167848  1607 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:21.078842  5432 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:21.078824  5329 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.089012  5048 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:20.974774  5424 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:20.978032  5481 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.125831  5542 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:21.066718  5484 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:21.172430  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49192.6us
I20260709 13:01:21.065894  4934 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:21.126608  5018 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:21.167317  5541 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:21.196026  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.171932  5401 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.180603  5432 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:21.186257  5511 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260709 13:01:21.172135  5529 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:21.116262  5527 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.208549  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:21.208879  5518 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:21.206990  5541 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.252208  5541 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.257831  5529 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.261963  5482 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.265376  5507 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.267400  5491 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.268934  5521 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:21.270648  5485 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.713s	user 0.013s	sys 0.000s
I20260709 13:01:21.271311  5485 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.271591  1682 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:21.272109  5480 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.272831  5480 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.220389  5510 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.169265  5523 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.286208  5523 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:21.222285  5195 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.194451  5542 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.288348  5542 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.224781  5495 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.226091  5379 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:21.217935  5513 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:21.230509  5432 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.271801  5485 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:21.320325  5485 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.203341  5484 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.249259  5201 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:21.354779  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 146313us
I20260709 13:01:21.355898  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:21.237854  5256 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.492s	user 0.008s	sys 0.004s
W20260709 13:01:21.386502  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.011s	sys 0.015s
W20260709 13:01:21.387230  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.011s	sys 0.015s
W20260709 13:01:21.387544  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 877829us
I20260709 13:01:21.389950  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1968) took 1637 ms. Trace:
I20260709 13:01:21.390491  1675 rpcz_store.cc:276] 0709 13:01:19.752192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.594200 (+842008us) service_pool.cc:224] Handling call
0709 13:01:20.594497 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.594858 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:21.143115 (+548257us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.197206 (+ 54091us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.389505 (+192299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:21.389571 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:21.389625 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.389720 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.389875 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":467447,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":97,"raft.queue_time_us":193645,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"spinlock_wait_cycles":25128832,"thread_start_us":687220,"threads_started":3,"wal-append.queue_time_us":77429}
W20260709 13:01:21.386718  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 250705us
I20260709 13:01:21.392779  5502 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:21.402424  5515 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:21.383672  5523 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.238814  5511 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.418278  5511 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.419241  4934 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.379142  5484 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:21.434482  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46330us
I20260709 13:01:21.425868  5486 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.436066  5527 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:21.379981  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 306313us
I20260709 13:01:21.427198  5472 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.396095  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:21.472379  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.006s	sys 0.018s
W20260709 13:01:21.472882  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.007s	sys 0.018s
I20260709 13:01:21.472746  5546 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:21.477583  5472 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:21.486949  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90909.2us
I20260709 13:01:21.502853  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:21.439141  5541 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.511341  5077 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.505959  5511 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:21.496970  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 141154us
I20260709 13:01:21.527818  5077 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:21.523588  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52809.1us
I20260709 13:01:21.554998  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:21.573156  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70418us
W20260709 13:01:21.584563  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.608399  2226 connection.cc:256] RPC call timeout handler was delayed by -1.5619067300000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:01:21.616757  2226 connection.cc:256] RPC call timeout handler was delayed by -1.2478067299999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:01:21.525100  5511 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:21.524855  5549 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:21.626845  2226 connection.cc:256] RPC call timeout handler was delayed by -1.2001067300000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:01:21.609588  5546 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.609953  5481 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.442775  5542 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:21.627429  2226 connection.cc:256] RPC call timeout handler was delayed by -1.1416067299999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:01:21.629379  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.640844  2256 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
W20260709 13:01:21.641786  2226 connection.cc:256] RPC call timeout handler was delayed by -1.065106730000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 13:01:21.622900  5535 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.643324  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:21.538509  5329 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.623392  5549 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.623459  5511 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.621145  5523 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:21.649541  5523 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:21.650027  5523 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:21.651265  5523 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.652769  5523 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:21.656430  5416 consensus_queue.cc:1175] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 8 } }
I20260709 13:01:21.638885  5546 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:21.660219  5546 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.639375  5481 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.673334  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:21.707406  1681 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:21.646121  5549 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.682282  5481 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.705308  5529 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:21.645823  5535 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.730499  5529 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:21.741217  5529 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.741045  5486 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.752238  5535 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:21.757867  5541 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.761072  5542 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.761669  5329 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:21.763244  5432 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.776973  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:21.777657  2256 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.787338  2256 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:21.793915  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.814740  2261 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
W20260709 13:01:21.821703  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 148449us
I20260709 13:01:21.822753  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:21.773960  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:21.835001  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:21.836225  1675 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:21.891345  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68672.9us
I20260709 13:01:21.892932  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.893633  2261 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:21.895290  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.896648  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.897589  2256 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:21.905655  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.909235  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:21.902540  5534 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.901520  5535 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.772809  5484 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.961695  5432 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:21.970350  5529 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.979084  5549 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:21.955924  5546 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:22.016215  5535 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.027384  5546 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:22.027730  5549 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:22.055488  1421 maintenance_manager.cc:419] P 3fc8854ff8e34244b91acf19f7f50f8a: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033655
W20260709 13:01:21.143546  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.009s	sys 0.006s
I20260709 13:01:22.072611  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 628) took 2512 ms. Trace:
I20260709 13:01:22.073230  1602 rpcz_store.cc:276] 0709 13:01:19.559483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.559846 (+   363us) service_pool.cc:224] Handling call
0709 13:01:19.560253 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.677599 (+117346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.677634 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.677678 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:19.677709 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.071646 (+2393937us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:22.071789 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.072252 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266980736}
I20260709 13:01:22.077191  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:22.079118  1529 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
W20260709 13:01:22.081044  1573 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.003s	sys 0.014s
I20260709 13:01:22.081212  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:22.081699  1573 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.003s	sys 0.014s
W20260709 13:01:22.082320  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 1.38023e+06us
I20260709 13:01:22.083137  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.084167  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1983) took 1225 ms. Trace:
I20260709 13:01:21.169169  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:22.084780  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.521s	user 0.003s	sys 0.011s
W20260709 13:01:22.085454  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.522s	user 0.004s	sys 0.012s
I20260709 13:01:22.085566  1605 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:22.085907  1607 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:21.169872  1604 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:22.080184  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:22.086928  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.009s	sys 0.007s
I20260709 13:01:22.086881  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1986) took 1055 ms. Trace:
I20260709 13:01:21.960301  5481 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:21.982187  5484 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:22.154778  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.002431  5511 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.161034  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:22.167371  5529 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.084535  1602 rpcz_store.cc:276] 0709 13:01:20.858648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.075786 (+1217138us) service_pool.cc:224] Handling call
0709 13:01:22.084055 (+  8269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.100297  1607 rpcz_store.cc:276] 0709 13:01:21.031798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.168898 (+137100us) service_pool.cc:224] Handling call
0709 13:01:22.086780 (+917882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.377015  2258 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:22.377579  5559 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.378724   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:22.379103  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2249) took 2638 ms (client timeout 1815 ms). Trace:
I20260709 13:01:22.378535  5559 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:22.379588  1601 rpcz_store.cc:269] 0709 13:01:19.740822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.563421 (+822599us) service_pool.cc:224] Handling call
0709 13:01:22.378761 (+1815340us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54003b8dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.378960 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370658688}
I20260709 13:01:22.379704  1525 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:22.384905  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.385456  2261 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:22.385952  5201 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.386844  5201 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.387594  5445 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:22.388473  1574 connection.cc:256] RPC call timeout handler was delayed by -2.384301111999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:01:22.390076  5511 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.391110  4895 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:22.384984  5526 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.388711  5432 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:22.392244  5526 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.394238  5432 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.394621  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.395979  2254 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:22.397764  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.398195  5201 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.398610  5559 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.398922  2252 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:22.399928  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:22.380888  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 297355us
I20260709 13:01:22.389964  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.393075  2257 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:22.405244  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2250) took 2657 ms (client timeout 3214 ms). Trace:
W20260709 13:01:22.408425  1602 rpcz_store.cc:269] 0709 13:01:19.744377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.380387 (+2636010us) service_pool.cc:224] Handling call
0709 13:01:22.402142 (+ 21755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.407804  1675 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:22.408022  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.413842  5559 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:22.415443  5559 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:22.404835  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:22.415959  5526 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.392047  4895 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:22.424623  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2248) took 2684 ms (client timeout 3312 ms). Trace:
W20260709 13:01:22.430064  1607 rpcz_store.cc:269] 0709 13:01:19.737945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.382964 (+2645019us) service_pool.cc:224] Handling call
0709 13:01:22.422568 (+ 39604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.426883  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.426350  5432 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:22.433334  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2258) took 1823 ms (client timeout 1662 ms). Trace:
W20260709 13:01:22.435403  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45958.6us
I20260709 13:01:22.437736  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:22.443789  5473 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 4.141s	user 0.030s	sys 0.096s
I20260709 13:01:22.445103  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.440270  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.445999  2253 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:22.446858  1531 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:22.445946  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.441231  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.436964  2256 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:22.438488  1604 rpcz_store.cc:269] 0709 13:01:20.549974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.053482 (+503508us) service_pool.cc:224] Handling call
0709 13:01:22.091741 (+1038259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.448937  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.450605  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.449951  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2242) took 2789 ms. Trace:
I20260709 13:01:22.447438  5432 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:22.454007  1608 rpcz_store.cc:276] 0709 13:01:19.658477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.658639 (+   162us) service_pool.cc:224] Handling call
0709 13:01:19.658978 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.781646 (+1122668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.781683 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.781728 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:20.781761 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.447310 (+1665549us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400384fd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:22.447380 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.447624 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581359360}
I20260709 13:01:22.454924  5432 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:22.463474  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:22.468535  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.470800  2261 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:22.458935  5432 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.527451  2252 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:22.462644  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.613584  4895 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.469887  5559 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.470518  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:22.615095  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 167002us
I20260709 13:01:22.616077  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:22.617394  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1942) took 3057 ms (client timeout 2125 ms). Trace:
W20260709 13:01:22.617949  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.621836  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:22.622402  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.623580  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.622795  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2259) took 2056 ms. Trace:
I20260709 13:01:22.624508  1604 rpcz_store.cc:276] 0709 13:01:20.566856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.464687 (+1897831us) service_pool.cc:224] Handling call
0709 13:01:22.622737 (+158050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.625521  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.613935  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:22.626348  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2260) took 2052 ms. Trace:
I20260709 13:01:22.626662  1607 rpcz_store.cc:276] 0709 13:01:20.573827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.436064 (+1862237us) service_pool.cc:224] Handling call
0709 13:01:22.626291 (+190227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.628830  5546 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.629734  1604 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:22.629928  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:22.630159  1498 connection.cc:256] RPC call timeout handler was delayed by -2.395712350999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:01:22.617852  1682 rpcz_store.cc:269] 0709 13:01:19.559595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.561369 (+  1774us) service_pool.cc:224] Handling call
0709 13:01:22.616843 (+3055474us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540024a4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.617148 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3797626624}
I20260709 13:01:22.630427  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2246) took 2905 ms. Trace:
I20260709 13:01:22.630923  1604 rpcz_store.cc:276] 0709 13:01:19.724982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.628975 (+2903993us) service_pool.cc:224] Handling call
0709 13:01:22.629433 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.630184 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.630353 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.631611  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.632197  1676 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:01:22.440414  5526 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.192s
I20260709 13:01:22.632501  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 529) took 1149 ms. Trace:
I20260709 13:01:22.631163  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.630733  1527 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:01:22.635641  1498 connection.cc:256] RPC call timeout handler was delayed by -2.375912350999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:01:22.636013  1498 connection.cc:256] RPC call timeout handler was delayed by -2.3174123509999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:01:22.636379  1498 connection.cc:256] RPC call timeout handler was delayed by -2.1248123510000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:01:22.636744  1498 connection.cc:256] RPC call timeout handler was delayed by -1.856612350999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 13:01:22.637030  1498 connection.cc:256] RPC call timeout handler was delayed by -1.7558123509999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:01:22.635070  1682 rpcz_store.cc:276] 0709 13:01:21.483386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.631252 (+1147866us) service_pool.cc:224] Handling call
0709 13:01:22.632414 (+  1162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.632386  4895 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.642306  4895 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.631377  5201 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.645903  5201 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.646400  5201 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.648732  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.636092  1676 pending_rounds.cc:85] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 6
I20260709 13:01:22.622213  5561 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.651639  5561 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.655351  5561 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.655539  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.657516  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:22.658850  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.658759  2254 raft_consensus.cc:2376] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9. Re-sending same reply.
I20260709 13:01:22.659454  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.660037  2253 raft_consensus.cc:2376] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:01:22.650483  1676 pending_rounds.cc:107] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:22.663196  1602 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:22.663661  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2256) took 2130 ms. Trace:
I20260709 13:01:22.663954  1602 rpcz_store.cc:276] 0709 13:01:20.533136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.424329 (+1891193us) service_pool.cc:224] Handling call
0709 13:01:22.663595 (+239266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.663079  1676 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.666915  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:22.668350  1675 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:22.668833  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 525) took 1202 ms. Trace:
I20260709 13:01:22.669158  1675 rpcz_store.cc:276] 0709 13:01:21.465964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.423057 (+957093us) service_pool.cc:224] Handling call
0709 13:01:22.668776 (+245719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.670686  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.670857  5424 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.672283  1675 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:22.677086  5481 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.677668  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.678412  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 524) took 1207 ms. Trace:
I20260709 13:01:22.680601  1675 rpcz_store.cc:276] 0709 13:01:21.465267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.670215 (+1204948us) service_pool.cc:224] Handling call
0709 13:01:22.672724 (+  2509us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:22.693114  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 225057us
I20260709 13:01:22.696728  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:22.697542  1531 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.677754  4895 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.703444  1527 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:22.706532  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 620) took 4265 ms. Trace:
I20260709 13:01:22.705188  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1970) took 2947 ms. Trace:
I20260709 13:01:22.707211  1602 rpcz_store.cc:276] 0709 13:01:19.757516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.672745 (+2915229us) service_pool.cc:224] Handling call
0709 13:01:22.702903 (+ 30158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.704832 (+  1929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.704857 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.704917 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:22.704946 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.705011 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.705113 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.700918  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1965) took 3016 ms. Trace:
I20260709 13:01:22.705689  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.708189  1676 rpcz_store.cc:276] 0709 13:01:19.662603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.561129 (+898526us) service_pool.cc:224] Handling call
0709 13:01:22.627981 (+2066852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.671285 (+ 43304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.672698 (+  1413us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540024a4d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.678882 (+  6184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4727308032}
W20260709 13:01:22.710552  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 2.15432e+06us
I20260709 13:01:22.711726  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:22.707926  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 522) took 1240 ms. Trace:
I20260709 13:01:22.713958  1682 rpcz_store.cc:276] 0709 13:01:21.463355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.644603 (+1181248us) service_pool.cc:224] Handling call
0709 13:01:22.703689 (+ 59086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.706890  1533 rpcz_store.cc:276] 0709 13:01:18.413841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.429227 (+ 15386us) service_pool.cc:224] Handling call
0709 13:01:18.429575 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.515011 (+ 85436us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:19.315586 (+800575us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.499534 (+183948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.499609 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:19.499699 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.649787 (+3150088us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b5400343ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:22.653737 (+  3950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.679611 (+ 25874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":865,"prepare.queue_time_us":59567,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1015,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8224,"spinlock_wait_cycles":197229568,"thread_start_us":982563,"threads_started":2,"wal-append.queue_time_us":249174,"wal-append.run_cpu_time_us":1031,"wal-append.run_wall_time_us":1001058}
I20260709 13:01:22.718160  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1969) took 2985 ms. Trace:
I20260709 13:01:22.718691  1607 rpcz_store.cc:276] 0709 13:01:19.732872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.662861 (+2929989us) service_pool.cc:224] Handling call
0709 13:01:22.717216 (+ 54355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.717748 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.717777 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.717845 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:22.717877 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.717942 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.718069 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.721051  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1971) took 2922 ms. Trace:
I20260709 13:01:22.724462  1607 rpcz_store.cc:276] 0709 13:01:19.798549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.719875 (+2921326us) service_pool.cc:224] Handling call
0709 13:01:22.720373 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.720724 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.720747 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.720803 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:22.720846 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.720895 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.720995 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.726193  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.723654  5201 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:22.758586  1675 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:22.759860  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.760366  5201 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:22.752660  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.761096  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.761447  5561 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.762343  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.763540  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.764055  1675 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.758571  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.766093  1682 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:22.766750  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 523) took 1302 ms. Trace:
W20260709 13:01:22.768189  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1943) took 3201 ms (client timeout 1600 ms). Trace:
W20260709 13:01:22.768657  1678 rpcz_store.cc:269] 0709 13:01:19.566614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.567456 (+   842us) service_pool.cc:224] Handling call
0709 13:01:22.767798 (+3200342us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003296d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.768016 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247829248}
I20260709 13:01:22.769858  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:22.735443  5432 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:22.767762  1682 rpcz_store.cc:276] 0709 13:01:21.464037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.765427 (+1301390us) service_pool.cc:224] Handling call
0709 13:01:22.765854 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.766492 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.766681 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.769884  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 526) took 1303 ms. Trace:
I20260709 13:01:22.774713  1676 rpcz_store.cc:276] 0709 13:01:21.466645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.768755 (+1302110us) service_pool.cc:224] Handling call
0709 13:01:22.769147 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.769547 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.769571 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.769627 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:22.769660 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.769730 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.769826 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:22.777794  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:22.779419  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.780478  1609 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:22.781343  5512 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:22.781919  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 125834us
I20260709 13:01:22.784554  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:22.790117  5567 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:01:22.792219  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 519) took 3353 ms (client timeout 2063 ms). Trace:
W20260709 13:01:22.793881  1683 rpcz_store.cc:269] 0709 13:01:19.438951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.444657 (+  5706us) service_pool.cc:224] Handling call
0709 13:01:22.791778 (+3347121us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000ec4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.791980 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281504128}
I20260709 13:01:22.786398  1602 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:22.799811  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:22.799850  4956 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.801004  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.805769  2253 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:22.815028  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.817384  2254 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:22.818612  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.819811  5480 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:22.821112  2253 raft_consensus.cc:2368] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:22.821808  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:22.823127  1648 leader_election.cc:336] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.908s (SENT)
I20260709 13:01:22.823889  1675 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:22.824466  2261 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:22.825783  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:22.826563  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.826712  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.853196  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:22.855386  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62467.2us
I20260709 13:01:22.856335  2256 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:22.860210  2257 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:22.861349  5511 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.862495  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.862582  2254 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:22.869599  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46551.4us
I20260709 13:01:22.871886  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.880586  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.862236  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:22.884063  2261 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:22.877962  1500 connection.cc:256] RPC call timeout handler was delayed by -1.7602029290000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:01:22.886819  2259 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:22.887128  1500 connection.cc:256] RPC call timeout handler was delayed by -1.6873029289999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:01:22.887439  1500 connection.cc:256] RPC call timeout handler was delayed by -1.6819029289999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:01:22.887643  1500 connection.cc:256] RPC call timeout handler was delayed by -1.5334029289999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:01:22.887848  1500 connection.cc:256] RPC call timeout handler was delayed by -1.5325029289999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:01:22.888083  1500 connection.cc:256] RPC call timeout handler was delayed by -1.3975029289999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:01:22.888346  1500 connection.cc:256] RPC call timeout handler was delayed by -1.3561029289999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 13:01:22.888657  1500 connection.cc:256] RPC call timeout handler was delayed by -1.303902929000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:01:22.889189  1500 connection.cc:256] RPC call timeout handler was delayed by -1.2967029289999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:01:22.889719  1500 connection.cc:256] RPC call timeout handler was delayed by -1.2499029289999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:01:22.889685  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:22.890018  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:22.888605  1531 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:22.871644  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:22.892867  1527 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.877317  5561 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.897826  5561 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.900760  5561 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.877946  4956 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.903736  4956 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.906291  4956 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:22.907303  1602 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:22.908509  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.909173  1675 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.909262  5432 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:22.868970  5511 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:22.910808  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.912525  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.912796  1607 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:22.913388  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.914011  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.914254  1682 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:22.914999  1607 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:22.915491  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.896692  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:22.917431  5480 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:22.918242  1533 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:22.909947  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.908478  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:22.915927  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:22.921293  1678 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.921962  1683 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:22.923246  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.923982  1683 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:22.924460  1682 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:22.925458  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.926617  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.927037  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 681) took 3191 ms. Trace:
I20260709 13:01:22.927428  2260 rpcz_store.cc:276] 0709 13:01:19.735925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.736076 (+   151us) service_pool.cc:224] Handling call
0709 13:01:19.736473 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.561038 (+824565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.561078 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.561121 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:20.561151 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.926581 (+2365430us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54005de8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:22.926652 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.926866 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895773440}
I20260709 13:01:22.927773  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.929471  1682 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:22.930449  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.931236  1682 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:01:22.932539  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45643.6us
I20260709 13:01:22.933542  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:22.934204  5406 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:22.939680  5077 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:22.940516  2253 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.950616  5561 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.951115  5561 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.951483  5561 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:22.956764  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 85237us
W20260709 13:01:22.959791  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1955) took 3299 ms (client timeout 1771 ms). Trace:
W20260709 13:01:22.965148  1679 rpcz_store.cc:269] 0709 13:01:19.659923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.726218 (+ 66295us) service_pool.cc:224] Handling call
0709 13:01:22.959330 (+3233112us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400328cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:22.959588 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285661056}
I20260709 13:01:22.970017  1678 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:22.949621  4956 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:22.973538  5570 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:22.974061  5570 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:22.974493  5570 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.980192  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:22.986308  4956 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:22.988772  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.990253  1602 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:23.015513  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:23.015903  1527 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:23.015535  1675 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:23.000478  5572 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:22.990276  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:22.990113  5467 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:23.009997  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:23.008483  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.010907  5525 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.013314  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1967) took 3281 ms. Trace:
W20260709 13:01:23.014240  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2244) took 3299 ms (client timeout 2121 ms). Trace:
I20260709 13:01:23.016620  1602 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:01:23.018108  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59028.5us
I20260709 13:01:22.969031  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:23.014519  1683 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:23.023828  1682 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:01:23.066812  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.028391  1600 rpcz_store.cc:269] 0709 13:01:19.715044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.715334 (+   290us) service_pool.cc:224] Handling call
0709 13:01:23.013890 (+3298556us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54004560d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:23.014028 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436040064}
W20260709 13:01:23.043704  1573 connection.cc:256] RPC call timeout handler was delayed by -1.4671840579999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:01:23.033404  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.045274  1607 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:23.032452  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.030145  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:23.034780  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 84422.2us
W20260709 13:01:23.044628  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 1981) took 2351 ms (client timeout 1968 ms). Trace:
I20260709 13:01:23.076635  2259 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:23.076460  2261 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:23.037499  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:23.045280  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2253) took 3297 ms (client timeout 1592 ms). Trace:
I20260709 13:01:23.030319  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1973) took 2331 ms. Trace:
I20260709 13:01:23.053154  1603 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:23.027979  1604 rpcz_store.cc:276] 0709 13:01:19.732274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.631911 (+2899637us) service_pool.cc:224] Handling call
0709 13:01:22.632259 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.632567 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:22.675257 (+ 42690us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.773472 (+ 98215us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.791231 (+ 17759us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b18003f5f80. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:23.012779 (+221548us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18003f5f80. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:01:23.012954 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.013005 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:23.013046 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.013111 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.013235 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234210,"prepare.queue_time_us":58669,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":106,"raft.queue_time_us":242228,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":5974,"spinlock_wait_cycles":27029504,"thread_start_us":138073,"threads_started":2,"wal-append.queue_time_us":193633}
I20260709 13:01:23.148202  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:23.228072  1647 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.107s (SENT)
W20260709 13:01:23.153861  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.076483  1605 rpcz_store.cc:269] 0709 13:01:20.692946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.059766 (+366820us) service_pool.cc:224] Handling call
0709 13:01:23.044361 (+1984595us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003c6254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:23.044540 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355722496}
I20260709 13:01:23.108292  2253 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:23.014767  5500 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.167352  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:23.165658  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 187585us
I20260709 13:01:23.147239  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.173377  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:23.182318  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:23.181150  1679 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:23.272809  2261 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:23.031219  5512 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.032719  5525 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.274145  5444 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:23.269855  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.264613  1681 rpcz_store.cc:276] 0709 13:01:20.698661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.051369 (+352708us) service_pool.cc:224] Handling call
0709 13:01:21.051672 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.707931 (+656259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.029891 (+1321960us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54001086d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:23.030135 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505264512}
W20260709 13:01:23.082427  1573 connection.cc:256] RPC call timeout handler was delayed by -1.3191551920000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28740000000000004s for a response
I20260709 13:01:23.166546  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:23.276232  1573 connection.cc:256] RPC call timeout handler was delayed by -1.2513769790000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:01:23.276628  1604 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 13:01:23.276959  1573 connection.cc:256] RPC call timeout handler was delayed by -1.0252840580000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:01:23.183456  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 79967.4us
I20260709 13:01:23.147584  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.274927  2259 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
W20260709 13:01:23.081094  1606 rpcz_store.cc:269] 0709 13:01:19.747330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.560604 (+813274us) service_pool.cc:224] Handling call
0709 13:01:23.044965 (+2484361us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540034b2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:23.045103 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433284992}
I20260709 13:01:23.041848  5511 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.277851  1600 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:23.277330  1573 connection.cc:256] RPC call timeout handler was delayed by -1.00188405800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:01:23.046483  5220 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:23.277217  1604 pending_rounds.cc:85] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:01:23.282393  1604 pending_rounds.cc:107] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:01:23.282609  1604 raft_consensus.cc:2889] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.041378  4933 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:23.281849  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.284933  1675 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.285177  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.278278  1602 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:23.230513  5506 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:23.284479  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.288743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.288069  1682 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.289829  1679 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.273746  5512 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.291009  1683 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.292340  1678 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:23.289670  5531 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:23.293550  5531 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.296052  5531 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.297498  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1968) took 3564 ms. Trace:
I20260709 13:01:23.298003  1608 rpcz_store.cc:276] 0709 13:01:19.732622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.661349 (+2928727us) service_pool.cc:224] Handling call
0709 13:01:23.018529 (+357180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.031678 (+ 13149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.031718 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.031763 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:23.031797 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.031858 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.297185 (+265327us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54004560d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:23.297347 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740169472}
W20260709 13:01:23.300369  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 153609us
I20260709 13:01:23.304715  2257 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:23.310117  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.310904  2259 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
W20260709 13:01:23.308462  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.542s (SENT) [suppressed 41 similar messages]
I20260709 13:01:23.321260  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 953) took 1422 ms. Trace:
I20260709 13:01:23.285594  5220 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:23.320187  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 312) took 43738 ms (client timeout 15000 ms). Trace:
I20260709 13:01:23.326826  1682 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.287760  5574 raft_consensus.cc:2764] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:23.325994  2258 rpcz_store.cc:276] 0709 13:01:21.898927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.899056 (+   129us) service_pool.cc:224] Handling call
0709 13:01:23.321026 (+1421970us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54007378d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:23.321178 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561847680}
I20260709 13:01:23.284471  4933 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:23.380787  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1984) took 2452 ms. Trace:
I20260709 13:01:23.381283  1604 rpcz_store.cc:276] 0709 13:01:20.928851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.272452 (+2343601us) service_pool.cc:224] Handling call
0709 13:01:23.272913 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.380509 (+107596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.380722 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.390443  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:23.392228  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:23.394567  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 86127.9us
I20260709 13:01:23.391659  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:23.395646  1675 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:23.395988  1602 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:23.399708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 230400us
I20260709 13:01:23.396620  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1987) took 2283 ms. Trace:
I20260709 13:01:23.403806  4933 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.414180  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1977) took 3023 ms. Trace:
I20260709 13:01:23.414589  1609 rpcz_store.cc:276] 0709 13:01:20.390652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.781148 (+2390496us) service_pool.cc:224] Handling call
0709 13:01:22.781633 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.016646 (+235013us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:23.016675 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.017291 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.165037 (+147746us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:23.165954 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.166068 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.413903 (+247835us) raft_consensus.cc:1685] finished
0709 13:01:23.413922 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.414101 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209295,"raft.queue_time_us":223757,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":90361,"threads_started":1,"wal-append.queue_time_us":309021}
W20260709 13:01:23.402156  1649 connection.cc:256] RPC call timeout handler was delayed by -1.4523387079999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:01:23.402215  1647 leader_election.cc:336] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.110s (SENT)
I20260709 13:01:23.413133  1602 rpcz_store.cc:276] 0709 13:01:21.113020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.287227 (+2174207us) service_pool.cc:224] Handling call
0709 13:01:23.388776 (+101549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.396349 (+  7573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.396543 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.417385  1604 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:23.418303  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1985) took 2449 ms. Trace:
I20260709 13:01:23.412601  2259 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:23.418618  1606 rpcz_store.cc:276] 0709 13:01:20.969175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.279887 (+2310712us) service_pool.cc:224] Handling call
0709 13:01:23.324119 (+ 44232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.399819 (+ 75700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.399850 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.399914 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:23.418094 (+ 18180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.418158 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.418247 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.403280  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.416891  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 1978) took 2989 ms. Trace:
I20260709 13:01:23.420796  1603 rpcz_store.cc:276] 0709 13:01:20.410018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.270427 (+2860409us) service_pool.cc:224] Handling call
0709 13:01:23.326295 (+ 55868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.398662 (+ 72367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.398698 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.398755 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:23.398795 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.398863 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.398988 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.407441  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.422876  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2257) took 2880 ms. Trace:
I20260709 13:01:23.287292  5500 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.425165  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:23.407316  5272 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.483997  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.400393  5545 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.391970  5561 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.424044  1605 rpcz_store.cc:276] 0709 13:01:20.542595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.270246 (+2727651us) service_pool.cc:224] Handling call
0709 13:01:23.290949 (+ 20703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.291226 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:23.291566 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.422482 (+130916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.422545 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:23.422598 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.422678 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.422810 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5100,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":5127,"thread_start_us":125408,"threads_started":1}
I20260709 13:01:23.535758  5577 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.536659  5575 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:23.535791  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 109344us
W20260709 13:01:23.533764  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 130658us
I20260709 13:01:23.540674  5502 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:23.557346  1600 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:23.367753  1432 rpcz_store.cc:269] 0709 13:00:39.581846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.583933 (+  2087us) service_pool.cc:224] Handling call
0709 13:01:23.319859 (+43735926us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:12.278559 (+     0us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54003d55a8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e69eed9e1 00007f7e69eec64c 00007f7e6757badc 00007f7e675670a6 00007f7e67566d58 00007f7e6756b9f1 00007f7e6756b9a9 00007f7e6756b939 00007f7e6756b901 00007f7e6756ab2d 000000000038f354
0709 13:01:12.278670 (+   111us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:12.279467 (+   797us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:12.279523 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:01:12.279543 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:12.280472 (+   929us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:12.280581 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:12.280613 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:12.281291 (+   678us) tablet.cc:701] Row locks acquired
0709 13:01:12.281345 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:01:12.281534 (+   189us) write_op.cc:270] Start()
0709 13:01:12.282017 (+   483us) write_op.cc:276] Timestamp: P: 1783602072281459 usec, L: 0
0709 13:01:12.282048 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:01:12.405387 (+123339us) log.cc:844] Serialized 2458 byte log entry
0709 13:01:13.554814 (+1149427us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b
0709 13:01:14.399391 (+844577us) op_driver.cc:464] REPLICATION: finished
0709 13:01:14.956040 (+556649us) write_op.cc:301] APPLY: starting
0709 13:01:14.982192 (+ 26152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:14.982383 (+   191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:14.982417 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:14.985763 (+  3346us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:14.986038 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:01:14.986092 (+    54us) write_op.cc:312] APPLY: finished
0709 13:01:14.986379 (+   287us) log.cc:844] Serialized 53 byte log entry
0709 13:01:14.986568 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.986672 (+   104us) write_op.cc:454] Released schema lock
0709 13:01:14.986733 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:15.013310 (+ 26577us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:15.018319 (+  5009us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":290784,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":509559,"apply.run_cpu_time_us":3120,"apply.run_wall_time_us":62008,"num_ops":6,"prepare.queue_time_us":187224,"prepare.run_cpu_time_us":24535,"prepare.run_wall_time_us":1952614,"raft.queue_time_us":233510,"raft.run_cpu_time_us":20646,"raft.run_wall_time_us":288480,"replication_time_us":2090351,"spinlock_wait_cycles":184461952,"thread_start_us":1705508,"threads_started":4,"wal-append.queue_time_us":1393341,"wal-append.run_cpu_time_us":26735,"wal-append.run_wall_time_us":1987457}]]}
W20260709 13:01:23.556375  5570 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:01:23.392827  5506 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:23.568933  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.556207  5575 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:23.579733  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 252925us
I20260709 13:01:23.540021  5545 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.563505  5512 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.569861  5511 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:23.587369  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 180069us
I20260709 13:01:23.567135  5577 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:23.571691  5525 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.561051  5570 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.580446  5575 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:23.592793  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 303293us
W20260709 13:01:23.600876  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 198719us
I20260709 13:01:23.603538  2257 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:23.604384  1675 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:23.605531  5545 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:23.605029  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:23.605644  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.606396  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.607018  1682 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:23.607263  5545 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:23.582530  5220 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.609965  5220 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.610035  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1960) took 3929 ms. Trace:
I20260709 13:01:23.610688  1680 rpcz_store.cc:276] 0709 13:01:19.661321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.558266 (+896945us) service_pool.cc:224] Handling call
0709 13:01:20.561919 (+  3653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.942337 (+380418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.569811 (+2627474us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54001d9054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:23.590719 (+ 20908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873238272}
I20260709 13:01:23.613163  5561 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.613866  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.614675  5545 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.614997  5500 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.615190  5545 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:23.616606  5545 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.618256  5506 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:23.619831   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.581581  5272 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.622367  5272 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:23.588258  5511 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:23.629947  5511 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.604993  5577 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:23.634294  1499 connection.cc:256] RPC call timeout handler was delayed by -2.5800996099999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:01:23.634763  1499 connection.cc:256] RPC call timeout handler was delayed by -2.4261996099999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:01:23.635049  1499 connection.cc:256] RPC call timeout handler was delayed by -2.196699609999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:01:23.635346  1499 connection.cc:256] RPC call timeout handler was delayed by -2.1075996099999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:01:23.635610  1499 connection.cc:256] RPC call timeout handler was delayed by -2.0130996099999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:01:23.626737  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:23.636807  5561 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:23.637032  5467 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.637439  5561 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.639135  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:23.639887  5467 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.640255  5467 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.629271  5570 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.640630  5467 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.636498  5574 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:23.641310  5574 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.643044  5574 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.643877  5561 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:23.646029  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:23.646852  5570 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.653920  5506 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:23.654891  5506 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:23.655241  5506 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:23.656277  5506 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.657802  5506 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.658401  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.658811  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:23.659166  1680 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:23.659237  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.659485  1682 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.660048  1681 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.661487  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.655113  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:23.663882  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:23.664233  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:23.665095  1681 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:23.665714  1675 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.664763  1680 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.664865  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.668000  1674 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.669188  5574 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.675820  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:23.676537  1573 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.033s (SENT)
I20260709 13:01:23.676745  1682 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:23.676951  5446 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.677356  5446 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:23.677743  5446 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.678689  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.679761  5574 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.680138  5574 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:23.680495  5574 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:23.682618  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.686945  5512 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:23.688058  5531 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:23.688470  5531 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:23.689128  5512 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:23.689232  5531 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.690690  1527 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 11. Ops: []
I20260709 13:01:23.690900  5531 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.691531  1533 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:23.692960  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.684144  5511 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.696383  5511 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.697095  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.698294  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.698805  1531 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.698553  5575 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.679001  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:23.701550  1525 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.704368  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.705195  5446 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.711826  1533 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:23.706717  5467 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.719841  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.720474  5467 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:23.721837  5248 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.722224  5248 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:23.722579  5248 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:23.712605  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 85482.8us
I20260709 13:01:23.725055  5575 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:23.729272  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.731472  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:23.734213  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.736104  1525 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:23.741909  5574 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.743116  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.744297  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.747252  5534 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:23.747792  5534 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:23.748996  5534 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.707739  5570 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:23.762089  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.769755  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.771963  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.788944  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:23.790689  1533 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:23.791872  1682 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.793020  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.794275  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.794963  1682 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.795960  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.758600  5506 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.799371  1682 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.796906  1674 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.808421  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.808725  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:23.811390  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74527.1us
I20260709 13:01:23.811642  1675 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:23.807627  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.809583  1679 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:23.780468  5446 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:23.815512  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.816087  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.817260  1682 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 6: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.817351  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:23.815086  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.770598  5402 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:23.820194  5402 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.820555  5402 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.820879  5402 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.821785  5248 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.818621  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:23.824079  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.818990  1681 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:23.819660  1533 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.824781  1525 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:23.825470  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.825616  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:23.826231  1681 raft_consensus.cc:2376] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12. Re-sending same reply.
I20260709 13:01:23.827574  5570 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.828011  5570 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.827080  5528 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.828902  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.813711  5534 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.828385  5570 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.830103  5534 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:23.831058  5534 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.831463  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.833853  5531 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:23.834264  5531 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:23.835026  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.835673  5439 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:23.836089  5439 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:23.836905  5439 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.837970  5439 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:23.840337  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.835562  5574 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.827165  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.841756  5248 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:23.842434  5574 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.843009  5574 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:23.843770  1677 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:23.843978  5574 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.844889  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.845678  1676 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:23.846063  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2087) took 1072 ms. Trace:
I20260709 13:01:23.811115  5506 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.831410  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.848738  2254 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.846319  1676 rpcz_store.cc:276] 0709 13:01:22.775920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.844618 (+1068698us) service_pool.cc:224] Handling call
0709 13:01:23.846011 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.852056  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.852226  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.852648  2253 raft_consensus.cc:2376] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11. Re-sending same reply.
I20260709 13:01:23.853462  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.854058  2253 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:23.854739  2256 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:23.855103  2253 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:01:23.855829  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.857079  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.857766  2254 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:23.864899  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:23.866895  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.866974  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.869187  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.850657  4933 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.869537  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.870373  1529 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:23.870554  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:23.871066  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.867158  2253 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:23.871737  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:23.872515  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.873082  2261 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:23.873406  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.874847  2252 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:23.867883  2255 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:23.877421  1527 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:23.879585  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.877049  4956 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.864074  5506 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.885143  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.886206  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.886371  1529 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:23.887789  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:23.888041  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.888417  1531 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.884943  4956 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.890187  4956 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.892455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.893095  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:23.893290  1532 raft_consensus.cc:2410] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:23.888417  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.894372  1527 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:23.896095  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:23.835060  5531 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.901669  1531 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:23.905314  5572 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.907222  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:23.903510  5574 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.911643  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:23.916654  1529 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:23.916792  5531 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.911789  5545 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:23.917866  5545 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:23.912438  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:23.919459  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:23.916041  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.909839  5590 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.923519  5590 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:23.924113  5590 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.926564  5402 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.921067  5506 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.940577  5506 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:23.920809  5588 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:23.940804  5545 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.941596  5506 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.920607  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:23.927424  1528 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:23.929513  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.931283  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.945590  2257 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:23.931229  5590 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:23.946445  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:23.947103  2257 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:23.947566  5590 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.932367  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.948452  2254 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:23.948184  5590 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.949033  5590 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.949276  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.949918  2254 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:23.950228  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54199.6us
I20260709 13:01:23.931953  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.949421  5590 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.932628  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.945794  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.951031  2256 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:23.950939  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:23.947795  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.948550  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.959975  1533 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:23.960287  2252 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:23.959784  2257 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:23.955662  2259 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:01:23.961375  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45698.6us
I20260709 13:01:23.966121  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:23.829177  5528 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:23.967543  2255 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:23.967674  1528 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.968008  2260 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:23.976518  2254 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:23.981125  5593 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.009274  5593 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:23.989603  2261 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:24.019382  5593 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:23.990064  5585 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:01:23.990577  5586 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.021234  5586 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:24.021680  5586 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.023700  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.025394  5439 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.026515  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:24.027679  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45263.3us
I20260709 13:01:23.979633  4933 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.005663  4956 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.005791  5506 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.006381  5402 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:23.916338  5574 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.049485  5574 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.027387  1528 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:24.027411  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:24.024433  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 73561.8us
I20260709 13:01:24.049656  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.052513  2261 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.053922  4956 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:23.994804  5590 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.026890  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:24.039108  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119080us
I20260709 13:01:24.044335  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.052515  4933 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:01:24.069088  1525 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.027511  5439 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:24.070434  5439 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.077533  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.080478  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.084076  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:24.087718  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 334948us
I20260709 13:01:24.090762  1527 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:24.091022  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.091836  1533 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:24.093118  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.068934  5590 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:24.098029  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.094743  1526 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.098912  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.086409  5506 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.101389  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.102144  1600 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:24.109644  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.110423  1600 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.110147  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.100122  4933 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:01:24.116765  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.118505  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.118086  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.123108  1603 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.115476  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.117518  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.116765  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.119092  1604 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:24.005556  1427 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 5, now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:24.131680  1605 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.132606  5525 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.133044  5525 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:24.133430  5525 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.136520  5506 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.137341  5506 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:24.137756  5506 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.138731  2261 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:24.162142  1605 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:24.162058  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.158912  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:24.163504  2253 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.164917  5600 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:24.165818  5600 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:24.166146  5600 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.168956  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.169324  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.163549  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.173126  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:24.174050  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48623.2us
I20260709 13:01:24.174624  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.181321  5593 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.173754  1606 raft_consensus.cc:2376] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:01:24.182297  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.185927  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.185144  5506 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.186153  5592 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:24.181914  5593 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.185737  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.187039  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.188606  5595 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:24.125963  5570 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:24.205103  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.201624  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.208654  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.160395  5512 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:24.189198  5272 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:24.212100  5588 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:24.212731  5588 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.212680  5590 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.213606  5590 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:24.209798  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.213853  5531 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:24.193553  5402 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:24.216374  5506 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.218554  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.219669  1527 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.220911  1528 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:24.221619  1525 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:24.220844  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.222447  1526 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:24.222819  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.191197  5593 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.224466  1606 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:24.240799  1603 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:24.243723  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53885.6us
I20260709 13:01:24.193060  5595 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.254369  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.258005  1603 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.239964  5590 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.168574  5600 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.254446  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:24.280153  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 99688.3us
I20260709 13:01:24.259514  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.284070  1533 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:24.285388  1573 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.290822  5574 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.292603  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.286914  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:24.253459  5512 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:24.297221  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.298476  5592 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:24.295554  5600 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.313558  5592 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.314643  5592 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:24.298802  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 72797.3us
I20260709 13:01:24.302889  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.304540  5595 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:24.305943  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51562.3us
I20260709 13:01:24.306733  5605 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.213634  5588 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.309154  4956 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:24.319736  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.318038  1606 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.316074  5592 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.319186  5512 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.327591  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.313357  5570 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:24.212168  1427 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 6, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:24.334347  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47712.1us
I20260709 13:01:24.336841  1573 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.335157  5512 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.339496  4956 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:24.339217  5586 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.339882  4956 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:24.340806  4956 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.342077  4956 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.344689  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.344877  5588 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:24.345366  1526 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:24.345901  5525 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.346917  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.348047  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.348558  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.349076  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.348654  1525 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:24.346238  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.350602  1526 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.352015  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.352047  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.351511  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.354812  1531 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.350629  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:24.352831  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 109874us
I20260709 13:01:24.358875  1603 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:24.359877  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.360047  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.361544  1527 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:24.323722  5605 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.364781  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.366276  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:24.371841  1606 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:24.365267  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.373353  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.374027  1682 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:24.374174  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.355919  5531 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.375146  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.379191  2261 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:24.376060  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.323751  5402 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:24.377399  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.381008  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.383479  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.384063  1525 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.383503  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:24.381397  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62536.5us
I20260709 13:01:24.378253  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.385757  2257 raft_consensus.cc:2376] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:01:24.382257  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:24.382513  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.381088  5574 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:24.365566  5577 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.367375  5595 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:24.387719  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.388152  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.388298  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.386583  5607 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.389734  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.389869  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.390161  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.356855  4933 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:24.367710  5525 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.410385  2257 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.412838  1533 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.402509  2255 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:24.405861  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.406400  2260 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:24.365379  5605 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.407302  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.408495  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.411103  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.413034  1678 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:24.397230  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.378244  5570 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.381870  5506 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:24.424642  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:24.420746  5606 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:24.421620  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.421217  1427 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 7, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:24.424068  5570 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:24.425438  2261 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:24.407735  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:24.426736  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 62428.9us
I20260709 13:01:24.428282  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.428372  1530 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:24.429410  1680 raft_consensus.cc:2376] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8. Re-sending same reply.
I20260709 13:01:24.435137  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.396298  5592 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.436468  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.437773  1528 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:24.436925  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.438916  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:24.440522  5586 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.441195  5586 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.441551  5586 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:24.441848  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.441696  5525 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.442744  5525 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.432672  5570 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.443234  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.443421  5416 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.443849  5416 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:24.444339  5416 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.442772  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.444823  5583 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.445230  5583 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.445529  5583 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.445833  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.447559  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.443100  5525 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.426328  5506 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.453359  5506 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.454679  5506 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.454908  5593 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.430548  5577 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:24.408648  5572 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:01:24.461409  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.463757  1600 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:01:24.464159  1600 pending_rounds.cc:85] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 6
I20260709 13:01:24.464432  1600 pending_rounds.cc:107] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:01:24.464668  1600 raft_consensus.cc:2889] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.465449  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.467052  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.467831  5467 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.441964  5586 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.433522  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.468254  5467 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.468750  5467 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.468858  1529 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.469810  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.464838  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.470582  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:24.471248  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45114.7us
I20260709 13:01:24.473258  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:24.473809  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.474212  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.475085  1530 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.467538  1533 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:24.446883  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.476713  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.478324  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.480691  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.481868  1534 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:24.482808  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.483680  1534 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:24.484699  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.485652  1534 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.486061  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.487216  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.420287  5590 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.489899  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.489370  1427 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 8, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:24.490633  1533 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.491446  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.491065  1427 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 7, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.492507  1608 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.493620  5583 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.495244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.496579  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.497154  5577 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:24.497552  5577 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:24.497809  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:24.498415  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.499388  1533 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:24.474625  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.502595  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.483050  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.505192  1530 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:24.508350  1529 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:24.509541  1529 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:24.510066  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.510706  1529 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:24.510095  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.512851  5248 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.513284  5248 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.513641  5248 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.513986  5512 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.516618  5439 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.488160  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:24.516510  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.525245  1608 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:24.531082  1605 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:24.533834  5607 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.535435  5607 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.536537  1530 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:24.537695  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65359.5us
I20260709 13:01:24.435999  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.538404  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.540096  1531 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.573577  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.573812  5528 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:24.574842  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.576054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.577764  5416 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:24.594735  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 161103us
I20260709 13:01:24.599829  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:24.599258  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 68352.4us
I20260709 13:01:24.601003  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.601262  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:24.603332  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.580284  5416 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.581619  4956 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:01:24.607084  1607 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:24.612879  1532 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:24.618559  1525 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:24.582306  5592 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:24.620270  1680 raft_consensus.cc:2368] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9.
W20260709 13:01:24.620990  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 90821.1us
I20260709 13:01:24.623699  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:24.625270  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.625535  1531 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:24.628736  1601 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:24.629441  1527 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:24.539724  5439 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:01:24.635407  1525 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:24.632881  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.633069  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.570250  5511 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.599810  1678 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:24.637050  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:24.581526  5512 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:24.637843  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.638631  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.498364  5577 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.646940  5525 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.647680  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.648761  5446 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.651489  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:24.666658  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 156666us
I20260709 13:01:24.667130  1603 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:24.667745  1648 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.662s (SENT)
I20260709 13:01:24.652635  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.621572  5531 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.648094  1526 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:24.661479  1600 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:24.656627  5574 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.668576  1606 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:24.672101  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.677362  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.678500  1682 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:24.680238  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.684031  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.687930  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.688452  1607 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:24.689045  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:24.693558  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92366.8us
I20260709 13:01:24.700176  5446 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:24.703979  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:24.704447  1676 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:24.704587  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:24.704797  1675 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:24.707939  1680 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:24.709793  1680 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:24.710165  1606 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:24.712127  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.712721  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.735198  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:24.735392  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67679.4us
I20260709 13:01:24.740581  1676 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:24.749894  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.751531  1606 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:24.711925  5583 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:24.758589  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 85708.7us
I20260709 13:01:24.759743  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.762621  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.764575  1603 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:24.766428  1600 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:24.691802  5593 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:24.766849  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.772418  1607 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:24.660507  5511 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.767483  1606 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:24.768110  1534 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:24.768537  5525 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.769336  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:24.774816  1606 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:24.760041  5577 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.782382  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.782955  2252 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.778085  1499 leader_election.cc:400] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9.
I20260709 13:01:24.779515  5220 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:24.780422  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.785275  1499 leader_election.cc:403] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.801924  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.803438  2255 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:24.809940  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.845605  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:24.777660  5439 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.858865  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:24.859936  2254 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:24.859555  2261 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.829531  1606 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.802318  5220 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:24.873111  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.853055  4933 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:24.861191  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.874241  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111670us
I20260709 13:01:24.879514  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.899232  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:24.908474  1606 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.912796  2261 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:24.865845  5439 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:24.853677  5570 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.864809  5574 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9.
W20260709 13:01:24.925423  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.927683  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64920.1us
I20260709 13:01:24.929972  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:24.854183  5617 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:01:24.899324  4933 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:24.934494  4956 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:24.936442  5220 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.937692  5220 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.938735  5615 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.940639  5511 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:24.715091  1427 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 7, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.951058  5623 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:24.906956  5467 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:24.952814  5590 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:24.953814  5467 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:24.954751  5467 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:24.955235  5467 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:24.956102  5467 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.956861  5439 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.906032  5248 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:24.865483  5272 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:24.963466  4933 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.994493  4933 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:25.004019  5570 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:25.003931  4933 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:25.007352  5248 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:25.008496  1682 raft_consensus.cc:2368] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
W20260709 13:01:25.209877  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.295210  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 434119us
W20260709 13:01:25.346284  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45554.6us
I20260709 13:01:25.353581  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:25.355391  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:25.357571  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 458378us
I20260709 13:01:25.351563  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:25.378991  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.143s (SENT)
W20260709 13:01:25.407867  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 343452us
W20260709 13:01:25.408706  1648 leader_election.cc:336] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.161s (SENT)
W20260709 13:01:25.409282  1648 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.179s (SENT)
I20260709 13:01:25.409642  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:25.381573  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:25.484807  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75534.6us
W20260709 13:01:25.488361  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 131108us
I20260709 13:01:25.379899  5248 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.379336  5583 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:25.406847  5570 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:25.381237  5534 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:25.489840  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:25.644954  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 155205us
I20260709 13:01:25.688777  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:25.379019  5525 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.161s
I20260709 13:01:25.381409  5416 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.248s
W20260709 13:01:25.494904  5605 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.074s	user 0.006s	sys 0.004s
W20260709 13:01:25.540395  5439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.001s
I20260709 13:01:25.380988  4933 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.248s
I20260709 13:01:25.682168  5534 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:26.050231  2227 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.511s (SENT)
I20260709 13:01:26.052228  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:25.642979  5272 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:25.488668  5623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.010s
W20260709 13:01:26.070053  2252 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.218s	user 0.010s	sys 0.002s
I20260709 13:01:26.071177  2252 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:26.072068  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 707) took 1290 ms. Trace:
I20260709 13:01:25.686203  5248 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.392518  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2004) took 1685 ms. Trace:
W20260709 13:01:26.382704  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 1.02413e+06us
I20260709 13:01:26.072477  2252 rpcz_store.cc:276] 0709 13:01:24.782021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.782144 (+   123us) service_pool.cc:224] Handling call
0709 13:01:26.071996 (+1289852us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:26.383685  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 333470us
W20260709 13:01:25.985852  5439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.009s	sys 0.003s
W20260709 13:01:26.060281  5623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.002s	sys 0.011s
W20260709 13:01:26.405547  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.010s	sys 0.003s
W20260709 13:01:26.424109  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.010s	sys 0.003s
I20260709 13:01:26.049335  5617 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:26.059978  5583 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.403726  2253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.005s	sys 0.021s
W20260709 13:01:26.440411  2253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.506s	user 0.005s	sys 0.021s
W20260709 13:01:26.077687  5586 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.539s	user 0.011s	sys 0.000s
I20260709 13:01:26.060959  5534 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:26.376346  5511 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:26.410419  2227 leader_election.cc:336] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.561s (SENT)
I20260709 13:01:26.447615  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.421769  1675 rpcz_store.cc:276] 0709 13:01:24.707564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.714359 (+  6795us) service_pool.cc:224] Handling call
0709 13:01:24.714650 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.748614 (+ 33964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.748650 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.758870 (+ 10220us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.197249 (+438379us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:25.197296 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.197376 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.392129 (+1194753us) raft_consensus.cc:1685] finished
0709 13:01:26.392155 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.392430 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7461,"thread_start_us":396338,"threads_started":1,"wal-append.queue_time_us":1618055}
I20260709 13:01:26.433198  5623 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:26.439277  4933 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.435557  5617 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.046594  5605 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.445735  5439 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:26.454420  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.001s	sys 0.017s
W20260709 13:01:26.460445  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.001s	sys 0.017s
I20260709 13:01:26.445523  5626 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.077523  5272 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:26.469831  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.466230  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.007s	sys 0.019s
W20260709 13:01:26.485239  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.007s	sys 0.019s
W20260709 13:01:26.496490  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86102.6us
I20260709 13:01:26.457231  5617 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.459693  5416 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:26.507184  2224 connection.cc:256] RPC call timeout handler was delayed by -1.0123494410000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:26.447186  5586 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.456670  4933 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.444648  5583 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:26.506534  2227 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.635s (SENT)
I20260709 13:01:26.601914  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:26.629483  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.013s	sys 0.066s
W20260709 13:01:26.630252  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.858s	user 0.014s	sys 0.066s
W20260709 13:01:26.633033  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 126534us
W20260709 13:01:26.630563  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 1.87592e+06us
W20260709 13:01:26.651291  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.023s	sys 0.053s
W20260709 13:01:26.651837  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.023s	sys 0.053s
I20260709 13:01:26.634768  5416 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:26.654793  5467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.695s	user 0.031s	sys 0.044s
I20260709 13:01:26.659992  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:26.665956  4933 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:26.666625  4933 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.666880  5272 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:26.664148  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.005s	sys 0.001s
W20260709 13:01:26.664222  5467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.705s	user 0.031s	sys 0.044s
W20260709 13:01:26.670076  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.005s	sys 0.001s
I20260709 13:01:26.674356  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:26.674154  2227 leader_election.cc:336] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.731s (SENT)
I20260709 13:01:26.653786  5623 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.671792  5635 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.668819  4933 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.671182  5511 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:26.687351  5511 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.689858  5248 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:26.690208  5633 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.690711  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 708) took 1889 ms. Trace:
I20260709 13:01:26.690824  5633 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:26.688119  5577 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 1.883s	user 0.010s	sys 0.000s
I20260709 13:01:26.693251  5633 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:26.691102  2253 rpcz_store.cc:276] 0709 13:01:24.800937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.802606 (+  1669us) service_pool.cc:224] Handling call
0709 13:01:24.854506 (+ 51900us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:24.866180 (+ 11674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.866210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:24.876855 (+ 10645us) log.cc:844] Serialized 52 byte log entry
0709 13:01:26.441520 (+1564665us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:26.670748 (+229228us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.671052 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.671136 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.690447 (+ 19311us) raft_consensus.cc:1685] finished
0709 13:01:26.690468 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.690617 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3494,"raft.queue_time_us":9121,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":11541,"thread_start_us":1725152,"threads_started":2,"wal-append.queue_time_us":1738731}
W20260709 13:01:26.694715  2227 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.876s (SENT)
I20260709 13:01:26.676684  5570 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:26.700979  2227 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.991s (SENT)
I20260709 13:01:26.703161  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.704952  5583 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.686973  5605 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:26.711084  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 286157us
I20260709 13:01:26.709620  5583 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.702198  5272 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.712334  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:26.712455  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 302596us
I20260709 13:01:26.702503  5467 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.714063  5570 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:26.715282  1648 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.597s (SENT)
I20260709 13:01:26.715663  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:26.716739  1648 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.599s (SENT)
I20260709 13:01:26.717547  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.716473  5248 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.714401  5272 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.719026  4933 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:26.720818  1648 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.632s (SENT)
I20260709 13:01:26.718575  5633 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:26.721822  1648 leader_election.cc:336] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.657s (SENT)
W20260709 13:01:26.722421  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.876s (SENT)
I20260709 13:01:26.722908  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.723785  5623 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.713275  5586 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:26.720903  5272 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.722375  5446 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.717948  5635 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:26.728601  5635 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:26.731405  5635 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:26.736721  5641 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:26.737076  5534 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.738260  5641 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:26.738632  5641 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:26.739365  5641 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.740358  5534 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:26.741695  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.742126  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.745421  5635 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.746052  5635 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.747547  5633 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.748365  5635 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:26.749544  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.749888  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:26.750380  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.750778  1675 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:26.750993  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.750206  5416 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.747563  5617 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.753328  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:26.754091  1529 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.750896  5641 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:26.759580  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 1.82626e+06us
I20260709 13:01:26.752521  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:26.762424  1532 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:26.762782  1529 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:26.763164  5248 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.756009  5617 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:26.764166  1648 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.887s (SENT)
I20260709 13:01:26.764550  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:26.764638  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.765296  1675 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:26.766463  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.766860  5248 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.767896  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:26.769573  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:26.769950  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:26.771205  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:26.771704  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.772969  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.773144  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:26.773633  1678 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.774608  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:26.775497  5640 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:26.776139  5640 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:26.772094  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:26.772033  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.778107  1675 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.781253  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.782007  1680 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.783233  5641 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.783988  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.784655  1683 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.785022  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.785734  1679 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.785665  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.777150  5640 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.786875  1676 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:26.784682  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:26.789996  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:26.794361  1681 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:26.797566  1678 raft_consensus.cc:2410] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:26.804075  1529 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:26.808699  5638 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:26.785904  5633 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.814644  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.815474  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:26.816422  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:26.817096  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:26.817513  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:26.818259  1607 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:26.818420  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:26.818989  1529 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.819494  5416 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.820047  5416 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.820636  5617 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.821193  5617 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.822448  5416 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.823534  5617 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.825937  5617 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.826594  5617 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.829478  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.814728  1680 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
W20260709 13:01:26.830269  1606 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.921s	user 0.024s	sys 0.004s
I20260709 13:01:26.831246  1606 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:26.833071  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.837385  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:26.837448  1679 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:26.838858  1529 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:26.839965  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:26.837356  1683 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:26.843336  5416 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.843531  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.843976  5416 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.845312  2253 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:26.846345  5618 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:26.846828  5416 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.847467  5534 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:26.848567  5416 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:26.849126  5416 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:26.850034  5416 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.836886  5248 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.853689  5272 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:26.855396  5272 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.855813  5272 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:26.856405  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 661) took 2124 ms. Trace:
I20260709 13:01:26.859045  1675 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:26.862229  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.864300  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.863713  1606 rpcz_store.cc:276] 0709 13:01:24.708033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.752082 (+ 44049us) service_pool.cc:224] Handling call
0709 13:01:24.767398 (+ 15316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.831736 (+2064338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.831989 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:26.866387  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.867588  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:26.863862  1674 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:26.868819  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.864466  1607 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:26.870214  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.864965  2255 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:26.873468  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.874576  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.868155  1606 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:01:26.881211  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.884506  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:26.885025  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.884557  1607 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:01:26.885087  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.885196  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.885406  1526 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:26.887209  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.887686  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.887682  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:26.888952  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.891605  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.892234  2252 raft_consensus.cc:2376] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7. Re-sending same reply.
I20260709 13:01:26.893913  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:26.894513  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.885025  5646 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:26.902853  2255 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.896104  5641 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.897285  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.903769  5617 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:26.904838  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.905835  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:26.907071  5446 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.907874  5636 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.898339  5511 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:26.910346  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:26.912145  2260 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:26.913388  2255 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [6.7-10.9]
I20260709 13:01:26.893419  5633 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.900969  2252 raft_consensus.cc:2368] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:01:26.900787  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.886663  5618 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:26.894795  1529 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:26.894819  1606 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:26.917062  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:26.917529  5618 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:26.917793  2252 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:01:26.915201  1648 leader_election.cc:336] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.999s (SENT)
I20260709 13:01:26.915175  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.919319  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.922849  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.923574  2260 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.918690  5618 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.925071  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.927199  2252 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.927489  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:26.928289  5534 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:26.928684  5534 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.929032  5534 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.929549  5623 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.924682  5586 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.931003  5586 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:26.931368  5586 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.938509  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.939278  2257 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.939473  5467 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.915177  5272 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:26.941233  5272 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.941779  5641 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:26.942677  1648 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.017s (SENT)
I20260709 13:01:26.943158  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.943974  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:26.910398  5635 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:26.944716  2258 raft_consensus.cc:2368] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:26.910401  5636 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:26.945180  5636 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.925436  2255 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.952299  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.952533  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:26.959928  1573 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.953635  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:26.925688  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 98468.3us
I20260709 13:01:26.957310  5446 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.959473  1607 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:26.963563  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.948122  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:26.963845  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.961200  1606 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:26.966953  2252 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:26.967628  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:26.968349  5605 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.944757  5635 consensus_queue.cc:1243] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:26.971293  1573 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:26.975939  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:26.978477  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.958s (SENT)
I20260709 13:01:26.978967  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:26.978538  1574 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.081s	user 0.004s	sys 0.016s
W20260709 13:01:26.979579  1574 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.082s	user 0.005s	sys 0.017s
W20260709 13:01:26.979897  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 2.08236e+06us
W20260709 13:01:26.980525  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.980863  5545 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.971055  5570 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:01:26.983852  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:26.969871  5646 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.995465  2260 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
W20260709 13:01:26.996822  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 79835.2us
I20260709 13:01:26.980471  5650 raft_consensus.cc:2764] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:27.001151  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.001098  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.002122  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.005997  1679 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.002017  1683 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:27.007397  1683 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:27.003823  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.008764  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.012985  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.013561  5632 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:27.014683  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.018702  1679 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:27.019634  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.019964  1674 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:27.020334  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:27.020581  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.021091  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.021593  1678 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.021706  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.022064  1680 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:27.022290  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.022707  5632 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.022935  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.023123  5657 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.023460  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.023991  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.023939  5657 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:27.024650  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 3.093s (SENT)
I20260709 13:01:27.024950  1680 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:27.025110  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.026077  5439 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.026580  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.027406  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.028056  1681 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:27.028891  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.029707  1681 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:27.015522  5646 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.997982  5640 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.999328  5446 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.031167  1679 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:27.037683  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.039628  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:27.008806  5605 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.025296  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.026918  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:27.035986  5632 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:27.041383  1683 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.046991  5632 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.026073  5656 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:01:27.054623  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 1996) took 2367 ms (client timeout 2125 ms). Trace:
I20260709 13:01:27.049423  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.029927  5570 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.056464  1677 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:01:27.055066  1682 rpcz_store.cc:269] 0709 13:01:24.687419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.687678 (+   259us) service_pool.cc:224] Handling call
0709 13:01:27.054388 (+2366710us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540024a4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:27.054554 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735167360}
I20260709 13:01:27.033784  5650 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.058966  2227 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.009042  5617 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:01:27.061196  5657 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:27.061818  1573 leader_election.cc:400] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:01:27.062178  1573 leader_election.cc:403] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.064448  1683 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.067803  5623 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.059059  5660 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.071117  5534 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.071552  2255 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:27.074896  5586 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.075618  1683 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:01:27.077356  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.030740  5628 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:27.078016  1534 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:27.061493  5662 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.076577  5511 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.081182  5583 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.081885  5583 consensus_queue.cc:1243] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:27.082115  5658 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:27.083084  5570 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.057421  5605 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:27.083561  5570 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.091593  5570 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:27.084671  5605 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.096861  5586 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:27.097710  5586 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:27.098059  5586 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:27.098884  5586 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.101845  5636 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.103184  1676 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:27.105885  5636 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:27.078766  5650 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:27.106580  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 712) took 1460 ms. Trace:
I20260709 13:01:27.107008  2261 rpcz_store.cc:276] 0709 13:01:25.645788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.645932 (+   144us) service_pool.cc:224] Handling call
0709 13:01:25.646264 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.594826 (+948562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.594862 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.594910 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:26.594945 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.106342 (+511397us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54007ae254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:27.106390 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.106519 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180861312}
I20260709 13:01:27.080358  5416 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.086292  5662 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
W20260709 13:01:27.116724  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60917.4us
I20260709 13:01:27.100222  5586 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.117467  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:27.122270  1500 connection.cc:256] RPC call timeout handler was delayed by -1.1941148349999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:01:27.123030  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:27.122778  5646 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.123612  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64698.3us
I20260709 13:01:27.125764  2227 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:27.126030  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.125396  5646 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:27.126639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:27.126755  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65065.3us
I20260709 13:01:27.127993  1526 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:27.129523  5646 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:27.129889  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.130568  1529 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:27.131330  1674 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.131897  5534 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:27.107246  5650 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:27.126329  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.133862  1573 leader_election.cc:400] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:27.134215  1573 leader_election.cc:403] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.134173  5667 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:27.133874  1534 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:27.136093  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.137214  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.138176  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.138968  1674 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:27.139159  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.139813  1534 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:27.131332  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.141358  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.142115  1531 raft_consensus.cc:2368] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:27.140980  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.133026  5416 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.173875  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.174213  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.173817  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:27.176265  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53313.5us
I20260709 13:01:27.178154  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:27.176102  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50398.3us
I20260709 13:01:27.179704  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.180935  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:27.181140  2227 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 2.171s (SENT)
I20260709 13:01:27.181759  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.193413  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.194617  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.195106  1529 raft_consensus.cc:2376] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9. Re-sending same reply.
I20260709 13:01:27.195875  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.196403  1529 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:27.197229  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.198210  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.199115  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.202112  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.201167  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.144889  5416 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:27.207175  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:27.208454  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.209944  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.178581  5667 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.213864  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:27.214447  5618 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:27.214999  5618 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.215458  5618 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.217593  5623 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.144029  5633 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:27.183260  5511 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.144071  5636 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:01:27.201066  5534 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:27.243541  1529 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:27.213251  5416 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:27.255231  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 229987us
I20260709 13:01:27.176091  5467 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:27.205637  5663 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.219281  5617 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.226243  5511 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.263535  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.254770  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.211136  5632 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:27.257406  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53852.5us
I20260709 13:01:27.270391  5669 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:27.270941  5669 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:27.257871  5666 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.267324  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.276238  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.276818  1529 raft_consensus.cc:2376] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:01:27.277603  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.278069  1529 raft_consensus.cc:2376] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:01:27.278759  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.279222  1529 raft_consensus.cc:2376] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10. Re-sending same reply.
I20260709 13:01:27.280099  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.280766  1529 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:27.281508  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.265349  5511 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.282819  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.283982  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.284617  1529 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:27.276547  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 2.50998e+06us
I20260709 13:01:27.264375  5272 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:27.290187  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.266310  5663 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.263522  5534 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:27.295353  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:27.295784  5605 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:27.325425  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.297762  5664 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:01:27.297384  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.297542  5646 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.296443  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.291917  5272 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:27.300984  5665 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:27.271836  5669 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.302688  5632 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:27.313009  1604 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 10. Ops: [8.7-8.7]
I20260709 13:01:27.315717  5660 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:27.336850  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 126973us
W20260709 13:01:27.295972  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 82188.8us
W20260709 13:01:27.327057  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 145950us
I20260709 13:01:27.338117  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:27.328703  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.332170  1529 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:27.312114  5666 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:27.330863  5615 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:27.339906  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:27.340205  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:27.340989  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:27.341586  2260 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:27.341636  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:27.342332  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.342514  2257 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:27.343739  2253 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:27.344698  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:27.344857  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.333806  5272 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.348783  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:27.367302  1529 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.335493  4933 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.353005  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:27.337236  5667 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:27.351787  5663 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:27.360378  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.360378  1528 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:27.361756  2256 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.363417  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:27.363509  5618 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:27.345979  5640 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:27.363343  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:27.344892  5534 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.365477  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.373514  1530 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
W20260709 13:01:27.380122  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51479.8us
I20260709 13:01:27.378239  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:27.374419  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:27.382134  1609 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:27.336511  5660 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:27.385013  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45404.8us
I20260709 13:01:27.387472  4933 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:27.365741  5586 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:27.392750  5660 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.394225  5660 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.394774  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:27.395372  2227 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.517s (SENT)
I20260709 13:01:27.395816  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.396489  5617 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:27.396826  5672 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.390311  4933 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:27.397846  4933 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.400146  1525 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:01:27.402541  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 139082us
I20260709 13:01:27.403069  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:27.397336  1530 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:27.404086  2253 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:27.403545  2261 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.405272  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.405941  1529 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
W20260709 13:01:27.409051  2227 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 2.253s (SENT)
I20260709 13:01:27.409580  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.410130  2261 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:27.414640  2256 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:27.382201  5615 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:27.416935  5635 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.413663  5586 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:27.448979  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:27.414577  5248 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.414410  5446 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:27.439412  5675 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.394356  5511 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.425781  2255 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:27.468375  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:27.472226  1605 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:27.417061  5668 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.416584  5636 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.421152  5650 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:27.484861  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.491618  1530 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:27.494160  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 106244us
I20260709 13:01:27.449138  5663 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:27.483547  5636 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:27.555408  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64114.2us
I20260709 13:01:27.481199  5632 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.562479  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.563766  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.565654  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:27.583967  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 168092us
I20260709 13:01:27.608004  5678 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:27.609087  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43498.1us
I20260709 13:01:27.607990  5534 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:27.609886  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:27.610215  5534 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.610874  5674 raft_consensus.cc:2764] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:27.610838  5534 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.611725  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.465737  5416 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:27.650537  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 201629us
I20260709 13:01:27.658004  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:27.619589  5534 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.489908  5248 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 13:01:27.702960  5586 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:27.571588  5636 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:27.710884  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59599.4us
I20260709 13:01:27.636548  5657 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.916857  5657 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.917316  5657 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.921778  1427 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 6, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:27.923795  5684 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:01:27.711776   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:27.702876  5650 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:27.760879  5680 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:27.772603  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 276897us
I20260709 13:01:27.774338  5690 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:27.496809  5683 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.243s
W20260709 13:01:27.781980  5681 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:01:27.783141  5679 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:01:27.794971  2258 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:27.795810  5676 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:01:27.850679  5674 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:27.850752  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 239061us
W20260709 13:01:27.990410  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.009s
I20260709 13:01:27.589429  5667 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.991421  5667 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.905258  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 451606us
W20260709 13:01:27.910655  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.966406  5650 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:27.678495  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 190384us
I20260709 13:01:27.936437  5699 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:27.941079  5685 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:01:27.944293  5416 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:27.945030  5511 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:27.927042  4933 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
W20260709 13:01:27.947628  5272 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.002s
I20260709 13:01:27.948736  5534 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:27.955554  5694 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.921051  5617 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:27.946609  5605 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.618s	user 0.019s	sys 0.004s
I20260709 13:01:27.977087  1499 leader_election.cc:400] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:27.946561  5678 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:27.990249  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:27.677860  5446 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:01:27.556658  5615 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:27.996142  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.006s
W20260709 13:01:28.021699  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.006s
W20260709 13:01:27.997449  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.002s	sys 0.009s
I20260709 13:01:27.976867  5690 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:27.991997  5667 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:27.970340  5646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.010s
W20260709 13:01:28.022888  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 608766us
I20260709 13:01:28.024276  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:28.024865  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55870.8us
W20260709 13:01:28.013856  5635 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 13:01:28.032868  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.023051  5605 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.041569  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:28.042878  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:28.043578  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:28.047125  1678 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:28.048748  1678 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:28.045020  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.051282  1675 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:28.029680  5586 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:28.052819  5677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.004s
W20260709 13:01:28.053246  5677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.006s	sys 0.005s
W20260709 13:01:28.030457  5646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.011s
I20260709 13:01:28.013686  4933 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.062491  4933 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.063983  1529 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.046125  1682 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
W20260709 13:01:28.066175  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61451.5us
I20260709 13:01:28.071681  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:28.013833  5272 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.033847  5635 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.073443  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.005863  5699 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.018989  5617 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.109090  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.046552  5678 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:28.029495  5640 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:28.108675  2261 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:28.116117  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.117381  1680 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:28.122889  1675 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.116382  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.123570  1678 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.025346  5657 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.068193  5586 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.117010  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.126921  1605 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:28.124007  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53656.9us
I20260709 13:01:28.125190  2253 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.046290  5683 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:01:28.101655  5583 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.129585  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:28.128122  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:28.015369  5694 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.011039  1427 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.033546  5650 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.147764  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:28.152194  2227 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.576s (SENT)
I20260709 13:01:28.164417  1678 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:28.125407  5678 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.183307  1574 leader_election.cc:400] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:28.183709  1574 leader_election.cc:403] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.127848  5663 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:28.189314  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.167711  5586 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.202082  1675 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:28.184466  5678 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.208623  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.209626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.190383  5605 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
W20260709 13:01:28.210657  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 85964.8us
I20260709 13:01:28.207299  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:28.211831  1675 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.196954  5650 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.198014  5586 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.224854  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:28.229931  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 671) took 1416 ms (client timeout 1517 ms). Trace:
W20260709 13:01:28.230360  1601 rpcz_store.cc:269] 0709 13:01:26.813434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.223244 (+1409810us) service_pool.cc:224] Handling call
0709 13:01:28.229854 (+  6610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.231465  1675 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:28.145627  5690 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.223600  5586 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.217553  5695 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:28.232034  5657 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.212347  5703 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.200s
I20260709 13:01:28.246323  5713 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.246685  5705 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.245998  1427 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.247031  5714 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:28.253099  5694 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.254158  5617 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.253098  2256 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:28.259178  5704 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:01:28.260257  5698 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:28.261080  5699 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:28.263235  5636 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.232156  5667 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.267619  1605 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:28.230394  5683 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.264106  5680 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.297195  5694 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.297703  5694 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.299772  5694 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.295336  5706 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:28.301911  5706 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.303927  5706 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.291661  5272 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.304523  5636 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.305177  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:28.305811  2256 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:28.307291  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 685) took 1101 ms. Trace:
I20260709 13:01:28.300808  1427 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:28.318662  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:28.307639  1603 rpcz_store.cc:276] 0709 13:01:27.205786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.400392 (+194606us) service_pool.cc:224] Handling call
0709 13:01:27.400719 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.401058 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.401100 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.401541 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.464076 (+ 62535us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:27.913965 (+449889us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.306749 (+392784us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800489220. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:01:28.306900 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.306979 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.307021 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:28.307117 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.307233 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22814,"prepare.queue_time_us":528541,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":80113,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":6617,"spinlock_wait_cycles":3917056,"thread_start_us":596199,"threads_started":3,"wal-append.queue_time_us":91237}
I20260709 13:01:28.325093  1499 leader_election.cc:400] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:28.325512  1499 leader_election.cc:403] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.326310  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:28.333271  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.334807  5712 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.336479  5716 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.337340  5716 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.340498  5694 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:28.340960  5694 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.341363  5694 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.340822  1427 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:28.342573  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.342329  1427 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 8, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.343282  1600 raft_consensus.cc:2376] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15. Re-sending same reply.
W20260709 13:01:28.343902  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 672) took 1530 ms (client timeout 1576 ms). Trace:
W20260709 13:01:28.344228  1600 rpcz_store.cc:269] 0709 13:01:26.813763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.342054 (+1528291us) service_pool.cc:224] Handling call
0709 13:01:28.343844 (+  1790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.317559  5272 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.353596  5272 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.280748  5713 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.344148  1427 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 6, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.367897  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 1999) took 3665 ms. Trace:
I20260709 13:01:28.323462  5674 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.364159  2257 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:28.365152  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.364948  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:28.295647  5683 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:28.352909  5727 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:28.363739  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.374331  2252 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:28.374596  1649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.635s (SENT) [suppressed 78 similar messages]
I20260709 13:01:28.356266  5272 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.372604  1677 rpcz_store.cc:276] 0709 13:01:24.702875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.704185 (+  1310us) service_pool.cc:224] Handling call
0709 13:01:27.056223 (+2352038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.056857 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.367658 (+1310801us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540024a4d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:28.367833 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5406880128}
I20260709 13:01:28.362661  5713 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.377290  5727 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.376735  1427 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 6, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 6 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:28.377710  5727 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.378221  5683 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.379631  5683 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.375388  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 668) took 1563 ms. Trace:
I20260709 13:01:28.380528  1608 rpcz_store.cc:276] 0709 13:01:26.812472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.363419 (+1550947us) service_pool.cc:224] Handling call
0709 13:01:28.375335 (+ 11916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.382928  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.383594  1525 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.387609  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:28.388229  2261 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:28.391494  1574 connection.cc:256] RPC call timeout handler was delayed by -2.2076515449999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:01:28.391952  1574 connection.cc:256] RPC call timeout handler was delayed by -2.1689515450000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:01:28.392244  1574 connection.cc:256] RPC call timeout handler was delayed by -2.019551545000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:01:28.392553  1574 connection.cc:256] RPC call timeout handler was delayed by -1.9403515449999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:01:28.392844  1574 connection.cc:256] RPC call timeout handler was delayed by -1.876451545000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:01:28.393122  1574 connection.cc:256] RPC call timeout handler was delayed by -1.8494515450000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:01:28.393409  1574 connection.cc:256] RPC call timeout handler was delayed by -1.8485515450000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:01:28.393702  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7072515450000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:01:28.393975  1574 connection.cc:256] RPC call timeout handler was delayed by -1.6532515449999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:01:28.394254  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5947515450000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:01:28.394527  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5929515450000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 13:01:28.394990  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5929515450000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 13:01:28.395334  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5560515450000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2263s for a response
W20260709 13:01:28.395788  1574 connection.cc:256] RPC call timeout handler was delayed by -1.280651545000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2569s for a response
I20260709 13:01:28.387348  5716 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.389746  5680 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.403250  5680 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.405611  5680 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.401587  5667 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.406484  5667 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.397874  5674 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.408612  5667 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.408773  5674 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.367235  5586 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.416132  1525 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:28.419435  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:28.400157  5678 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.411087  5272 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.432830  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2147) took 1031 ms. Trace:
I20260709 13:01:28.432682  5272 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.426710  5674 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.433148  5694 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.427677  5727 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.435753  5272 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:28.428175  5678 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.399993  1427 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 8, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.437723  1427 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.439535  1427 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:28.444612  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:28.445973  5712 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:28.446183  5713 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:28.446593  5713 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.446995  5713 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.446010  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:28.449259  5683 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:28.450018  5683 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.450403  5683 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:28.457265  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.457809  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.446717  5712 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:28.459146  2256 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.433277  1530 rpcz_store.cc:276] 0709 13:01:27.401559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.414808 (+ 13249us) service_pool.cc:224] Handling call
0709 13:01:27.446092 (+ 31284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.492058 (+ 45966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.432589 (+940531us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b540008d9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:28.432771 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104255232}
I20260709 13:01:28.488525  5688 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:28.489080  5688 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:28.490000  5688 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.491176  5688 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.491603  1530 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:28.498289  5678 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:28.499310  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.495658  5439 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.500670  5439 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.441272  1427 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.503347  5727 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.505949  2256 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.507025  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:28.504109  5439 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:28.507731  2261 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:28.508626  5732 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.509301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.509133  5732 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:28.509687  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 90314.7us
I20260709 13:01:28.509869  1602 raft_consensus.cc:2376] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7. Re-sending same reply.
I20260709 13:01:28.510449  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.510682  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.510396  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.511278  1600 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.511516  1608 raft_consensus.cc:2368] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
W20260709 13:01:28.510375  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 669) took 1697 ms (client timeout 2171 ms). Trace:
W20260709 13:01:28.512880  1602 rpcz_store.cc:269] 0709 13:01:26.812806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.509042 (+1696236us) service_pool.cc:224] Handling call
0709 13:01:28.510324 (+  1282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.514146  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.515013  1605 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:28.508672  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2002) took 4045 ms. Trace:
I20260709 13:01:28.496363  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:28.512990  1603 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:28.516448  1604 rpcz_store.cc:276] 0709 13:01:24.463748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.463892 (+   144us) service_pool.cc:224] Handling call
0709 13:01:24.464198 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.335440 (+2871242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.508433 (+1172993us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54003c5354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:28.508609 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6550932224}
I20260709 13:01:28.517190  2257 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:28.526867  1600 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:28.530320  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.532122  1602 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.533034  1607 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:28.535146  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.535804  1607 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:28.537511  5694 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.538175  1605 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.538842  1604 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:28.539340  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:28.541450  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 77130.1us
I20260709 13:01:28.515682  5656 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:28.545105  1608 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.540467  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.549677  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.547642  1607 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.529971  5667 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.555191  5667 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:28.555841  5667 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:28.556898  5667 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.560842  5686 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:28.519488  1427 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:28.561435  5686 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.561935  5732 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.562315  1427 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 9, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.563762  5686 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.553968  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.567842  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:28.582053  1601 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:28.568519  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.606295  1601 pending_rounds.cc:85] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 8
I20260709 13:01:28.547627  5716 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.606797  1601 pending_rounds.cc:107] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:28.568534  1530 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:28.607260  1601 raft_consensus.cc:2889] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:28.547885  5656 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:28.568959  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.583176  1607 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:28.609608  5659 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.610208  5659 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.552556  5714 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:28.613596  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45133.4us
I20260709 13:01:28.618963  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.619535  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.619925  1604 raft_consensus.cc:2410] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:28.576066  5674 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.624409  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:28.632139  5712 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:28.632791  5712 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.602839  5721 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:28.620790  5732 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:28.634970  5678 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:28.636998  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.637678  1601 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:28.638588  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.640331  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.640928  1605 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.639092  5683 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.644008  1525 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:28.644717  5712 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.645008  5713 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.648527  5713 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.646000  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.621050  5659 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.649835  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.650400  1607 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.644058  5623 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:28.655938  5623 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:28.656828  5623 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.657850  5623 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.658720  5683 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.553824  5646 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:28.661067  5646 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:28.661434  5646 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:28.662222  5646 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.663544  5646 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.588889  1427 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 8, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.666131  1427 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 8, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.670033  5657 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.670619  5657 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.672864  5674 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.673524  5674 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.617815  5716 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.677898  5705 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.678784  5705 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.687387  5732 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:28.688776  5732 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.697306  5678 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:28.698477  5678 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.722872  5632 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.723695  5632 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.724848  5701 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.725191  5677 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.725488  5701 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.725721  5677 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.727923  5701 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:28.740692  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.744624  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 120363us
I20260709 13:01:28.758688  1601 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:28.759894  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.762838  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.763772  1530 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.768522  5688 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:28.769372  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.770054  1601 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:28.666992  1607 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:28.668164  1427 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:28.770910  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.773293  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:28.773916  1605 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:28.771453  1601 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:28.757436  5680 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:28.778275  1530 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:28.777060  1601 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.769658  5688 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:28.728235  5677 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.789348  1420 maintenance_manager.cc:643] P 3fc8854ff8e34244b91acf19f7f50f8a: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.724s	user 0.196s	sys 0.072s Metrics: {"bytes_written":29510,"cfile_init":1,"dirs.queue_time_us":50961,"dirs.run_cpu_time_us":458,"dirs.run_wall_time_us":35495,"drs_written":1,"lbm_read_time_us":394,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2133480,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":3,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":63,"thread_start_us":182786,"threads_started":2,"wal-append.queue_time_us":195693}
I20260709 13:01:28.792964  1421 maintenance_manager.cc:419] P 3fc8854ff8e34244b91acf19f7f50f8a: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9678 bytes on disk
I20260709 13:01:28.781677  1601 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:28.772809  5669 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.780457  5688 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:28.784029  5705 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.784559  5657 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.793795  5716 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:28.802063  1420 maintenance_manager.cc:643] P 3fc8854ff8e34244b91acf19f7f50f8a: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":365,"lbm_reads_lt_1ms":4}
I20260709 13:01:28.794509  5680 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:28.774365  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.809893  1607 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:28.797361  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:28.779171  5701 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:28.800658  1601 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:28.805454  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 193463us
I20260709 13:01:28.794443  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.825464  1605 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:28.830811  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.852286  1500 leader_election.cc:400] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:28.852713  1500 leader_election.cc:403] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.854285  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.854930  1605 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.855484  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.857122  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:28.857842  1607 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:28.875437  1601 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:01:28.801105  5633 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:28.892452  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.897171  1608 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.897287  1601 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.853156  5716 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.903314  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75566.9us
I20260709 13:01:28.801106  5669 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.905018  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:28.905470  1601 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.862051  5701 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:28.890715  5626 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:28.908010  5712 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:28.898591  5683 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:28.910404  1601 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.911121  5626 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.925201  5626 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:28.926486  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 2114) took 4492 ms (client timeout 1597 ms). Trace:
W20260709 13:01:28.926915  1528 rpcz_store.cc:269] 0709 13:01:24.434437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.438438 (+  4001us) service_pool.cc:224] Handling call
0709 13:01:28.926260 (+4487822us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b540008e3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:28.926389 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6683310464}
I20260709 13:01:28.911823  5712 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:28.928704  5712 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:28.929592  5712 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.930944  5712 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.771520  1427 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 6, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.932701  5623 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:28.906373  5716 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.903620  5706 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:01:28.915124  5701 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.853623  5446 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:28.917114  5633 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:28.911881  5713 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:28.907191  5657 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:28.908746  5659 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.918375  5680 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.920526  5718 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:28.920883  5638 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:28.935169  1533 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 11. Ops: []
I20260709 13:01:28.928157  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.940464  1605 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:28.989354  1528 raft_consensus.cc:2368] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:28.989799  1605 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:28.970098  1601 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:28.991400  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:28.975485  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:28.986343  2257 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:28.992569  1530 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.950819  5683 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.001644  5683 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.002369  5695 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:29.003731  5683 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:28.988281  5718 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:29.004835  1528 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:28.986758  5633 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.006588  5633 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:29.007331  5633 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.986006  4933 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:28.985569  5721 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.907135  5688 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:28.993701  5741 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:01:28.987918  5713 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:28.998185  5686 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.010628  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:29.036477  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:29.040582  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:29.041726  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:29.044400  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:28.990082  5659 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:28.987267  5657 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:28.995262  5727 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:01:29.051440  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:29.013927  5633 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.998054  5725 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:01:29.005043  5718 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.049983  5683 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:29.056068  1605 raft_consensus.cc:2376] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:29.062343  1530 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:28.993489  5638 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.037498  4933 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.012251  5623 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:29.008841  5694 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:29.049798  5695 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:29.050119  5703 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:29.052372  5686 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.012112  5626 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:29.066073  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:29.055375  5688 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.018934  5721 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.070797  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:29.076067  1605 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:29.057291  5716 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.073186  1601 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:29.072060  5695 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.072053  5718 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.075477  5727 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:29.094949  5695 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.098752  5657 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.099449  5721 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.075381  5686 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.082449  5632 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.083170  5703 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:29.102180  5686 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.102172  5632 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.102916  5703 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.091974  5716 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.113262  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.125869  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.129166  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 693) took 1077 ms. Trace:
I20260709 13:01:29.097316  5727 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:29.081398  5713 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.134198  1530 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:29.132102  5683 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:29.126931  5686 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:29.107227  5716 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.139173  5686 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.139533  5727 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.141403  5686 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.142987  5753 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.143594  5753 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.146338  5753 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.141646  1683 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:29.141394  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 545) took 2140 ms (client timeout 1566 ms). Trace:
W20260709 13:01:29.149410  1676 rpcz_store.cc:269] 0709 13:01:27.001053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.001172 (+   119us) service_pool.cc:224] Handling call
0709 13:01:29.141167 (+2139995us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b54003291d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:29.141326 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207311104}
W20260709 13:01:29.156536  5747 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:29.159987  5711 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:29.160462  5711 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:29.161284  5711 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.162532  5711 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:29.164741  5744 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:01:29.166364  5745 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:01:29.167475  5659 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.172407  5629 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.172873  5629 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:29.173447  5683 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.173686  5629 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.175019  5629 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.164796  5638 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.154956  5511 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.177193  5511 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.179647  5511 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.181627  5716 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:29.183665  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.197499  5680 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.198223  5680 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.233239  5695 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.236903  1532 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 10. Ops: []
I20260709 13:01:29.235873  5695 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:29.356412  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.367103  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.492333  5680 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.508620  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 683) took 2325 ms. Trace:
I20260709 13:01:29.509123  1606 rpcz_store.cc:276] 0709 13:01:27.183171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.205612 (+ 22441us) service_pool.cc:224] Handling call
0709 13:01:27.205948 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.206283 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.206311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.213039 (+  6728us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.336427 (+123388us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:27.336458 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.336706 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.507408 (+2170702us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b2400414b48. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a82fb0 00007f7e636f9488 00007f7e636f9be8 00007f7e636d1398 00007f7e636cc76a 00007f7e636cbbb6
0709 13:01:29.508267 (+   859us) raft_consensus.cc:1685] finished
0709 13:01:29.508288 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.508547 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63868,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13931392,"thread_start_us":118326,"threads_started":1,"wal-append.queue_time_us":231487}
I20260709 13:01:29.515493  5662 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:29.516094  5662 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:29.517473  5695 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.517268  5662 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.518074  5695 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:29.519073  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.521155  5695 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.526342  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 686) took 2115 ms. Trace:
I20260709 13:01:29.526868  1529 rpcz_store.cc:276] 0709 13:01:27.410649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.478467 (+ 67818us) service_pool.cc:224] Handling call
0709 13:01:27.493305 (+ 14838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.064476 (+571171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.526050 (+1461574us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400343ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:29.526258 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311995648}
I20260709 13:01:29.528522  1529 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:29.537489  1630 debug-util.cc:398] Leaking SignalData structure 0x7b080009fdc0 after lost signal to thread 434
W20260709 13:01:29.538854  1630 debug-util.cc:398] Leaking SignalData structure 0x7b080009ff00 after lost signal to thread 1466
W20260709 13:01:29.540361  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2480 after lost signal to thread 1558
I20260709 13:01:29.518616  5662 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.618132  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 671) took 2809 ms. Trace:
I20260709 13:01:29.619185  1527 rpcz_store.cc:276] 0709 13:01:26.808355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.197827 (+2389472us) service_pool.cc:224] Handling call
0709 13:01:29.198178 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.198564 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.198588 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.199026 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.567341 (+368315us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:29.567395 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.567478 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.617825 (+ 50347us) raft_consensus.cc:1685] finished
0709 13:01:29.617849 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.618055 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":367892,"threads_started":1,"wal-append.queue_time_us":368207}
I20260709 13:01:29.635573  1527 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:29.636180  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2153) took 1087 ms. Trace:
I20260709 13:01:29.636534  1527 rpcz_store.cc:276] 0709 13:01:28.548601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.634899 (+1086298us) service_pool.cc:224] Handling call
0709 13:01:29.635211 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.635943 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.636122 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:29.639156  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.654088  1527 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:29.654929  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2110) took 1105 ms. Trace:
I20260709 13:01:29.655306  1527 rpcz_store.cc:276] 0709 13:01:28.549853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.637388 (+1087535us) service_pool.cc:224] Handling call
0709 13:01:29.653812 (+ 16424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.654657 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.654871 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:29.656989  1527 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:29.657650  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2111) took 1107 ms. Trace:
I20260709 13:01:29.658067  1527 rpcz_store.cc:276] 0709 13:01:28.550088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.656068 (+1105980us) service_pool.cc:224] Handling call
0709 13:01:29.656826 (+   758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.657418 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.657599 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:29.656746  5657 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:29.654217  5680 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:29.682178  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53079.3us
I20260709 13:01:29.667956  5657 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.668185  5680 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.694741  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2088) took 5352 ms. Trace:
I20260709 13:01:29.695195  1533 rpcz_store.cc:276] 0709 13:01:24.342048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.503269 (+161221us) service_pool.cc:224] Handling call
0709 13:01:28.934990 (+4431721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.988583 (+ 53593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.694523 (+705940us) spinlock_profiling.cc:243] Waited 4.43 s on lock 0x7b540008e3d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:29.694673 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10191111424}
W20260709 13:01:29.697005  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 2004) took 5225 ms (client timeout 1544 ms). Trace:
W20260709 13:01:29.697418  1609 rpcz_store.cc:269] 0709 13:01:24.471511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.472195 (+   684us) service_pool.cc:224] Handling call
0709 13:01:29.696455 (+5224260us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b5400027454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:29.696572 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6670950272}
I20260709 13:01:29.698398  1602 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:29.702181  5695 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.706563  5657 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.707958  5657 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:29.708552  5669 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.710111  5680 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.703532  5695 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:29.717540  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2095) took 2591 ms (client timeout 2222 ms). Trace:
W20260709 13:01:29.717994  1526 rpcz_store.cc:269] 0709 13:01:27.125575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.125774 (+   199us) service_pool.cc:224] Handling call
0709 13:01:29.717300 (+2591526us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b54003057d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:29.717439 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2722688}
W20260709 13:01:29.722033  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.722819  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.723018  5695 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.723624  5673 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:29.724157  5673 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:29.724846  2255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1000) took 2385 ms (client timeout 2042 ms). Trace:
W20260709 13:01:29.725286  2255 rpcz_store.cc:269] 0709 13:01:27.339514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.339632 (+   118us) service_pool.cc:224] Handling call
0709 13:01:29.724512 (+2384880us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:29.724738 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79599872}
I20260709 13:01:29.725867  5629 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.726366  5629 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.730960  5628 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.731541  5628 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.712713  5657 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.735102  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2150) took 1189 ms. Trace:
I20260709 13:01:29.735519  1532 rpcz_store.cc:276] 0709 13:01:28.546032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.139863 (+593831us) service_pool.cc:224] Handling call
0709 13:01:29.140164 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.237416 (+ 97252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.734850 (+497434us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b540043c954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:29.735042 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222013824}
I20260709 13:01:29.739048  5657 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:29.740902  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.741906  5629 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:29.775961  5628 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:29.817580  5628 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.818118  5628 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:29.739802  5673 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:29.892733  5628 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:29.908644  5657 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.909329  5657 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:29.911581  5657 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:29.973788  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.063980  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.064639  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.067798  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 696) took 1610 ms. Trace:
I20260709 13:01:30.050884  5662 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:30.050887  5657 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:30.069334  1525 rpcz_store.cc:276] 0709 13:01:28.453862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.471995 (+ 18133us) service_pool.cc:224] Handling call
0709 13:01:30.064105 (+1592110us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540042d6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:30.064288 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290912512}
I20260709 13:01:30.078711  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.078012  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:30.078399  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.087991  2254 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.090649  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.091207  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.091796  5764 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:30.088415  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:30.089038  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:30.089741  2259 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.093398  2260 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.072402  5628 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.088785  2253 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:30.089960  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.092053  2255 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.074786  5657 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.097512  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:30.105934  2260 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:30.098605  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2152) took 1550 ms. Trace:
I20260709 13:01:30.074018  5662 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.110333  5570 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.116027  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1007) took 2069 ms. Trace:
I20260709 13:01:30.116348  5662 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.117729  5657 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.119163  2252 rpcz_store.cc:276] 0709 13:01:28.046188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.046358 (+   170us) service_pool.cc:224] Handling call
0709 13:01:28.046618 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.376280 (+329662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.115735 (+1739455us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540039c6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:30.115955 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753267456}
W20260709 13:01:30.124437  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.125535  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:30.107694  1529 rpcz_store.cc:276] 0709 13:01:28.548335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.529448 (+981113us) service_pool.cc:224] Handling call
0709 13:01:29.630788 (+101340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:29.632515 (+  1727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.632546 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:29.633125 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 13:01:30.069113 (+435988us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:30.096944 (+ 27831us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.097207 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.097289 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.098392 (+  1103us) raft_consensus.cc:1685] finished
0709 13:01:30.098404 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.098539 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2318,"prepare.queue_time_us":27639,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1989,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17358,"thread_start_us":431595,"threads_started":2,"wal-append.queue_time_us":437574}
W20260709 13:01:30.126179  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.127017  5570 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:30.128193  5570 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:30.131210  5439 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:30.131839  5629 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.132296  5439 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.132339  5629 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.133570  5615 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.134059  5615 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.135200  5629 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:30.138242  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:30.140194  2255 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:30.141002  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.144448  1601 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:30.146327  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.148877  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.149784  1606 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:01:30.153863  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.154542  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.154754  1606 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:30.155383  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:30.159245  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:30.160930  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.161334  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.162259  1607 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:30.163645  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:30.107445  5628 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.135896  5673 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.133074  5672 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.135155  5439 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.166086  5615 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.166488  5680 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:01:30.160570  5763 raft_consensus.cc:2764] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:30.158677  5662 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:30.159209  5657 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:01:30.176919  5669 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.191208  5669 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.181375  5629 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.189591  5628 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.183364  5771 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.195556  1427 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.022s	sys 0.056s
I20260709 13:01:30.175962  5673 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.177474  5672 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.182900  5764 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:30.200088  5680 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:30.202592  1427 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.022s	sys 0.056s
I20260709 13:01:30.198320  5629 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.210408  5629 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.218459  5672 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:30.220366  5673 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.205714  5680 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:30.201581  5771 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.233538  5669 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.234498  5680 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.241957  5771 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:30.248906  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 91576.4us
I20260709 13:01:30.249752  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:30.250653  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.250715  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.250406  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.251425  1607 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:30.251436  1601 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:30.252429  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.252990  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.253238  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.253902  1601 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 7.
I20260709 13:01:30.254720  1603 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:30.255021  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.255532  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.255607  1600 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:30.256971  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.254666  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.253233  1605 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:30.257056  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.258090  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.258271  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.257725  1601 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:30.258394  1603 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:30.261431  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:30.261634  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:30.262202  1609 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.262773  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:30.263415  1606 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.268290  5272 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.268795  5272 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.268959  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:30.269170  5272 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.270967  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:30.269186  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.272622  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:30.273584  1603 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:30.274574  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.275189  1603 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:30.276127  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.277007  1603 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:30.269742  5764 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:30.256017  5586 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.280670  1606 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:30.272445  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:30.284277  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.285398  1603 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:30.281311  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:30.242501  5680 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.286368  2257 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:30.286501  2260 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:30.286880  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.287386  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.287670  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.288286  2260 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:30.270375  5713 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.270457  5694 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.270171  5695 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.288627  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.270097  5662 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.288590  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.296151  5662 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.298489  5662 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.299996  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.300581  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.302903  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:30.303493  1603 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.279467  5570 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:30.279451  5673 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:30.283007  5764 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.290055  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.306891  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:30.307292  2254 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:30.279091  5771 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:30.314646  5771 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:30.315011  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1005) took 2973 ms. Trace:
I20260709 13:01:30.315152  5771 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.315426  2258 rpcz_store.cc:276] 0709 13:01:27.341557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.342267 (+   710us) service_pool.cc:224] Handling call
0709 13:01:27.343093 (+   826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.976713 (+633620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.314779 (+2338066us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400738554. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:30.314951 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037416704}
I20260709 13:01:30.310737  1526 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:30.283327  5467 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:30.304661  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.644610  1606 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
I20260709 13:01:30.289091  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:30.300911  1604 raft_consensus.cc:2410] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:30.294045  5694 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.647542  1604 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:30.648530  5694 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.307415  5672 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:30.307183  5673 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.308409  5707 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.309254  5683 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.649359  5707 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.305414  5713 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.304870  5570 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.308964  1609 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:30.649930  5707 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.651145  1609 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.651597  5713 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:30.314011  5764 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.652582  1609 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:30.311926  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2007) took 2280 ms. Trace:
I20260709 13:01:30.653462  1683 rpcz_store.cc:276] 0709 13:01:28.031929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.044436 (+ 12507us) service_pool.cc:224] Handling call
0709 13:01:29.141476 (+1097040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.148956 (+  7480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.311745 (+1162789us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003291d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:30.311868 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522142976}
I20260709 13:01:30.311946  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:30.304116  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2148) took 1758 ms. Trace:
I20260709 13:01:30.894913  1530 rpcz_store.cc:276] 0709 13:01:28.545509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.135042 (+589533us) service_pool.cc:224] Handling call
0709 13:01:29.148653 (+ 13611us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:29.154255 (+  5602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.154286 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:29.168619 (+ 14333us) log.cc:844] Serialized 52 byte log entry
0709 13:01:30.303440 (+1134821us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b18001a37a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1
0709 13:01:30.303692 (+   252us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:30.303734 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.303800 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.303843 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:30.303854 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.304054 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5208,"raft.queue_time_us":5317,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":22854,"spinlock_wait_cycles":135469312,"thread_start_us":31094,"threads_started":1,"wal-append.queue_time_us":401310,"wal-append.run_cpu_time_us":1703,"wal-append.run_wall_time_us":1001718}
I20260709 13:01:30.313160  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:30.312386  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:30.309965  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.312933  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:31.087373  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 774438us
I20260709 13:01:31.087464  5721 raft_consensus.cc:2764] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:31.088171  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:31.088981  5721 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.090242  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:30.360483  5772 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:01:30.502930  5771 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.662709  5764 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.093665  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.094054  5764 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:30.681874  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.672027  1531 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:30.364370  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:31.158144  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 794573us
I20260709 13:01:31.159433  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:31.162125  5657 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.162566  5657 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.162937  5657 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:30.662504  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.167359  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 556) took 4147 ms (client timeout 2072 ms). Trace:
W20260709 13:01:31.167750  1674 rpcz_store.cc:269] 0709 13:01:27.020022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.020685 (+   663us) service_pool.cc:224] Handling call
0709 13:01:31.167136 (+4146451us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54003b9cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:31.167286 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213773696}
I20260709 13:01:30.362022  1603 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:30.337193  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:30.605788  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2034) took 1987 ms. Trace:
W20260709 13:01:30.561484  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1960 after lost signal to thread 1633
W20260709 13:01:31.209244  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08003df280 after lost signal to thread 1634
W20260709 13:01:31.210461  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0400 after lost signal to thread 1707
W20260709 13:01:31.210726  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08002cace0 after lost signal to thread 1708
W20260709 13:01:31.211855  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab180 after lost signal to thread 2285
W20260709 13:01:30.560931  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.214757  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.371990  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:30.295183  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:30.529140  2226 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.072s (SENT)
I20260709 13:01:31.220037  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:31.220942  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 691792us
I20260709 13:01:30.356631  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.224928  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.225579  2258 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:31.226390  5764 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.557296  4933 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:31.228847  4933 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:31.229804  4933 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.230901  4933 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.362840  5248 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:31.234953  5248 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.351557  5272 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.658727  5570 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:30.577473  5583 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.360941  5586 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:31.244516  5586 raft_consensus.cc:2764] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:30.374366  5615 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:31.248296  1531 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:31.251748  5764 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:30.368696  5629 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.253993  5629 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.360906  5636 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.257270  5636 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.259627  5636 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:30.641296  5658 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.261618  5658 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:31.262602  5658 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.263875  5658 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.649165  5672 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:31.265118  5672 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.649324  5673 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.361183  5680 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:30.649875  5683 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.279428  5683 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.281312  5656 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.282652  5656 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.308529  5695 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.375363  5706 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:30.738936  5707 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.279186  5629 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.286945  5629 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:31.287518  5629 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:30.806839  5727 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.288497  5629 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.850009  5687 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.290115  5687 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:31.290962  5687 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:30.361588  5732 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:30.314782  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.000517  1647 connection.cc:256] RPC call timeout handler was delayed by -2.1364700199999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:01:31.293162  5732 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:31.042383  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.016s	sys 0.020s
I20260709 13:01:31.059988  5674 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.287822  5618 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.068691  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:31.294909  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.017s	sys 0.020s
I20260709 13:01:31.295068  2257 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.295485  5732 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.295692  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2325) took 1041 ms. Trace:
I20260709 13:01:31.070007  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.297009  2256 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:31.296087  1600 rpcz_store.cc:276] 0709 13:01:30.253806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.379321 (+125515us) service_pool.cc:224] Handling call
0709 13:01:30.379744 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:30.380153 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.380182 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:30.380827 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:01:31.295325 (+914498us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:31.295369 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.295436 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.295481 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:31.295492 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.295623 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1582,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":914099,"threads_started":1,"wal-append.queue_time_us":486128}
I20260709 13:01:31.070158  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.070669  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.073634  2260 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:31.287799  5707 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.080945  1534 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 6.
I20260709 13:01:31.095146  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.101114  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.069590  2252 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:31.300216  2255 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:31.300275  1526 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:31.107018  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.301518  1525 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:01:30.996201  1574 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.222s (SENT)
I20260709 13:01:31.126463  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.302862  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:31.105554  5721 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:31.303447  5721 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.303856  5721 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.145399  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.304482  5732 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:31.146991  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.305457  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.136123  5771 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.307938  5771 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:31.147708  5795 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.150902  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.308295  5771 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:31.309365  5727 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.358942  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.310963  1601 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:31.169972  1679 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:31.308601  5795 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.171931  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.314400  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2322) took 1062 ms. Trace:
I20260709 13:01:31.314841  1607 rpcz_store.cc:276] 0709 13:01:30.251580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.252649 (+  1069us) service_pool.cc:224] Handling call
0709 13:01:31.171765 (+919116us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800004298. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:01:31.314340 (+142575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411200}
I20260709 13:01:29.130386  1528 rpcz_store.cc:276] 0709 13:01:28.052211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.005586 (+953375us) service_pool.cc:224] Handling call
0709 13:01:29.005859 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.006036 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:29.068262 (+ 62226us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.128147 (+ 59885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.128196 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:29.128239 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.128996 (+   757us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.129110 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117071,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":995,"raft.queue_time_us":1169,"thread_start_us":121512,"threads_started":2}
W20260709 13:01:31.189127  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.008s	sys 0.028s
W20260709 13:01:31.316797  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.008s	sys 0.028s
I20260709 13:01:31.316956  5683 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:31.317499  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2156) took 1021 ms. Trace:
I20260709 13:01:31.317912  5713 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.318766  5713 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:31.317868  1529 rpcz_store.cc:276] 0709 13:01:30.309244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.309374 (+   130us) service_pool.cc:224] Handling call
0709 13:01:30.309675 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.309974 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.310002 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.310483 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.317183 (+1006700us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:31.317223 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.317289 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.317332 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:31.317341 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.317450 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31215,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2063,"thread_start_us":1006339,"threads_started":1,"wal-append.queue_time_us":62129}
I20260709 13:01:31.319613  5713 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.311444  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 2056) took 1045 ms. Trace:
I20260709 13:01:31.320730  1601 rpcz_store.cc:276] 0709 13:01:30.266238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.358632 (+ 92394us) service_pool.cc:224] Handling call
0709 13:01:31.311383 (+952751us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.202394  1608 rpcz_store.cc:276] 0709 13:01:28.618888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.619264 (+   376us) service_pool.cc:224] Handling call
0709 13:01:28.755336 (+136072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.899236 (+143900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.605427 (+1706191us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003b88d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:30.605702 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325614848}
I20260709 13:01:31.242182  5583 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.323184  5583 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.323685  5583 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.246129  5641 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:01:31.324245  5713 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.325666  5641 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.326210  5641 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:30.578150  5628 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.329407  5628 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.331744  5628 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.309727  5771 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.333607  5771 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.334270  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2326) took 1080 ms. Trace:
I20260709 13:01:31.334690  1606 rpcz_store.cc:276] 0709 13:01:30.254103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.645495 (+391392us) service_pool.cc:224] Handling call
0709 13:01:30.645816 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.296173 (+650357us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:31.320539 (+ 24366us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.332446 (+ 11907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.332502 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:31.332544 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.334027 (+  1483us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540034a8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:31.334074 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.334206 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23836,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":116,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":136,"spinlock_wait_cycles":1495355008,"thread_start_us":32134,"threads_started":2,"wal-append.queue_time_us":8461}
I20260709 13:01:31.148387  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2037) took 2517 ms. Trace:
I20260709 13:01:31.337044  1602 rpcz_store.cc:276] 0709 13:01:28.631256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.639636 (+  8380us) service_pool.cc:224] Handling call
0709 13:01:29.696591 (+1056955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.698786 (+  2195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.148146 (+1449360us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400027450. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:31.148300 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429970816}
I20260709 13:01:31.285778  5706 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:31.338970  5706 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.289067  5809 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:31.289403  5695 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.292200  5687 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.067881  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.339967  5706 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.340623  2253 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:30.893129  1533 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:31.341522  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 2161) took 1030 ms. Trace:
I20260709 13:01:31.341849  1533 rpcz_store.cc:276] 0709 13:01:30.311558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.311718 (+   160us) service_pool.cc:224] Handling call
0709 13:01:31.341465 (+1029747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.297967  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.106860  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:31.343545  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 236729us
I20260709 13:01:31.349206  2257 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:31.349699  5706 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.350224  5706 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.350919  5694 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:31.351370  5694 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.351706  5694 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.313524  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2012) took 3270 ms. Trace:
I20260709 13:01:31.260252  5636 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.356213  5687 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:31.373728  5248 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.358346  1679 rpcz_store.cc:276] 0709 13:01:28.043062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.043192 (+   130us) service_pool.cc:224] Handling call
0709 13:01:31.169715 (+3126523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.311767 (+142052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.313328 (+  1561us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b54003b9cd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:31.313465 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7189431040}
I20260709 13:01:31.366575  5662 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.376034  5662 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.380976  5662 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:31.309725  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.383455  5713 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:31.324100  5583 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.388275  5583 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.389926  5805 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.390564  5805 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.284855  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:31.303753  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 307574us
I20260709 13:01:31.308604  5570 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.309867  5727 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.393076  5570 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.309803  5794 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.313588  5795 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.328673  5618 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.302292  5272 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.395062  5794 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.395247  5618 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.339939  5809 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.396466  5809 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.369761  5706 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.399065  5706 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.399528  5706 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.367884  5636 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.394959  2258 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:31.409337  5641 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.446408  5805 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.446630  5795 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:31.447212  5795 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:31.448282  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.448660  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.449076  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.450922  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.453018  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.447952  5794 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.446489  5727 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.455585  5795 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.456362  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.457000  1533 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:31.457890  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.458523  1528 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:31.459781  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.459940  5570 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.460378  1525 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.462467  5721 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.465010  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.465566  5618 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.447731  5706 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:31.466521  1499 leader_election.cc:336] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.599s (SENT)
I20260709 13:01:31.466414  5657 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.470006  1525 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:31.473989  5694 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.446784  5636 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.477141  5672 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.479477  5672 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:31.480901  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 1.18567e+06us
I20260709 13:01:31.482318  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:31.471669  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.483824  1574 connection.cc:256] RPC call timeout handler was delayed by -1.670094425000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:01:31.484469  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3414987720000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:01:31.484805  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3414987720000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:01:31.485141  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3271944250000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:01:31.484941  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.485437  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3252987719999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:01:31.485752  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3145944249999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 13:01:31.485771  1527 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:31.486128  1574 connection.cc:256] RPC call timeout handler was delayed by -1.291098771999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:01:31.486459  1574 connection.cc:256] RPC call timeout handler was delayed by -1.291098771999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:01:31.486752  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2352987720000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:01:31.487046  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2352987720000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:01:31.487315  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2028987720000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:01:31.487577  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1884987720000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:01:31.487968  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1884987720000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:01:31.488556  5706 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.489074  1527 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:31.488456  5656 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:31.489614  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 214176us
I20260709 13:01:31.489939  5656 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.491170  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.489928  5707 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:31.489192  5706 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:31.491830  5707 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:31.495668  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.496568  1529 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:31.496803  5707 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.498203  5707 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.499269  5248 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.500653  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.501176  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.488116  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 328637us
I20260709 13:01:31.502283  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.502933  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.488382  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 1.11634e+06us
I20260709 13:01:31.504715  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.499864  1529 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.505324  1529 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:31.505379  1528 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 4.
I20260709 13:01:31.506311  1529 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.507272  1529 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.499835  5248 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.508553  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:31.510632  5248 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.503027  1527 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:31.491807  1525 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:31.469915  5673 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.520193  5673 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.522830  5706 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.523646  5248 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:31.557817  5809 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.525393  5636 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:31.523303  5656 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.528435  5628 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:31.529784  5272 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:31.587332  5272 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.587736  5272 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:31.531447  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.588827  1528 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:31.588546  5272 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:31.511471  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.589607  5248 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.540807  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.544472  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.589670  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.590543  1528 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.590977  1525 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:31.552625  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.592500  5248 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:31.593379  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.594223  1603 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:31.595112  5628 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:31.595721  5628 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.598047  5628 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.599905  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.589717  5272 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.592537  1602 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:31.602494  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.604362  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.605875  1608 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:31.510810  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:31.607057  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 96318.6us
I20260709 13:01:31.557744  5721 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.558786  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.609381  1527 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:31.609465  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.610334  1604 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:31.605032  1602 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.558861  5803 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.560041  5615 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:31.560951  5657 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:31.561777  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:31.615715  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54041.1us
I20260709 13:01:31.616817  1649 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:31.566393  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.615125  1528 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:31.567555  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.618249  2257 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:31.618616  1526 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.619700  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.620484  2257 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:31.567844  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.621304  1534 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:31.568141  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.569173  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.570533  1530 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:31.620988  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.618170  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.579337  1529 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:31.621469  2253 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:31.579694  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1749987719999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:01:31.538651  5618 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.627023  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.627720  1529 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:31.592077  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.610217  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.559221  5804 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.635032  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.635980  1603 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.612454  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.636948  1600 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:31.612959  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:31.614113  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 53274.3us
I20260709 13:01:31.640828  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:31.641882  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:31.646574  1526 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:31.623490  1533 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:31.623914  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1749987719999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:01:31.651062  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1605987720000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:01:31.622885  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:31.625402  1532 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:31.629333  1527 raft_consensus.cc:2410] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:31.611927  1605 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:31.653664  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1605987720000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:01:31.654404  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:31.608765  5673 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:31.624042  1531 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:31.539553  5806 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:01:31.652621  1499 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.577s (SENT)
I20260709 13:01:31.663707  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:31.637854  1601 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:31.666304  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.661958  1574 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:31.635094  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:31.667034  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.605072  5694 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:31.669785  1601 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:31.673108  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.674226  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.674978  1601 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:31.675777  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.659488  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.677340  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.678469  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:31.679329  1499 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.510s (SENT)
W20260709 13:01:31.681442  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.681825  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.682156  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.683106  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.684116  1601 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:31.671469  1574 leader_election.cc:400] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8.
I20260709 13:01:31.688199  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.688869  1601 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.633016  5821 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.696082  5821 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.700757  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.670317  5641 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.701917  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:31.723351  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:31.724113  5662 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:31.724400  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.706283  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.724644  5662 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.625751  5618 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.647352  5771 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.701333  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.725190  5662 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.719895  1601 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:31.663257  5673 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:31.698644  4933 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:31.719835  1603 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:31.669137  5721 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.670552  5656 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.697613  5672 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:31.725438  5618 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.726382  1608 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:31.704658  5629 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.719110  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:31.733064  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:31.785974  2256 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:31.703498  5657 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.733253  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:31.724692  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:31.736518  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.738790  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.788614  2257 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.742268  1609 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
W20260709 13:01:31.789211  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.743144  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:31.789973  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65342.1us
I20260709 13:01:31.710983  5810 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.744529  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.738423  5673 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.593392  5248 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:31.797258  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 155417us
W20260709 13:01:31.760138  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.783499  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.786965  1605 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:31.787519  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:31.785514  1606 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.790190  1601 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.790911  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:31.725039  5801 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:31.735487  5706 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.710565  5802 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:31.743975  5809 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:31.798981  2257 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:31.785054  5672 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.626494  5803 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.916648  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:31.920086  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:31.921274  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.921939  1525 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:31.921834  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.923214  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.923435  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.924053  1533 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:31.921291  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:31.844408  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53518us
W20260709 13:01:31.850816  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52316us
I20260709 13:01:31.922274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.783082  4933 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:31.932482  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.858239  1606 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:31.933454  1525 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:31.746229  5805 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:31.862565  5802 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:31.822146  5801 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:31.866629  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800362700 after lost signal to thread 431
W20260709 13:01:31.944444  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08001b51e0 after lost signal to thread 434
W20260709 13:01:31.877043  5615 consensus_queue.cc:1175] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:31.926518  1526 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:31.855912  5657 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:31.788286  5629 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.798250  5810 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:31.924428  5713 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.914954  5570 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:31.671656  5804 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:31.936077  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:31.926256  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:31.885428  5656 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:31.942286  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.943605  1606 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:31.941144  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:31.945688  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080019e140 after lost signal to thread 1466
I20260709 13:01:32.042941  1531 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:31.937891  5802 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:32.043706  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08001acac0 after lost signal to thread 1558
I20260709 13:01:31.861188  5694 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:31.920929  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:31.937812  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.915604  5672 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:31.952528  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.959787  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48962.1us
I20260709 13:01:31.971643  1602 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:31.924362  5809 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.931548  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:31.931870  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:31.896239  5706 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:32.057811  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800376a40 after lost signal to thread 1633
W20260709 13:01:32.058756  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080037be20 after lost signal to thread 1634
I20260709 13:01:31.924582  5732 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:01:31.986568  5657 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.940448  5658 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.056432  1533 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:32.063067  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:32.067102  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:32.064574  2259 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:32.067899  2257 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:32.067891  1531 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:32.044036  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:32.006003  5615 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:32.059191  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.065847  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:32.111227  1602 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:32.070686  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:32.007033  5833 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.066241  5771 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:01:32.071983  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:32.062945  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800081ce0 after lost signal to thread 1707
W20260709 13:01:32.129070  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdba0 after lost signal to thread 1708
I20260709 13:01:32.129386  1674 raft_consensus.cc:2410] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:01:32.130314  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800341140 after lost signal to thread 2285
W20260709 13:01:32.130640  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7be0 after lost signal to thread 2286
I20260709 13:01:31.937618  5805 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.134925  5805 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:32.075490  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 139474us
I20260709 13:01:32.076195  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.140564  1682 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:32.077425  1532 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:32.077564  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.141923  1682 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:01:32.142274  1682 pending_rounds.cc:85] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 9
I20260709 13:01:32.142477  1682 pending_rounds.cc:107] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:32.142693  1682 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.079244  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:32.076923  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 150759us
I20260709 13:01:32.149019  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:32.083472  4933 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.084087  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.084390  1683 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:32.084342  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:32.087229  1499 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.865s (SENT)
I20260709 13:01:32.084537  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:32.088832  5827 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:32.071584  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:32.237391  2259 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:31.946736  5801 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.093318  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:32.063344  5694 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:32.096982  2226 leader_election.cc:336] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.569s (SENT)
I20260709 13:01:32.098626  5672 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.042346  5713 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.042553  5570 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.112884  1675 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:32.112190  2256 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:32.066642  5657 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.067263  5658 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.111539  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:32.070019  5831 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.166213  1677 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:32.169557  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:32.167445  1682 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:32.167680  1680 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:32.234715  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.235374  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.235663  1676 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:32.059211  5809 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:32.107005  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 180949us
I20260709 13:01:32.245457  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:32.281165  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:32.281395  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 184440us
I20260709 13:01:32.243983  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.128348  5833 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.072892  5732 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 13:01:32.128541  5821 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:32.282241  1674 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:32.283309  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:32.283845  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.289289  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:32.284801  1681 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:32.243849  5832 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.287088  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.297667  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:32.298286  5803 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.295984  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.256225  5658 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.301759  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.306053  1674 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:32.303340  1680 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:32.247006  5834 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.309049  5834 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.309432  5834 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.311153  1602 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:32.312661  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:32.313449  1609 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:32.316887  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:32.296993  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:32.303426  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.009s
W20260709 13:01:32.321398  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.009s
I20260709 13:01:32.286348  5583 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:32.307952  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 265827us
I20260709 13:01:32.246572  5618 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.320346  5834 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.326236  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.300544  1682 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:32.287901  5833 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.298767  5764 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:32.326844  5838 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.284129  5831 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.330072  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:32.334661  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.302389  5832 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.306527  5821 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.348423  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.308154  5803 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.301661  5839 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.362462  5656 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:32.322928  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.350800  1678 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.321561  1676 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:32.365904  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:32.389506  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59519.4us
I20260709 13:01:32.417753  1682 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:32.418952  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:32.352664  5615 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.421334  1680 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:32.394129  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.011s
W20260709 13:01:32.422542  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.015s	sys 0.011s
I20260709 13:01:32.415385  1681 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:32.350203  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:32.423776  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:32.429327  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:32.432367  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:32.396481  5821 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.432863  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:32.436188  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 324713us
I20260709 13:01:32.401443  5764 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:32.393383  5629 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:32.400650  5843 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.397850  5832 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:32.435814  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 286851us
I20260709 13:01:32.426822  5706 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.400929  5838 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.414541  5803 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.574484  1527 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:32.426478  5810 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:32.524392  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.610070  5834 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.469700  5821 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.437134  5641 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:32.572952  5842 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:01:32.566195  5615 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:32.598737  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 161913us
W20260709 13:01:32.624518  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 321751us
I20260709 13:01:32.624895  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.568389  5721 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:32.606271  5662 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.004s
I20260709 13:01:32.639104  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:32.468875  5804 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.626430  4933 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.430267  5839 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.629913  5641 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.585541  5672 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.572278  5570 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.426540  5847 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.672626  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:32.638469  5809 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
W20260709 13:01:32.676074  5862 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:01:32.629956  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "055cfab17a334683a9350a659118ac99"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:32.684643  5858 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:32.646894  5662 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.634930  5764 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.661062  5656 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.657613  4933 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.721459  1676 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:32.741583  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.504834  5629 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:32.610625  5861 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.647444  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:32.505591  5732 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.649448  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:32.846735  1606 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:32.656522  1680 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:32.624969  5843 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.629418  1682 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:32.610903  5771 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:32.635016  5615 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.670979  5871 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.677296  5802 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:32.681453  5852 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:32.682439  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:32.684551  5845 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:01:32.868628  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.627767  5868 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:32.846356  5732 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:32.869648  5732 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.869855  5843 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.865713  5802 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:32.870537  5803 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.871488  5771 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:32.871948  5771 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:32.862615  5629 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:32.872924  5771 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.873310  5629 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.874408  5248 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.874847  5863 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.875432  5863 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:32.868201  5801 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:01:32.876995  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.791939  5831 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.714159  5839 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.701476  5713 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:32.877806  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:32.878909  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:32.879383  5694 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:32.880025  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.666271  5721 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:32.880141  5801 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.881212  5721 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:32.848636  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.882817  5801 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:32.883651  1680 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:32.685109  5856 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:01:32.671751  5641 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:32.791620  5805 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.001s
W20260709 13:01:32.805331  5657 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.004s
W20260709 13:01:32.768916  5830 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.713s	user 0.000s	sys 0.004s
W20260709 13:01:32.799986  5673 consensus_meta.cc:287] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.939s	user 0.012s	sys 0.000s
I20260709 13:01:32.736392  5853 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:32.812299  4933 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.770227  5636 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:32.865643  5874 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:32.672804  5618 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:32.869035  5883 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:32.720192  5272 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:32.731230  5851 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.854816  5861 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.855106  5838 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:32.860980  5871 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.861222  5615 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.814390  5859 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.874466  5771 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.891705  5636 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:32.959038  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.020s
W20260709 13:01:33.021425  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.001s	sys 0.020s
I20260709 13:01:32.962724  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2179) took 1014 ms. Trace:
W20260709 13:01:32.964660  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.011s	sys 0.016s
W20260709 13:01:33.024650  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.012s	sys 0.016s
I20260709 13:01:33.022704  5636 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:33.026255  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 938969us
W20260709 13:01:32.637907  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 287726us
W20260709 13:01:32.977658  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.028343  5636 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:32.978269  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.000s	sys 0.008s
W20260709 13:01:33.030047  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.000s	sys 0.008s
W20260709 13:01:33.031452  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 750313us
I20260709 13:01:32.979451  1601 raft_consensus.cc:2410] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:32.980495  1603 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:33.023262  1534 rpcz_store.cc:276] 0709 13:01:31.949303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.952880 (+  3577us) service_pool.cc:224] Handling call
0709 13:01:31.953206 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.953413 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:32.239177 (+285764us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.961303 (+722126us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.961772 (+   469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.961845 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:32.962001 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.962105 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.962384 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131104,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":213332,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":6225,"thread_start_us":947605,"threads_started":3,"wal-append.queue_time_us":515552}
I20260709 13:01:32.981721  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:32.982267  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2347) took 1315 ms. Trace:
I20260709 13:01:33.035773  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:32.987974  1600 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:32.988912  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2071) took 1361 ms. Trace:
I20260709 13:01:32.643834  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2070) took 1032 ms. Trace:
W20260709 13:01:32.989429  1608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.000s	sys 0.006s
I20260709 13:01:32.991799  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 2169) took 1056 ms. Trace:
W20260709 13:01:32.978302  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.016s	sys 0.015s
I20260709 13:01:32.861053  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.997581  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:33.039268  1682 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:32.884694  1676 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:33.040817  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:32.999359  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:33.042114  1608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.006s
I20260709 13:01:32.891010  5805 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.702081  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:33.006973  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 336896us
I20260709 13:01:33.009087  5272 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:33.037158  1604 rpcz_store.cc:276] 0709 13:01:31.627150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.627350 (+   200us) service_pool.cc:224] Handling call
0709 13:01:31.627640 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.627990 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.628018 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.628492 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.321874 (+693382us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.321913 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.321976 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.988410 (+666434us) raft_consensus.cc:1685] finished
0709 13:01:32.988445 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.988744 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":608898,"threads_started":1,"wal-append.queue_time_us":878254}
I20260709 13:01:32.901729  5851 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:32.894388  5853 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:33.103922  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.104138  5853 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.105108  1601 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
W20260709 13:01:33.105556  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 403404us
I20260709 13:01:32.904168  5861 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.102499  1430 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 6, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 6 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:32.895435  5883 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:33.038455  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.016s	sys 0.016s
I20260709 13:01:32.816798  1674 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.926347  5863 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:32.921648  5833 consensus_meta.cc:287] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:01:33.165406  5833 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.038203  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:33.168529  5855 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:33.168852  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 130845us
I20260709 13:01:33.041821  1682 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:33.043068  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.169301  5707 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:33.169906  1680 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:33.169966  5707 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.171027  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.171607  1680 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:33.043329  1527 rpcz_store.cc:276] 0709 13:01:31.921498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.921602 (+   104us) service_pool.cc:224] Handling call
0709 13:01:32.977517 (+1055915us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002ce054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:32.977820 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497779968}
W20260709 13:01:33.061422  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.171787  1675 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:33.035805  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:33.041661  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.077490  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2336) took 1414 ms. Trace:
I20260709 13:01:33.172923  1676 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:33.173846  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.174091  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:33.174643  1499 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.894s (SENT)
I20260709 13:01:33.174939  1676 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
W20260709 13:01:33.175915  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.175814  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:32.910607  5859 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:32.892043  5673 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.182469  5859 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.182895  5673 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.088851  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 2075) took 1390 ms. Trace:
I20260709 13:01:32.906853  5871 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:33.185290  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 149895us
I20260709 13:01:33.186952  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.106415  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.035991  1605 rpcz_store.cc:276] 0709 13:01:31.666350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.917260 (+250910us) service_pool.cc:224] Handling call
0709 13:01:31.917553 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.917929 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:32.254731 (+336802us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.981342 (+726611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.981480 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.981598 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.981739 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.981989 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26497,"prepare.queue_time_us":149962,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":39,"raft.queue_time_us":159146,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":970417,"threads_started":3,"wal-append.queue_time_us":481723}
W20260709 13:01:33.118461  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.118193  1430 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 7 to 8, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:33.125164  5876 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:01:33.183832  1603 rpcz_store.cc:276] 0709 13:01:31.698315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.738543 (+ 40228us) service_pool.cc:224] Handling call
0709 13:01:33.088513 (+1349970us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400384ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:33.088764 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738224000}
I20260709 13:01:33.125422  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.126255  5872 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.126741  5618 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:33.135357  2226 leader_election.cc:336] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.846s (SENT)
I20260709 13:01:33.135955  5694 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.137238  5662 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.037469  1607 rpcz_store.cc:276] 0709 13:01:31.610948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.611139 (+   191us) service_pool.cc:224] Handling call
0709 13:01:31.611382 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.611574 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:32.007018 (+395444us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.643459 (+636441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.643517 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.643568 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.643659 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.643781 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3397,"prepare.queue_time_us":99044,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":4672,"raft.queue_time_us":296768,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":23906,"thread_start_us":1008428,"threads_started":3,"wal-append.queue_time_us":495843}
I20260709 13:01:33.189472  5707 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.216589  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.217645  1607 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:33.138526  5889 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.139802  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:32.892289  5657 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.146615  1683 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 11. Ops: []
I20260709 13:01:33.221405  5657 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.147440  5805 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.222838  1609 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:33.147894  5884 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.149695  5868 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:33.088851  5801 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.225184  5801 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.102242  5615 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.229971  5615 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.160768  5628 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:33.230829  5628 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:33.231247  5628 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.162181  5272 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.077975  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.176203  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:33.229820  5832 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.010s
I20260709 13:01:33.234548  1676 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:33.235633  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.177304  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.237289  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.237660  1680 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:33.238307  1682 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.238662  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.239125  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.239768  1682 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:01:33.177788  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.172861  1600 rpcz_store.cc:276] 0709 13:01:31.663498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.734116 (+ 70618us) service_pool.cc:224] Handling call
0709 13:01:33.077176 (+1343060us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400336b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:33.077381 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731646208}
I20260709 13:01:33.102140  5851 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.188769  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2344) took 1523 ms. Trace:
I20260709 13:01:33.188855  1601 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:33.207568  5881 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.207666  5713 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:33.208566  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.911015  5732 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.209566  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:33.212579  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:33.213557  5694 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.234788  5832 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.178234  5885 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:33.262737  5658 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.006s
I20260709 13:01:33.262966  5884 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.263595  1679 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.264844  5832 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:33.265605  5884 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.228159  5801 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.239985  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.273244  1680 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.275187  4933 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.277311  5707 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:33.278491  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 296) took 23216 ms (client timeout 15000 ms). Trace:
I20260709 13:01:33.237052  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.280853  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:33.282222  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.283197  1676 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.168128  5833 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:33.286317  5732 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.287508  5805 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:33.288000  5805 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.288401  5805 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.291138  5871 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.249300  5713 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.292994  5713 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.294847  5628 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:33.252408  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 112773us
I20260709 13:01:33.208977  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.249751  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2180) took 1242 ms. Trace:
I20260709 13:01:33.251408  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.199301  5618 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.258291  1430 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 7, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 7 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.259852  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.261124  5694 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:33.302835  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 122347us
W20260709 13:01:33.257287  5860 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:01:33.277724  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 142490us
W20260709 13:01:33.262523  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.013s
I20260709 13:01:33.297930  1603 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
W20260709 13:01:33.304514  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.307932  1680 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.311767  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.312711  1680 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:33.309376  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.005s	sys 0.014s
I20260709 13:01:33.311671  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.313664  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.297927  1530 rpcz_store.cc:276] 0709 13:01:32.004064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.056651 (+ 52587us) service_pool.cc:224] Handling call
0709 13:01:32.060799 (+  4148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.301688 (+240889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.301719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.307228 (+  5509us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.022215 (+714987us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:33.068607 (+ 46392us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.101531 (+ 32924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.153827 (+ 52296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.189986 (+ 36159us) raft_consensus.cc:1685] finished
0709 13:01:33.190001 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.244829 (+ 54828us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27373,"prepare.queue_time_us":74056,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":432913,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":111740,"thread_start_us":940610,"threads_started":3,"wal-append.queue_time_us":442959}
I20260709 13:01:33.244675  1608 rpcz_store.cc:276] 0709 13:01:31.665613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.821647 (+156034us) service_pool.cc:224] Handling call
0709 13:01:31.821988 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.822606 (+   618us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:31.913995 (+ 91389us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.043065 (+1129070us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.101000 (+ 57935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.114525 (+ 13525us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:33.188384 (+ 73859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.188485 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.188678 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29460,"prepare.queue_time_us":85228,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":12776,"raft.queue_time_us":400218,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":13680,"thread_start_us":1128080,"threads_started":2,"wal-append.queue_time_us":500678}
I20260709 13:01:33.303915  5618 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.321137  4933 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.307717  5658 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.325814  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.316759  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.326573  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.326792  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:33.316043  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 847398us
I20260709 13:01:33.333700  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.308357  5868 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.338060  1680 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.339718  5658 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.340564  1603 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:33.342224  1603 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:33.343405  5657 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:33.343972  5657 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.344439  5657 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.345016  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.346813  1604 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:33.346447  1430 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 6 to 8, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.346453  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.352579  1676 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.353679  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 712) took 1387 ms. Trace:
I20260709 13:01:33.354110  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.354251  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.355944  1676 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.359180  5883 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.355067  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.356324  5628 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:33.356142  1604 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.356680  5801 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.358696  5658 raft_consensus.cc:2764] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:33.360433  5869 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:33.360728  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2159) took 1121 ms. Trace:
I20260709 13:01:33.355002  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:33.362434  1606 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:33.362939  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.363576  1680 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.364178  5871 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.364629  5843 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:33.365520  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2146) took 1296 ms (client timeout 1507 ms). Trace:
I20260709 13:01:33.367331  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.371706  5872 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.352376  5868 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.373286  1600 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:33.354138  1525 rpcz_store.cc:276] 0709 13:01:31.965965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.966082 (+   117us) service_pool.cc:224] Handling call
0709 13:01:31.966393 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.294099 (+327706us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:32.304422 (+ 10323us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.974782 (+670360us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180045a2a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:01:33.207880 (+233098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.207969 (+    89us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:33.208155 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.353239 (+145084us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54002a7954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:33.353291 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.353476 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24517,"prepare.queue_time_us":10157,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3223,"raft.queue_time_us":25805,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":757529344,"thread_start_us":122873,"threads_started":1,"wal-append.queue_time_us":961812}
I20260709 13:01:33.340160  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.387349  1607 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:33.356495  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44979.3us
I20260709 13:01:33.356271  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2351) took 1041 ms. Trace:
I20260709 13:01:33.380402  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.379421  1683 rpcz_store.cc:276] 0709 13:01:32.239346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.239464 (+   118us) service_pool.cc:224] Handling call
0709 13:01:32.239764 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.219994 (+980230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.360425 (+140431us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54003ab954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:33.360644 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084343552}
W20260709 13:01:33.377507  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136733us
I20260709 13:01:33.388002  1609 rpcz_store.cc:276] 0709 13:01:32.314630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.317421 (+  2791us) service_pool.cc:224] Handling call
0709 13:01:32.317718 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.223318 (+905600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.356026 (+132708us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54003f2fd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:33.356219 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080572160}
I20260709 13:01:33.390012  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:33.384409  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86199.5us
I20260709 13:01:33.328202  5732 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:33.383147  1679 rpcz_store.cc:269] 0709 13:01:32.070278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.083685 (+ 13407us) service_pool.cc:224] Handling call
0709 13:01:33.365286 (+1281601us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540007d5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:33.365450 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518011520}
W20260709 13:01:33.397571  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.391657  1676 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.399691  1680 raft_consensus.cc:2376] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12. Re-sending same reply.
I20260709 13:01:33.399987  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:33.401685  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:33.402642  5248 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.518s	user 0.019s	sys 0.001s
I20260709 13:01:33.403091  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.406030  5868 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.407011  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:33.410571  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:33.382958  5843 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:33.374173  5801 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:33.416910  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62016.1us
I20260709 13:01:33.374173  5861 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:33.412765  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50009.5us
W20260709 13:01:33.415345  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 205902us
W20260709 13:01:33.416298  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.510s (SENT) [suppressed 38 similar messages]
I20260709 13:01:33.329672  5855 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.405886  5872 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.416822  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.463903  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.420555  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:33.390615  1430 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 5 to 6, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 6 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:33.418665  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.416706  5868 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.431763  1674 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:33.472363  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.419937  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:33.474045  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 278116us
I20260709 13:01:33.416352  5843 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:33.474184  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62033.5us
W20260709 13:01:33.476805  2226 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.959s (SENT)
I20260709 13:01:33.477337  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:33.478379  5871 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.416538  5832 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:33.473994  5821 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.004s
I20260709 13:01:33.485519  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.495226  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.495925  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:33.496744  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.472054  5658 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.497380  1676 raft_consensus.cc:2376] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:33.497491  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.483597  5884 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:33.480825  5868 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.498685  1680 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:33.499605  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88765.7us
W20260709 13:01:33.501157  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.284s (SENT)
I20260709 13:01:33.502928  1683 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:33.500425  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82051.3us
I20260709 13:01:33.504103  1677 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.505829  5833 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.524744  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:33.504230  5641 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.487449  5853 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:33.509280  5656 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:33.471701  5732 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.503942  1678 raft_consensus.cc:606] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:33.513140  5886 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.515897  5615 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.517302  5771 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:33.518976  5883 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.487224  5832 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.488072  5876 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.503980  1675 raft_consensus.cc:2376] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13. Re-sending same reply.
W20260709 13:01:33.522475  1499 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.514s (SENT)
I20260709 13:01:33.534260  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.534652  5851 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.535835  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.536548  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.558743  1677 raft_consensus.cc:2368] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:33.558842  1676 raft_consensus.cc:2376] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:33.559821  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:33.538314  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.539809  5855 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.542240  5657 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.543635  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.544941  5805 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.548285  5656 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.548801  1678 raft_consensus.cc:614] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:33.526311  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:33.502991  5884 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:33.572403  1680 raft_consensus.cc:2376] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10. Re-sending same reply.
I20260709 13:01:33.573529  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.574586  5732 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.551807  5886 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.574910  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.576498  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.523182  5868 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.500664  5821 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.537892  5872 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:33.547415  5801 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.570907  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.544883  1430 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 7 to 8, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 8 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:33.569041  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:33.577163  1680 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:33.560621  5832 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.589128  5641 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:33.591598  5615 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:33.581445  5272 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:33.592463  5615 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:33.593750  5615 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.596880  5821 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.597992  5872 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:33.599295  5872 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.579314  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:33.582979  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57704.5us
I20260709 13:01:33.572810  5884 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.577167  5656 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:33.603245  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47884.4us
I20260709 13:01:33.605233  1675 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.560948  5833 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.612107  1682 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:33.614233  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.615124  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.616176  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.578938  5886 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:33.619098  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 118847us
W20260709 13:01:33.620242  1499 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.611s (SENT)
I20260709 13:01:33.620754  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:33.621702  5881 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.622613  5881 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.618801  5858 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:33.624089  5858 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.626219  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.626369  5858 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.621968  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50480 (request call id 25) took 1002 ms. Trace:
I20260709 13:01:33.627285  1678 rpcz_store.cc:276] 0709 13:01:32.619270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.619447 (+   177us) service_pool.cc:224] Handling call
0709 13:01:33.621657 (+1002210us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540031abd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2b853 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:33.621812 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560412544}
I20260709 13:01:33.628446  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.629302  1677 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:33.630236  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.627025  1682 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:33.632926  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.633767  1675 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.634601  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.636169  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.640127  1679 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:33.638011  5876 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:33.600747  5771 consensus_queue.cc:1243] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:33.649725  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.652643  5805 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:33.657675  5248 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:33.657148  1430 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 7 to 8, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.658114  5248 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:33.659192  5248 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.659873  1430 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.650619  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.651942  1602 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.644047  1683 raft_consensus.cc:2376] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8. Re-sending same reply.
I20260709 13:01:33.662901  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:33.653088  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 157422us
W20260709 13:01:33.664342  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 92415.9us
I20260709 13:01:33.652626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.653896  1677 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.661490  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.665215  1675 raft_consensus.cc:2376] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:33.667662  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.671494  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.671895  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.672189  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.672595  1600 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:33.673031  1499 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.715s (SENT)
I20260709 13:01:33.676008  1677 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
W20260709 13:01:33.678730  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.679286  1680 raft_consensus.cc:2376] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:33.689337  1678 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.679041  1679 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.694895  1682 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:33.695982  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 2029) took 1025 ms. Trace:
I20260709 13:01:33.696241  1676 raft_consensus.cc:2410] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:33.695259  1607 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:33.674438  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:33.698062  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.696456  1680 rpcz_store.cc:276] 0709 13:01:32.670407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.583525 (+913118us) service_pool.cc:224] Handling call
0709 13:01:33.695910 (+112385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.700270  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.697398  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:33.671599  5876 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:33.714062  5876 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:33.716094  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.717126  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 4 to 5, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 5 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:33.718173  5628 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.718803  5628 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.722769  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.723501  1682 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:33.726985  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.727046  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.727679  1676 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:33.707298  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52404us
I20260709 13:01:33.709560  5694 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:33.710026  5821 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.727588  1682 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:33.689424  5861 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.697872  5855 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.731400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.731788  1609 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:33.705689  1675 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
W20260709 13:01:33.711093  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.730042  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:33.733037  1679 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:33.730320  1600 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:33.712700  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.734094  1677 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:33.735146  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.735417  1677 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:33.735948  1682 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:33.736043  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.736361  5821 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.736938  2256 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:33.738497  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.738749  5821 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.739298  2254 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:33.736076  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2019) took 1106 ms. Trace:
I20260709 13:01:33.699329  5248 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:33.730048  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55028.9us
I20260709 13:01:33.761456  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.762509  1683 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:33.763176  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.763998  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.764005  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:33.764528  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.740494  1677 rpcz_store.cc:276] 0709 13:01:32.629348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.734791 (+1105443us) service_pool.cc:224] Handling call
0709 13:01:33.735174 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.735819 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.735997 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.771684  1430 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 6 to 7, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:33.772970  5628 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.773952  1680 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:33.770552  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73239.7us
W20260709 13:01:33.780674  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.782212  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:33.783658  1683 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:33.784489  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2025) took 1115 ms. Trace:
I20260709 13:01:33.784879  1683 rpcz_store.cc:276] 0709 13:01:32.669417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.766429 (+1097012us) service_pool.cc:224] Handling call
0709 13:01:33.783447 (+ 17018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.784200 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.784418 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.785825  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.787252  1683 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:33.788514  5805 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:33.789108  5805 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:33.790010  5805 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.798183  5851 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.802016  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:33.803131  1600 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:01:33.804046  1574 connection.cc:256] RPC call timeout handler was delayed by -1.79532363200002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3316s for a response
I20260709 13:01:33.783689  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:33.778647  5771 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:33.807303  5771 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:33.808243  5771 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.812000  5657 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.818310  5721 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:33.822683  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:33.823089  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.823385  2257 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.823902  2254 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:33.731439  5713 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.827162  5713 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.784403  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.832361  2259 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:33.832912  5851 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.833561  5886 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.833500  5851 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.834372  5886 consensus_queue.cc:1243] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:33.822903  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 149913us
W20260709 13:01:33.279033  1427 rpcz_store.cc:269] 0709 13:01:10.062328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.064047 (+  1719us) service_pool.cc:224] Handling call
0709 13:01:10.645452 (+581405us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:33.278188 (+22632736us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:30.093064 (+     0us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e6756616c
0709 13:01:30.231140 (+138076us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:30.283679 (+ 52539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:30.289824 (+  6145us) write_op.cc:435] Acquired schema lock
0709 13:01:30.289867 (+    43us) tablet.cc:662] Decoding operations
0709 13:01:30.293139 (+  3272us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:30.293221 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:30.293247 (+    26us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:01:30.338068 (+ 44821us) tablet.cc:701] Row locks acquired
0709 13:01:30.338125 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:01:30.338308 (+   183us) write_op.cc:270] Start()
0709 13:01:30.338542 (+   234us) write_op.cc:276] Timestamp: P: 1783602090338237 usec, L: 0
0709 13:01:30.338577 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:01:30.339423 (+   846us) log.cc:844] Serialized 10102 byte log entry
0709 13:01:30.869968 (+530545us) op_driver.cc:464] REPLICATION: finished
0709 13:01:30.878516 (+  8548us) write_op.cc:301] APPLY: starting
0709 13:01:30.878624 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:30.893766 (+ 15142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:30.893811 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:30.906673 (+ 12862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:30.907067 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 13:01:30.907131 (+    64us) write_op.cc:312] APPLY: finished
0709 13:01:30.907958 (+   827us) log.cc:844] Serialized 212 byte log entry
0709 13:01:30.908394 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.908598 (+   204us) write_op.cc:454] Released schema lock
0709 13:01:30.908675 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:30.909039 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.909064 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":863088,"reported_tablets":47,"spinlock_wait_cycles":43521408,"child_traces":[["op",{"apply.queue_time_us":8272,"apply.run_cpu_time_us":28883,"apply.run_wall_time_us":30498,"cfile_cache_hit":94,"cfile_cache_hit_bytes":98465,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6222,"cfile_init":1,"lbm_read_time_us":799,"lbm_reads_lt_1ms":8,"num_ops":24,"prepare.queue_time_us":1079666,"prepare.run_cpu_time_us":20179,"prepare.run_wall_time_us":141795,"raft.queue_time_us":492944,"raft.run_cpu_time_us":3827,"raft.run_wall_time_us":7852,"replication_time_us":531208,"spinlock_wait_cycles":9626368,"thread_start_us":1584208,"threads_started":4,"wal-append.queue_time_us":30943,"wal-append.run_cpu_time_us":15095,"wal-append.run_wall_time_us":1553273}]]}
W20260709 13:01:33.867324  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90940us
I20260709 13:01:33.817327  1430 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 6 to 8, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 8 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:33.883664  1677 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:33.887603  1674 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:33.888173  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2023) took 1217 ms. Trace:
I20260709 13:01:33.902456  1677 rpcz_store.cc:276] 0709 13:01:32.667437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.765534 (+1098097us) service_pool.cc:224] Handling call
0709 13:01:33.883497 (+117963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.884430 (+   933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.884637 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.866765  5694 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:33.910259  5884 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.911778  1430 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.917140  5884 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.891422  5861 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.924836  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.933039  1677 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:33.914049  5713 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.933867  1676 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:33.886462  5855 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.937664  5713 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.945458  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.945634  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:33.941730  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 218836us
W20260709 13:01:33.944464  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 172370us
I20260709 13:01:33.948247  2256 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:33.949723  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:33.950518  2254 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:33.952209  5868 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:33.955165  5713 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.955840  5713 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.957335  5618 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
I20260709 13:01:33.957052  5694 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.957924  1676 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:33.957800  5618 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.959019  1681 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10.
I20260709 13:01:33.958307  1676 pending_rounds.cc:85] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 8
I20260709 13:01:33.959520  1676 pending_rounds.cc:107] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:33.960083  1676 raft_consensus.cc:2889] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.962160  5858 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.962859  1676 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:33.969103  5868 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:33.969795  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:33.970252  5861 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.970978  5636 raft_consensus.cc:2764] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:33.972630  5861 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.975306  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.976414  2254 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:33.977295  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.978077  2254 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:33.979535  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.980264  2258 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:33.981623  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.983681  1679 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:33.976297  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:33.985715  2252 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:33.986748  2260 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:33.988708  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2016) took 1355 ms. Trace:
I20260709 13:01:33.989372  1679 rpcz_store.cc:276] 0709 13:01:32.628606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.740718 (+1112112us) service_pool.cc:224] Handling call
0709 13:01:33.983238 (+242520us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:33.983459 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.984065 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.984245 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47770880}
I20260709 13:01:33.991567  1676 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.995275  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:33.946564  5851 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:33.988687  2259 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:33.928579  5656 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:33.979462  5884 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.985613  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.005371  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.007640  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.008603  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:33.962790  5858 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.031955  1680 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:34.032630  1604 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:33.997162  5673 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:01:34.022110  5618 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:34.042814  1674 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:34.053802  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:33.997256  5713 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:34.058880  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 110131us
I20260709 13:01:34.061810  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.062796  1527 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.062561  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.065116  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.067107  1607 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.067337  1602 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:34.070847  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.073170  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.073835  2256 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.085726  1605 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.088826  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.089583  1675 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 10. Ops: []
I20260709 13:01:34.090206  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2017) took 1461 ms. Trace:
W20260709 13:01:34.073287  5883 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.007s
I20260709 13:01:34.042413  5884 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.090544  1675 rpcz_store.cc:276] 0709 13:01:32.628862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.773767 (+1144905us) service_pool.cc:224] Handling call
0709 13:01:34.089267 (+315500us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:34.089430 (+   163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.089976 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.090155 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37354240}
I20260709 13:01:34.096479  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.092252  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:34.091280  5843 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.003s
I20260709 13:01:34.099933  2255 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.109056  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:34.114717  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:34.115021  1682 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:34.111557  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.117290  5801 raft_consensus.cc:2764] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:34.121778  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2022) took 1484 ms. Trace:
I20260709 13:01:34.123865  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.129733  2258 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:34.133630  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 2036) took 1411 ms. Trace:
I20260709 13:01:34.108480  5764 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.117182  1527 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:34.089900  5657 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:01:34.129101  1682 rpcz_store.cc:276] 0709 13:01:32.664569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.763529 (+1098960us) service_pool.cc:224] Handling call
0709 13:01:34.089427 (+325898us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:34.109468 (+ 20041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.121519 (+ 12051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.121720 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28475648}
I20260709 13:01:34.091451  5832 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:34.115579  5886 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.134088  1681 rpcz_store.cc:276] 0709 13:01:32.722631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.077289 (+354658us) service_pool.cc:224] Handling call
0709 13:01:34.131570 (+1054281us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54003b97d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:34.133559 (+  1989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666333056}
I20260709 13:01:34.202832  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.120180  5884 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.195542  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:34.197616  5919 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:34.205269  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.194782  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.181080  1678 raft_consensus.cc:2410] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:34.136669  5872 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.273375  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.274665  5858 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.282212  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
W20260709 13:01:34.242349  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 142684us
W20260709 13:01:34.190793  1499 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.882s (SENT)
I20260709 13:01:34.204788  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.338795  2258 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:34.203671  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.138702  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.339563  1531 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:34.338940  1601 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.293970  1607 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:34.118474  5843 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.295446  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:34.301739  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.292697  5886 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.318141  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.242798  5855 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.321568  1609 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:34.343077  1600 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:34.287153  5656 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:34.348498  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 233853us
W20260709 13:01:34.343142  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 350862us
I20260709 13:01:34.317852  5872 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.356230  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:34.357174  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.357811  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.365244  1607 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:34.364625  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.338287  1602 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.369704  1527 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:34.374027  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.374974  1676 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.376493  1606 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:34.383013  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.384240  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:34.385174  1682 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:34.386065  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.352046  5615 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.360462  5886 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.364204  5872 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.393332  2255 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:34.393666  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.394691  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.395015  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:34.395867  1677 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:34.396440  5656 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.396602  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.397384  1674 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:34.397090  5656 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:34.398527  1674 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:34.399224  5656 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:34.363867  5248 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.400530  5248 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.400674  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:34.401201  5248 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.401228  1680 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:34.405056  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 214338us
W20260709 13:01:34.405803  1499 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.914s (SENT)
W20260709 13:01:34.407457  1499 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.996s (SENT)
I20260709 13:01:34.407866  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.408581  5855 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.410902  5884 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:34.411226  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.411558  5884 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.412101  2261 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:34.413116  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.415720  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.415611  2260 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:34.417896  5884 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.418571  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.419885  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.428962  2255 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:34.393409  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:34.421475  5922 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:01:34.432004  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.434706  2252 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:34.422096  5913 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 13:01:34.422305  5917 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:01:34.423695  5915 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:01:34.423871  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:34.425292  5923 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:34.445943  2260 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:34.447278  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 251833us
I20260709 13:01:34.364424  5918 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.286454  5764 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.383412  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:34.429339  2256 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.390750  1601 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:34.431898  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.432807  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.453111  1679 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:34.436692  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.453819  1682 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
W20260709 13:01:34.448616  1499 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.075s (SENT)
I20260709 13:01:34.431401  1680 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.456420  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.457226  1675 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:34.456480  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:34.460963  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.432174  5881 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.458422  1681 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:34.465412  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.465618  2257 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:34.466035  1602 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.466298  1603 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:34.469517  1534 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.470227  2259 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:34.470762  1527 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:34.459560  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.473207  2254 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.462368  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.448558  5713 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:34.430238  5615 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:34.493067  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.494306  1601 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:34.444342  5801 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:34.475448  5868 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:34.503585  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.477100  5656 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.510214  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.511246  2258 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:01:34.514802  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.501206  5707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.004s
I20260709 13:01:34.520824  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.521584  1533 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.526988  1601 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:34.528051  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79469.4us
I20260709 13:01:34.521270  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.535969  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 573) took 1354 ms. Trace:
W20260709 13:01:34.525978  5707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.001s	sys 0.004s
W20260709 13:01:34.537345  1499 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.107s (SENT)
I20260709 13:01:34.539948  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:34.536913  1683 rpcz_store.cc:276] 0709 13:01:33.181241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.788112 (+606871us) service_pool.cc:224] Handling call
0709 13:01:33.813818 (+ 25706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.814236 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.814261 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.814735 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.033730 (+218995us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:34.033767 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.033828 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.422960 (+389132us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:34.529603 (+106643us) raft_consensus.cc:1685] finished
0709 13:01:34.529632 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.535907 (+  6275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":15275264,"thread_start_us":218631,"threads_started":1,"wal-append.queue_time_us":253615}
I20260709 13:01:34.527454  5925 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.477605  5918 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.535903  5855 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:34.539775  5248 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:34.526366  5713 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:34.600857  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:34.603284  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65963.1us
I20260709 13:01:34.604240  1532 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:34.563481  5618 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:34.625072  1526 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.560772  5843 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:34.628834  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110559us
I20260709 13:01:34.638643  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:34.647411  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:34.626473  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.658438  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.659391  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.660156  1532 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.661005  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.662050  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.659991  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:34.663775  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 117490us
I20260709 13:01:34.657089  1528 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:34.695945  1499 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.246s (SENT)
I20260709 13:01:34.561077  5925 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:34.701689  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 273849us
I20260709 13:01:34.735010  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.736833  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.654232  5272 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:34.735144  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 375614us
I20260709 13:01:34.651037  5871 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:34.735253  5933 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:01:34.749230  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:34.751705  1529 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.753849  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:34.754545  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.774868  1530 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.756964  1605 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:34.757431  1528 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
W20260709 13:01:34.762708  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 104435us
I20260709 13:01:34.698913  5833 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:34.736847  5918 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.697767  5764 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:34.781208  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:34.779152  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.782150  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.782413  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.782589  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.782754  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.785460  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.786828  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.788901  5673 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:34.790354  2256 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:34.797420  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.798167  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.798656  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2179) took 1130 ms. Trace:
I20260709 13:01:34.799088  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.799335  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:34.799815  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2374) took 1167 ms (client timeout 1516 ms). Trace:
W20260709 13:01:34.800537  1604 rpcz_store.cc:269] 0709 13:01:33.632141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.634273 (+  2132us) service_pool.cc:224] Handling call
0709 13:01:34.799596 (+1165323us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:34.799749 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913563904}
I20260709 13:01:34.803396  5832 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:34.806802  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.808647  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.808754  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.809450  2260 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:34.809939  5909 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:34.810985  5909 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:34.811304  5909 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:34.811591  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:34.812058  5909 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.812834  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:34.799849  1532 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:34.815249  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.816363  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.816526  5615 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:34.817188  1532 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:34.817663  1601 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:34.799007  1678 rpcz_store.cc:276] 0709 13:01:33.668632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.705414 (+ 36782us) service_pool.cc:224] Handling call
0709 13:01:34.798433 (+1093019us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540032a5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:34.798584 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937936640}
I20260709 13:01:34.819178  2254 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:34.827900  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:34.822914  5925 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.829293  5940 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:34.829859  5940 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:34.830242  5872 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.767117  5272 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.831226  5272 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.830811  5940 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.774227  5871 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.832888  5871 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.832094  1533 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:34.841547  1601 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:34.821655  1532 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:34.824654  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 166299us
W20260709 13:01:34.847692  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66536.4us
I20260709 13:01:34.848163  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:34.850078  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.850250  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:34.827780  5628 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:34.852023  5801 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:34.852761  5801 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:34.841746  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.788117  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.852206  5707 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.854310  1529 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
W20260709 13:01:34.854885  5930 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:01:34.824093  5248 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:34.853648  5858 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:34.856281  5858 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:34.856663  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.856850  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:34.859571  1529 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.855223  5949 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.858744  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 723) took 1254 ms. Trace:
I20260709 13:01:34.853322  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:34.853281  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.860491  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:34.852294  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:34.861122  1533 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.865787  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.866439  1600 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:34.868925  1602 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:34.860869  1606 rpcz_store.cc:276] 0709 13:01:33.604666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.608473 (+  3807us) service_pool.cc:224] Handling call
0709 13:01:33.609866 (+  1393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.381369 (+771503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.858473 (+477104us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540031bd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:34.858674 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753262976}
I20260709 13:01:34.872262  2254 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:34.873057  1534 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:34.876140  1530 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:34.877316  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.879983  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.880652  1532 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.857524  5927 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:34.885277  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.857251  5858 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.885643  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.887214  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.889266  1534 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.852705  5869 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.891453  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.892973  1533 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:34.901250  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 148665us
I20260709 13:01:34.868561  5707 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.905174  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.910358  1602 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:34.909931  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49521.8us
I20260709 13:01:34.910401  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:34.907053  5707 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.853827  5801 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.929026  1601 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:34.936643  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.941857  1600 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.942005  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:34.920290  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68102.5us
I20260709 13:01:34.942988  1533 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:01:34.929088  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.929692  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:34.944835  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:34.945582  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:34.915616  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.919312  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:34.947819  4933 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.948189  4933 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:34.934765  5872 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:34.948552  4933 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.949043  5713 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.949743  5918 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.950132  5918 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.950474  5918 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.925004  5821 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:34.919122  5764 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.953469  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.953994  5272 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:34.915752  5935 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:01:34.956516  5764 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.936082  5909 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.959021  5707 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:34.961655  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:34.962209  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.962878  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:34.963667  1601 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:34.912976  5937 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.964660  5937 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.965112  5937 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.956117  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.945822  1534 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:34.962155  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:34.912151  5927 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.980278  4933 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:34.981631  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.885965  5884 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:01:34.937166  5858 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.984922  1530 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:34.981364  1529 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:34.985071  5927 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.023708  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.026357  4933 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:35.018414  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 72898.2us
I20260709 13:01:34.986213  1499 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:35.027494  1499 leader_election.cc:403] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:35.032671  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58783us
I20260709 13:01:34.952355  5656 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.043222  1500 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
W20260709 13:01:35.066027  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 78603.9us
W20260709 13:01:35.067085  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 201771us
I20260709 13:01:35.044453  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:34.981452  5764 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.023526  5272 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.075366  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:35.077276  2255 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.036710  5927 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.078857  5628 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:35.079066  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:35.077801  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:35.084134  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 118038us
I20260709 13:01:35.085814  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:35.088131  4933 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.088598  4933 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.088907  4933 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:35.091176  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67664.1us
I20260709 13:01:35.093359  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:35.071424  5868 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11.
I20260709 13:01:35.091977  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:35.071686  5843 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:35.094806  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.073884  5942 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.024430  5869 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:35.070626  5851 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:35.080878  5876 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.220604  5876 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.221098  5876 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.098313  5950 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.099366  5954 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:35.225119  5954 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:35.226086  5954 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.110278  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:35.228350  5821 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:35.228758  5821 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:35.229112  5821 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:35.228425  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 118122us
I20260709 13:01:35.111464  5953 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:01:35.132591  5881 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.233417  5881 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.233800  5881 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.234869  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:35.235574  1529 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:35.109463  5886 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.005s
I20260709 13:01:35.141065  5272 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.236557  5886 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.141549  5921 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:35.105141  5628 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:35.244659  5628 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:35.245191  5953 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:35.245724  5628 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.247032  5628 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.248399  5868 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.244935  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:35.151568  5943 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:35.249825  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:35.092904  5855 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.251731  5886 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.248950  5868 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.255576  5868 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.076107  5673 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:01:35.082850  5833 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:01:35.249927  1530 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:35.158751  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65460.5us
I20260709 13:01:35.258570  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:35.248955  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.264446  1529 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:35.271625  5881 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:35.273417  5948 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
W20260709 13:01:35.273989  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.167593  5871 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.177601  5937 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.192989  5918 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.194039  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:35.196504  2255 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:35.202780  5942 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.205353  5908 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.288820  5908 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:35.206462  5657 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.208664  5872 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:35.291114  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.209945  4933 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:35.211256  1526 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
I20260709 13:01:35.236730  5272 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.137614  5707 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.236756  1531 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:35.241612  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:35.249024  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:35.149845  5843 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:35.280002  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 181484us
I20260709 13:01:35.292814  1526 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:01:35.294049  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 202143us
I20260709 13:01:35.300825  1527 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:35.300748  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:35.296087  4933 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.296977  1531 pending_rounds.cc:85] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 7
I20260709 13:01:35.303172  1531 pending_rounds.cc:107] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:35.303442  1531 raft_consensus.cc:2889] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.279560  5868 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.281592  5858 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.312426  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:35.313690  5941 raft_consensus.cc:2764] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:35.314545  5941 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:35.316694  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:35.317654  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.317902  5946 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:35.318979  5946 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:35.290910  5657 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:35.319882  5707 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:35.321048  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.321568  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:35.322887  5929 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.323199  1678 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:35.323356  5929 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.323779  5929 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.324957  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.325748  1678 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.326027  5272 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.303035  5843 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.327780  1678 pending_rounds.cc:85] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 7
I20260709 13:01:35.328230  1678 pending_rounds.cc:107] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:35.328691  1678 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.329506  1678 pending_rounds.cc:107] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:35.329865  5871 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:35.330642  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 235860us
I20260709 13:01:35.331049  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.331801  1679 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.321749  1675 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:35.332624  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.331720  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.333752  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.334987  1675 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.334146  1678 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.331682  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.336704  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.336704  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:35.339612  1605 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.333866  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.340725  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:35.341380  4933 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.319929  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.290714  5872 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:35.310343  2261 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:35.349071  1683 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:35.349424  1682 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:35.351455  1600 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:35.298805  5950 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.321732  5707 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:35.366672  5707 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:35.367093  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.367901  1682 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.316059  5855 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:35.368891  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.369309  1533 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:35.368965  5855 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:35.370749  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.371562  1679 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.372471  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.367583  5707 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.370334  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.374106  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:35.372732  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.375284  1675 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.375144  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.352756  4933 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:35.303396  5713 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:35.370617  1602 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:35.376958  1681 raft_consensus.cc:2376] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9. Re-sending same reply.
I20260709 13:01:35.373231  1679 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.373194  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.386333  1674 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:35.379628  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.296998  5805 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:35.307300  5851 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.310663  5858 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:35.369797  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.334273  5957 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.319917  5941 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:35.390138  4933 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:35.392488  1677 raft_consensus.cc:2376] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11. Re-sending same reply.
I20260709 13:01:35.392944  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.374712  5950 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.394294  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.353497  5881 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.420507  4933 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:35.397393  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.336864  5821 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.397759  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.368394  5636 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:35.416625  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:35.422432  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 325995us
I20260709 13:01:35.424029  1683 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
W20260709 13:01:35.396749  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 104105us
I20260709 13:01:35.387138  5641 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.427040  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:35.393046  5805 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:35.428620  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 89756.9us
I20260709 13:01:35.428835  1682 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.313570  5876 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:35.431419  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 111927us
I20260709 13:01:35.432181  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:35.433138  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 152299us
I20260709 13:01:35.438642  1605 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:35.350993  5949 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:01:35.420365  5941 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:35.448218  4933 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.429946  5641 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.474339  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:35.473421  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:35.431517  5805 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.474973  2261 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.476631  5641 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.397009  5851 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:35.477574  5958 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:01:35.478590  5916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.006s
W20260709 13:01:35.479105  5916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.005s	sys 0.006s
I20260709 13:01:35.479676  5937 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.476689  4933 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.480700  5707 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.479095  5851 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.484951  5941 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.486510  5941 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.488020  4933 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:35.489764  4933 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:35.490245  4933 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:35.492357  1605 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:35.491098  4933 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.427999  5673 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:35.504652  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 125093us
I20260709 13:01:35.505635  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:35.476267  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:35.510033  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:35.511626  1527 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
W20260709 13:01:35.513124  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72281.7us
I20260709 13:01:35.514392  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.430927  5955 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:35.450174  5833 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.436177  5248 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:01:35.558681  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:35.398170  5908 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.560868  1531 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.563557  5946 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.563701  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:35.563985  5851 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:35.565479  5950 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:35.566105  5950 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.566326  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:35.566836  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61305.6us
I20260709 13:01:35.567190  5851 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.567605  5851 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.568117  5851 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.568500  5937 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.565392  1674 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:01:35.569648  1674 pending_rounds.cc:85] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 11
I20260709 13:01:35.569895  1674 pending_rounds.cc:107] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:35.570152  1674 raft_consensus.cc:2889] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.571342  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.571841  1674 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.576858  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.577782  5937 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:35.494578  5884 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:35.567544  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.586344  2261 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:35.588023  1683 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:01:35.589906  1647 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:35.567059  5960 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:35.593580  1679 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:35.596041  1674 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:35.425460  5957 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.524458  5886 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:35.613065  1674 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:35.579360  5871 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:35.617419  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 200869us
W20260709 13:01:35.647720  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57901.8us
I20260709 13:01:35.648613  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.577841  5851 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.613962  5884 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:35.590981  5869 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:35.669812  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:35.503953  5657 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.590514  5950 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.516664  5858 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.593606  5673 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:01:35.675033  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 86253.7us
I20260709 13:01:35.609663  5833 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:01:35.646193  5636 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:35.695894  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 187305us
I20260709 13:01:35.665649  5871 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:35.691624  5974 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:35.695158  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:35.700834  1674 raft_consensus.cc:606] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.701174  1674 raft_consensus.cc:614] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.702173  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.697409  5618 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:35.712779  5657 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.669418  5969 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:35.699409  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.703634  5805 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.733726  1531 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:35.735634  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:35.693814  5636 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.738337  2260 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:35.739688  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73362.7us
W20260709 13:01:35.773265  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.699702  5918 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.789215  1675 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:35.730195  5858 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.728114  5969 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.716615  5946 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:01:35.773378  5886 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.742830  5636 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.788203  5821 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:35.846292  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 266531us
I20260709 13:01:35.713091  5979 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:01:35.850764  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 423776us
I20260709 13:01:35.866497  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:35.789165  5618 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:35.872095  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 177370us
I20260709 13:01:35.833474  5974 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:35.818845  5969 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.830524  5973 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.875415  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:35.729710  5929 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:35.865319  5868 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
W20260709 13:01:35.879715  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.855862  5248 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.884912  5970 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:35.885187  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.886396  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:35.886727  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:35.886942  5884 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.873243  5963 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:35.888528  5963 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:35.889050  5972 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.890089  5981 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.893066  5929 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.893638  5641 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.896425  5957 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:35.896659  5961 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.467s	user 0.004s	sys 0.005s
I20260709 13:01:35.880744  5833 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.882483  5974 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.898036  5942 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:35.898401  5942 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:35.899703  5927 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.000s
I20260709 13:01:35.899416  5942 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.882649  5949 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:35.900705  5949 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:35.901180  5949 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.902889  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:35.903903  5851 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:35.904598  5954 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:35.887960  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:35.888903  5963 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:35.914033  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.849705  5965 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.303s
I20260709 13:01:35.905114  5954 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:35.881371  5973 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.916817  5954 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.919571  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:35.897117  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.899996  5974 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.920805  1682 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:35.925026  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49705.5us
I20260709 13:01:35.910234  5868 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.900810  5950 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.900524  5876 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:35.917683  5833 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.948148  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.960970  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:35.961010  1682 raft_consensus.cc:2376] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13. Re-sending same reply.
I20260709 13:01:35.961251  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.923020  5979 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:35.968071  1604 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:35.964504  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 78176.9us
I20260709 13:01:35.963536  1681 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.968994  1608 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:35.971724  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:35.965415  1574 leader_election.cc:400] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:35.924176  5929 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:35.930017  5843 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:01:35.976266  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:35.977383  1681 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:35.978488  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:35.913096  5248 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:35.981000  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:35.980225  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:35.879545  5871 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.962193  5989 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:36.034605  5707 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
I20260709 13:01:35.900192  5927 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:36.036474  5978 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 13:01:36.037909  5833 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.038633  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.039466  1606 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.039889  5980 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:36.040261  5980 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:36.032603  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72211.9us
I20260709 13:01:36.041028  5618 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.042017  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.043257  5876 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:36.030720  5949 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:35.984469  1605 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:35.979085  1681 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.045153  1604 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:36.016868  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:35.985176  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:35.998652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.050815  1600 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:36.051043  1602 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.053007  1606 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:35.967059  5942 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.974223  5641 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.067062  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.073051  1681 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:36.065606  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:36.056810  5990 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:01:36.075356  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.079339  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.075984  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.051892  5851 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.077322  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.083345  1531 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:36.085180  1528 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:36.085772  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.086249  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.086992  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.087459  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:36.088467  5983 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.007s
W20260709 13:01:36.089413  5988 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:01:36.090221  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.090633  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.091353  1529 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.092236  1533 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:36.093333  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.093956  1676 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:36.094218  5248 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:36.095587  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.088567  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.098398  1525 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.099385  1683 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:36.079994  5989 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.100977  5989 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:36.101126  5976 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:01:36.104722  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.105782  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.105962  5949 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.106592  1531 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.078295  5886 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.041296  5980 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.108741  5980 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.032073  5636 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.114717  5989 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.076767  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.075714  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:36.121079  1681 raft_consensus.cc:2376] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12. Re-sending same reply.
I20260709 13:01:36.088174  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.122128  1530 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:36.037926  5927 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:36.080781  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110917us
I20260709 13:01:36.085284  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:36.123364  1648 leader_election.cc:336] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.734s (SENT)
I20260709 13:01:36.123745  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.081897  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.123908  1534 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:36.126812  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.124570  1682 raft_consensus.cc:2376] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13. Re-sending same reply.
W20260709 13:01:36.131820  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 146722us
I20260709 13:01:36.132855  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.119570  5872 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.136711  2261 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:36.149515  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.160105  2259 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:36.146471  1648 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.866s (SENT)
I20260709 13:01:36.148839  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:36.146817  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 71157us
I20260709 13:01:36.148423  2254 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:36.138489  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:35.982720  5843 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.149175  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.165393  2255 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:36.136965  5248 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.163635  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:36.171592  1648 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.870s (SENT)
I20260709 13:01:36.132490  5805 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.135957  5876 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.178961  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.172540  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.181574  5969 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.183899  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.147431  5927 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:36.217799  1609 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:36.185304  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51130.7us
I20260709 13:01:36.187132  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.187374  5868 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:36.222994  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51622.8us
I20260709 13:01:36.188871  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.187050  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.191104  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.192595  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.193334  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.193518  5908 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.198626  5973 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.178426  5886 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:01:36.200950  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.203362  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:36.237320  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:36.205632  2261 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:36.184482  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.239181  1525 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:36.216720  1531 raft_consensus.cc:2376] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10. Re-sending same reply.
I20260709 13:01:36.184777  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.135380  5940 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:01:36.225180  1527 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.222937  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.232892  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.224516  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:36.248231  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.249009  1607 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:36.203570  2226 leader_election.cc:336] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.510s (SENT)
I20260709 13:01:36.238070  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.249677  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.249974  1534 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.240808  1533 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.222631  1530 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.233278  2252 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:36.219216  5941 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.004s
I20260709 13:01:36.251694  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:36.253275  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:36.167300  5657 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:36.218221  5872 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:36.220044  5927 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.138695  5963 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.286818  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.287631  2257 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.289332  1528 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:36.250473  5980 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.293895  1674 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:36.297724  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.300526  1607 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.296752  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.298080  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:36.305331  1606 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:36.304562  4933 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:36.250377  5248 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.223507  5918 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:01:36.288980  5927 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.284579  5981 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:36.257243  5713 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:36.314810  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 90981.3us
I20260709 13:01:36.295265  5980 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.257424  5973 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:36.235940  5876 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:01:36.319276  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:36.328996  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 125475us
I20260709 13:01:36.329448  1607 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:36.296381  5954 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:36.323652  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:36.292590  5968 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.325911  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:36.308531  4933 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:36.310077  5868 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:36.284421  5641 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:01:36.328759  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.345376  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:36.335032  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 163480us
I20260709 13:01:36.350399  1525 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:36.291420  5986 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:36.334496  5980 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.350553  4933 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.370323  2256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:36.370447  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.336647  5954 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:36.378419  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:36.345928  5886 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:36.381523  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 129834us
I20260709 13:01:36.385463  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.327960  5884 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:36.351521  5868 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:36.417480  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.417992  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:36.417075  1606 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.381865  5973 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.357326  5949 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:01:36.437016  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.416090  5871 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.441577  1677 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.441344  5929 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.442932  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.445593  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.446431  1677 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:36.448124  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.449362  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.454032  1677 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:36.454967  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.456387  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.457062  1676 raft_consensus.cc:2376] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:36.457065  5636 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.458817  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.458282  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.459493  1678 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:36.459779  1676 raft_consensus.cc:2376] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10. Re-sending same reply.
I20260709 13:01:36.460963  1676 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:36.461189  1679 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:36.455039  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.462433  1677 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:36.463308  5995 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:01:36.465345  5940 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:36.465643  5801 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:36.465903  5940 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:36.466948  5940 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.469576  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2399) took 1095 ms. Trace:
I20260709 13:01:36.469935  1609 rpcz_store.cc:276] 0709 13:01:35.374024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.374182 (+   158us) service_pool.cc:224] Handling call
0709 13:01:35.374465 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.224731 (+850266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.469350 (+244619us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540011dd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:36.469518 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935912704}
I20260709 13:01:36.471257  1606 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:36.418751  5986 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:36.452735  6015 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.434500  5858 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.613s	user 0.003s	sys 0.008s
I20260709 13:01:36.454190  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.476827  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.487959  1675 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:36.410035  5989 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.552227  1677 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:36.508373  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.514458  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.556134  1679 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:36.474367  5999 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:36.556504  1683 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:36.482616  5843 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.562738  1532 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:36.565117  5921 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:36.565554  5921 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:36.566367  5921 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.567853  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.568478  2252 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.569228  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.569847  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.551855  5801 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.572693  5868 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.574290  5801 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:36.576164  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 193508us
W20260709 13:01:36.576943  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 165862us
I20260709 13:01:36.577661  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:36.567472  5921 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.586908  5989 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:36.588282  6003 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:01:36.588778  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.589548  5713 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:36.590420  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.591279  5909 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:36.591774  5909 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:36.592747  5965 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.592656  5909 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.481238  5986 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:36.594610  5942 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.003s
I20260709 13:01:36.491242  6015 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.589116  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.596169  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:36.597425  6004 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:36.586807  2259 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:36.598475  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.598802  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.599643  2252 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:36.599655  1674 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:36.588143  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.598543  1499 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.601538  2255 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:36.610038  1678 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:36.437199  5973 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.631014  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.615532  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.632376  1606 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:36.633061  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.633198  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.637970  1609 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:36.636523  2252 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:36.641165  4933 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.642634  2256 raft_consensus.cc:606] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.645045  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:36.649061  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.644169  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:36.590224  5713 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.603744  5989 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.632915  5821 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.594784  5986 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.605474  5764 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.646484  5871 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.639168  5968 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.647243  5851 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.646199  5955 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.652194  5957 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.659798  6019 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:36.742712  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 138512us
I20260709 13:01:36.628544  5886 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:36.707965  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:36.656975  5984 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:36.492102  5954 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:36.700506  6007 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:01:36.741310  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 85491.2us
W20260709 13:01:36.744042  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 365351us
I20260709 13:01:36.692333  5764 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.751152  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:36.738884  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 87502.5us
I20260709 13:01:36.693992  5942 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:36.701851  5929 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.693845  5876 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:01:36.742048  6019 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.758196  6020 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.761896  5628 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:36.789966  5954 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.801570  1529 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:36.768365  5764 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.806253  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:36.805699  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.807121  1534 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.805824  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:36.806393  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62770.5us
I20260709 13:01:36.808459  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.805564  6016 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:36.811348  5876 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.811903  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.804710  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:36.814150  1530 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.816787  1534 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:36.784077  6019 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.819486  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:36.817004  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.822664  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:36.857311  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.798177  5871 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.801617  5941 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:36.886976  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:36.887344  1527 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:36.887831  2255 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:36.891476  2252 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:36.827386  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:36.846375  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:36.875639  5978 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:36.815917  5833 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:36.894836  6027 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.092s	user 0.000s	sys 0.003s
I20260709 13:01:36.907035  2255 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:36.907349  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:36.884202  5981 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:36.920172  1681 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:36.885560  5965 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.911794  1530 raft_consensus.cc:2410] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:36.814231  5628 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.819440  5805 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:01:36.940939  5918 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:36.823601  5929 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:01:36.813391  6020 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.891170  6016 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:36.957724  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:36.947293  1533 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:36.949185  1527 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:36.953506  2257 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:36.884954  5886 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:36.929291  5942 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.798491  5968 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:01:36.929687  6015 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.962792  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:36.938460  1607 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:36.889497  5871 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.971761  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:36.974117  5942 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:36.970395  6017 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:01:36.954398  5973 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:36.969521  5989 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.965848  5833 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:36.998919  5833 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.943002  5981 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.997364  5764 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.997910  5996 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:37.007932  6030 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:37.011071  6013 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:01:36.984934  6011 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:37.012084  6026 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:01:36.953275  5965 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.035794  5981 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.036326  5965 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.004499  5969 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.030875  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.001806  5871 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.037962  1680 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:37.040896  6025 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:37.003365  5984 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:37.001808  5833 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:36.982043  5918 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:36.979178  6016 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:37.054066  6037 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:01:37.056552  5980 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.003s
I20260709 13:01:37.061136  1525 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:01:37.071750  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 252296us
I20260709 13:01:37.073540  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.047276  5984 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:37.075714  5980 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.078886  5833 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.081796  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.082537  1679 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:37.087229  6014 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.435s	user 0.000s	sys 0.002s
I20260709 13:01:37.095139  5713 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.096011  6022 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.096642  6022 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.095127  5884 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.101297  5884 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:37.102535  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 156813us
I20260709 13:01:37.103503  5884 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.096657  5963 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.107133  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:37.113027  5980 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.104120  5884 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:37.114734  5618 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:37.115289  5618 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.116484  5996 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:37.117063  5996 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.119158  5996 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.100041  6022 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.120023  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:37.120920  1678 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:37.121759  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:37.122848  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.123862  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.125057  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.125612  1678 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.134102  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:37.134470  1679 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:37.135026  1683 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:37.138063  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 185208us
W20260709 13:01:37.137512  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 322782us
I20260709 13:01:37.141346  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.142179  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.148761  1678 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:37.150527  1678 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:37.153684  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.155759  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:37.158710  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:37.160756  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53696.6us
I20260709 13:01:37.161911  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:37.161993  1683 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:37.163262  2261 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:37.163726  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.166968  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.171305  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:37.172260  2254 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:37.183101  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.077339  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.243670  2256 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:37.264341  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65800.1us
I20260709 13:01:37.264856  1682 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:37.387200  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:37.265561  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 100730us
I20260709 13:01:37.387521  2258 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 5.
W20260709 13:01:37.265707  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 120872us
I20260709 13:01:37.272795  1680 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:37.298482  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.391144  1527 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:37.299814  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.391758  1528 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:37.392020  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.264076  5851 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.328919  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:37.396788  1678 raft_consensus.cc:606] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.264541  5963 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.272574  6022 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.353577  6036 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:01:37.358181  5821 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.358486  6018 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:01:37.363910  5927 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.027s	user 0.010s	sys 0.000s
I20260709 13:01:37.365106  5918 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.367127  6016 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:37.377142  5908 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.141s	user 0.011s	sys 0.000s
I20260709 13:01:37.380530  5986 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:37.381487  6045 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:01:37.382064  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2150) took 1322 ms (client timeout 1621 ms). Trace:
I20260709 13:01:37.167690  1533 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 4.
I20260709 13:01:37.163345  5980 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.403254  5953 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.421595  1532 rpcz_store.cc:269] 0709 13:01:36.067608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.075072 (+  7464us) service_pool.cc:224] Handling call
0709 13:01:37.381891 (+1306819us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54002a8354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:37.382001 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092111616}
I20260709 13:01:37.401515  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:37.401764  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 243156us
W20260709 13:01:37.403381  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 326153us
I20260709 13:01:37.444895  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.403590  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:37.445246  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43807.5us
I20260709 13:01:37.408694  4933 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:37.404479  5954 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.581s	user 0.001s	sys 0.009s
I20260709 13:01:37.388487  5713 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.417426  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 755) took 1193 ms. Trace:
I20260709 13:01:37.400723  5858 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:37.397917  5881 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.395376  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:37.468658  1676 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:37.407634  5248 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.408399  5929 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.469872  5929 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.470331  5929 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.397401  6019 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.415184  5628 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.447149  5884 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:37.477159  5884 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.477604  5884 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:37.446429  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.424903  5636 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.446588  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:37.451979  5713 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.453544  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.418462  5927 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.451817  6050 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.432538  5984 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.457691  5965 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:37.445973  6020 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:37.497534  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44059.9us
I20260709 13:01:37.499641  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.459545  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.460330  6048 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:37.449427  1531 rpcz_store.cc:276] 0709 13:01:36.223987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.245531 (+ 21544us) service_pool.cc:224] Handling call
0709 13:01:36.288928 (+ 43397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.289296 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.289328 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.289794 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.425257 (+135463us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:36.425322 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.425399 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.086420 (+661021us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:37.407320 (+320900us) raft_consensus.cc:1685] finished
0709 13:01:37.407341 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.417368 (+ 10027us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15097,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":41039744,"thread_start_us":98125,"threads_started":1,"wal-append.queue_time_us":252653}
I20260709 13:01:37.425262  6023 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.401230  6011 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:37.506273  5713 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.409530  6022 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.507917  5984 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.509260  6022 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.409217  5851 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.410544  5821 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:37.511534  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.511960  5821 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:37.512403  5707 consensus_queue.cc:1175] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 15 status { last_received { term: 15 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 15 index: 13 } }
I20260709 13:01:37.516032  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.439121  5909 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.454586  6051 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.521701  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.521644  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:37.528753  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.529409  1607 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 5.
I20260709 13:01:37.529474  5996 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:37.492398  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45878.8us
I20260709 13:01:37.530040  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:37.530645  1528 raft_consensus.cc:2376] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10. Re-sending same reply.
I20260709 13:01:37.530890  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:37.531318  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.531621  1525 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:37.494694  5636 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.533108  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:37.499785  5641 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.486346  5618 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.518254  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.540371  1533 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:37.517582  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.519482  1609 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:37.516873  1600 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:37.522948  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:37.542091  1526 raft_consensus.cc:2376] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10. Re-sending same reply.
I20260709 13:01:37.527058  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.491401  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.527377  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.527767  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.543450  2261 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:37.528937  1604 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:37.501395  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.523660  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.535267  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:37.505882  6000 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.163s	user 0.000s	sys 0.004s
I20260709 13:01:37.532594  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.551378  1525 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:37.534044  5641 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.496943  5833 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.441234  5953 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.552230  6020 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:37.534638  6023 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.495667  5858 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:37.497694  5886 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.535862  1527 raft_consensus.cc:2376] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11. Re-sending same reply.
I20260709 13:01:37.548460  6051 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.548920  5805 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:37.539363  5909 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.552202  5641 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.545519  1529 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:37.495930  5954 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:01:37.520748  6035 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:37.560254  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58934.1us
I20260709 13:01:37.486640  5942 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:37.562999  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71692.3us
I20260709 13:01:37.552278  5636 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.567970  6048 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:37.561146  6016 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.579252  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:37.580425  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.589210  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:37.595227  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:37.570463  5641 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.579710  6020 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:37.573823  6035 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.609516  5909 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.595888  6048 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.610628  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.614732  5707 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.595472  5886 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:37.622032  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.621030  4933 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:37.633386  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.620388  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.597659  5881 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.634743  2254 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:37.627051  2258 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:37.617560  5986 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.636462  6011 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:37.640015  5833 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:37.642339  6019 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:37.636574  6046 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:01:37.607844  5996 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.667976  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.629941  6048 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:37.628024  6051 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.623521  6035 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:37.670116  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 122065us
I20260709 13:01:37.663483  6011 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.669126  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:37.664124  5833 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:37.606415  6016 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.657563  5636 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.656709  5801 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.675802  5986 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:37.677151  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:37.679714  6057 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:37.673213  6051 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.671661  6019 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.674614  6011 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.632025  5886 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:37.689182  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.694325  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.793613  1605 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:37.736783  5957 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:37.738993  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.741294  5851 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.742084  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.743239  1606 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:37.726929  6055 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.233s	user 0.000s	sys 0.003s
I20260709 13:01:37.755666  5953 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.756918  5764 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.763038  5869 raft_consensus.cc:993] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:37.819185  1534 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:37.774335  5927 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.778837  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.783047  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2114) took 1129 ms. Trace:
I20260709 13:01:37.821466  1609 rpcz_store.cc:276] 0709 13:01:36.653554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.653698 (+   144us) service_pool.cc:224] Handling call
0709 13:01:36.654058 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.550039 (+895981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.782781 (+232742us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540012fcd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:37.782979 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989609344}
I20260709 13:01:37.791222  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:37.795640  1601 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:37.796213  1604 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:37.797590  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.726884  5986 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.797751  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.744644  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:37.657755  5858 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.671767  5996 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.814898  1607 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 5: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:37.727856  5805 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.797117  5957 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.728902  6019 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.827384  4933 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:37.792734  5636 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.826814  5986 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:37.831223  5881 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.833112  6019 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.841992  4933 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:37.838820  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 109919us
I20260709 13:01:37.867651  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:37.870793  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:37.853080  5881 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.882426  5881 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.885355  6051 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.885834  4933 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.887584  5996 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.888141  5996 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.888492  5996 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:37.888846  5996 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.896977  6016 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.900434  1530 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.901892  5927 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.902402  5927 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.837785  5833 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.909194  5833 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.909524  5942 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.840103  5869 raft_consensus.cc:1081] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:37.909926  5942 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.910393  5942 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.912565  6029 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.913076  6029 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.914045  5636 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.914927  6029 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:37.919597  5641 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.834635  5805 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.921867  5965 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:37.922381  5965 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:37.922622  5805 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.923228  5965 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:37.835371  5886 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.924943  5886 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:37.925681  6023 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:37.935933  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.936775  1607 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
W20260709 13:01:37.938747  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80323.7us
I20260709 13:01:37.966532  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.983662  1605 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:37.986256  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:37.985222  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 404869us
I20260709 13:01:37.985800  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:37.988092  1606 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:37.899943  5884 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:37.924242  5965 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.993198  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:37.986013  6055 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:01:37.998101  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.996750  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:37.999843  4933 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:37.985121  6060 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.316s	user 0.004s	sys 0.000s
I20260709 13:01:38.005460  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:37.984432  5940 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.994338  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:56406
I20260709 13:01:38.008551  1534 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.008916  1534 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.909886  5929 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:37.984810  6026 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:01:37.983923  6058 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:01:37.998735  5871 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:37.993263  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.003685  5927 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:37.994849  5881 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:01:38.036371  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.039324  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2117) took 1220 ms. Trace:
I20260709 13:01:38.044402  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.045920  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.039822  1602 rpcz_store.cc:276] 0709 13:01:36.818491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.818638 (+   147us) service_pool.cc:224] Handling call
0709 13:01:36.882553 (+ 63915us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:37.097084 (+214531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.097118 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:37.097993 (+   875us) log.cc:844] Serialized 52 byte log entry
0709 13:01:37.332600 (+234607us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:37.396877 (+ 64277us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.397143 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.397228 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.638201 (+240973us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:37.762039 (+123838us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800395e60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:38.038868 (+276829us) raft_consensus.cc:1685] finished
0709 13:01:38.038892 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.039248 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213736,"prepare.queue_time_us":73431,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":215235,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":3626,"spinlock_wait_cycles":7693568,"thread_start_us":234231,"threads_started":1,"wal-append.queue_time_us":323319}
I20260709 13:01:37.951048  6062 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.056232  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 316311us
I20260709 13:01:38.057407  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.079489  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:38.081749  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.082506  5272 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:38.083069  5272 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.085544  5272 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.086660  5851 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.087096  5851 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:38.087469  5851 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.088132  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.088945  5955 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:38.091388  6071 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.092473  5954 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.092103  6071 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:38.089514  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:38.095757  6071 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:38.096760  6071 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:38.097886  5957 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.099035  1608 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:38.098172  6071 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.101076  6019 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.102262  1529 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:38.103366  6019 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.040308  5871 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.105974  5871 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.108455  5942 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.109426  5641 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.110536  5942 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.112628  6011 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.114876  6011 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.011018  5940 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.118808  5940 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.056675  5927 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:38.043354  5713 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:38.121016  5713 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.032725  6016 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:38.123658  6016 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:38.124862  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.124577  6016 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.080049  6048 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.125810  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.133829  5957 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.134644  5927 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.135888  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:38.137751  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2108) took 1316 ms. Trace:
I20260709 13:01:38.138157  1674 rpcz_store.cc:276] 0709 13:01:36.821026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.821146 (+   120us) service_pool.cc:224] Handling call
0709 13:01:36.822966 (+  1820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.069608 (+246642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.069641 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.070202 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.445893 (+375691us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:37.484757 (+ 38864us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.540522 (+ 55765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.540597 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.137502 (+596905us) raft_consensus.cc:1685] finished
0709 13:01:38.137525 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.137675 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12593,"prepare.queue_time_us":6048,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":116406,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":7029,"thread_start_us":621494,"threads_started":2,"wal-append.queue_time_us":522396}
I20260709 13:01:38.128026  6048 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.146209  5851 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.148528  5886 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.149106  5884 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.149686  6011 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.150571  6026 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:38.150270  6035 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:38.151760  5707 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:01:38.152009  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.152196  5707 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.152565  6035 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:38.154388  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 97067.1us
I20260709 13:01:38.156749  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:38.081032  1534 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.173657  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.138949  5801 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.173026  5957 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.138742  5929 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.177776  1534 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.178438  5851 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.118889  5986 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.180297  1533 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:38.182389  1674 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:38.183634  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.184603  1677 raft_consensus.cc:2410] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:38.185500  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.186208  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.186630  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.187316  1683 raft_consensus.cc:2368] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:38.187726  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.186357  1675 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.188328  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.188761  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.189208  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.189464  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.190016  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:38.190881  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.191450  1683 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:38.193039  1677 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.193464  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:38.193754  5641 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.174872  5636 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.150245  6011 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.190815  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.186932  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.196197  1680 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:38.196249  1676 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:38.189386  1678 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:01:38.187345  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.197510  1607 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:38.175848  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.003s	sys 0.011s
W20260709 13:01:38.200031  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.011s
W20260709 13:01:38.200335  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 584294us
I20260709 13:01:38.200033  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.201741  1605 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.203095  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.204442  1677 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:38.211189  1574 leader_election.cc:400] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:38.212461  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.174669  6019 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.082163  6062 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.270712  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:38.271343  1533 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.217402  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.266366  1574 leader_election.cc:403] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:38.267246  1606 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.267899  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.273643  1602 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.089484  5955 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:38.276979  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65919us
W20260709 13:01:38.267104  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 62692.2us
I20260709 13:01:38.278082  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.278571  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:38.221395  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:38.283393  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62088.7us
I20260709 13:01:38.247159  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.286139  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2227) took 1175 ms. Trace:
I20260709 13:01:38.285039  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.286593  1679 rpcz_store.cc:276] 0709 13:01:37.110361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.142360 (+ 31999us) service_pool.cc:224] Handling call
0709 13:01:37.142654 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.144816 (+  2162us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:37.182790 (+ 37974us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.571486 (+388696us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b180042d360. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:01:37.645596 (+ 74110us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180042d360. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1
0709 13:01:37.669488 (+ 23892us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b180042d360. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:37.689570 (+ 20082us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.690064 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.690196 (+   132us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:37.730210 (+ 40014us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.812801 (+ 82591us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b180042d360. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:01:37.909300 (+ 96499us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b180042d360. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:38.285778 (+376478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.285861 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.285909 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:38.285923 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.286070 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29124,"prepare.queue_time_us":77871,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":3042,"raft.queue_time_us":87229,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":51621,"spinlock_wait_cycles":420393856,"thread_start_us":589456,"threads_started":2,"wal-append.queue_time_us":705118}
I20260709 13:01:38.284252  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:38.189944  5942 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.290650  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:38.291350  1534 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.292068  2260 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:38.194268  5641 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:38.214551  5957 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:38.136057  5996 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.306684  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.352761  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.365916  2258 raft_consensus.cc:2410] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:38.353243  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.366811  2252 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:38.357184  1606 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.266392  5636 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.296800  1677 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:01:38.368485  1677 pending_rounds.cc:85] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 7
I20260709 13:01:38.188251  5805 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.358659  1605 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:38.359313  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.187768  5618 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:38.368870  1677 pending_rounds.cc:107] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:01:38.385589  1677 raft_consensus.cc:2889] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.358044  1534 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:38.375917  1602 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:38.377380  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.387466  2259 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:01:38.389274  1533 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:38.214771  5881 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:38.386118  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.390264  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.292927  6022 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:38.293771  5953 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.394353  2259 raft_consensus.cc:2368] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6.
I20260709 13:01:38.378350  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.401150  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.428155  2256 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:38.401530  6076 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.380617  6058 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:38.402303  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 184982us
I20260709 13:01:38.437923  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.405897  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.438902  1605 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:38.406463  5713 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.408121  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.442986  5713 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.443089  2252 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:38.409590  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.443516  5713 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.410677  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.412034  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.413105  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.445184  1601 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.444708  5641 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.445726  5713 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.446275  5713 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.446740  5713 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.444766  1606 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:38.425745  5881 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.451445  5881 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.449640  1604 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.453486  5955 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.452013  5881 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.415053  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.415535  5940 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:38.225342  5801 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.166s
I20260709 13:01:38.215952  5851 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:01:38.420575  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.350952  6029 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:38.441083  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:38.442022  6058 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.391390  5957 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:38.457371  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.457693  1607 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:01:38.424850  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54778.3us
I20260709 13:01:38.432960  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.290797  6019 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.485625  6058 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.389075  5886 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:38.318327  5942 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.492965  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:38.492564  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.480108  1604 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:38.413830  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.426854  6022 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.495512  6022 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.429591  5636 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:38.481796  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:38.496928  5957 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.481554  5881 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.500597  5821 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:38.501232  5821 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:38.502082  5821 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.502485  5881 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.485316  5940 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.504943  2255 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.480868  5248 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.396359  5979 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:38.426069  5953 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.488019  1603 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.486001  5955 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.428392  6078 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:01:38.495020  6011 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.494402  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.399160  5618 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.495186  1609 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:38.482311  1601 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 6.
I20260709 13:01:38.391330  5805 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:38.491108  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 501256us
I20260709 13:01:38.488817  6029 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:38.527884  2255 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:01:38.509822  5858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.020s	sys 0.016s
W20260709 13:01:38.537880  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 124141us
I20260709 13:01:38.508749  6076 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.584277  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:38.586647  1573 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.586886  4933 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:38.570701  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.023s	sys 0.035s
I20260709 13:01:38.507737  6075 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:38.518301  5929 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.519133  5953 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.590310  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:38.590497  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:38.522938  5884 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.587707  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.023s	sys 0.035s
I20260709 13:01:38.550971  5954 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.602504  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.589586  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2232) took 1065 ms. Trace:
W20260709 13:01:38.590770  1532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.012s	sys 0.011s
W20260709 13:01:38.610112  1532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.012s	sys 0.011s
I20260709 13:01:38.593014  1675 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
W20260709 13:01:38.628981  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.582199  5986 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:38.643085  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.644930  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:38.648469  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47028us
W20260709 13:01:38.589824  5858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.021s	sys 0.016s
I20260709 13:01:38.579227  5955 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:38.608762  1528 rpcz_store.cc:276] 0709 13:01:37.523882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.555380 (+ 31498us) service_pool.cc:224] Handling call
0709 13:01:37.565834 (+ 10454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.566154 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.566182 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.571378 (+  5196us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.042299 (+470921us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:38.587194 (+544895us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.587415 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.589357 (+  1942us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.589397 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:38.589408 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.589526 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13583,"raft.queue_time_us":1168,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":18905,"thread_start_us":819806,"threads_started":2,"wal-append.queue_time_us":596140}
I20260709 13:01:38.520505  5979 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.496984  5636 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:38.653393  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62964.3us
I20260709 13:01:38.656792  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:38.590106  5929 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.654749  4933 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.658881  4933 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.659288  4933 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.640914  5851 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:38.591284  5996 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:38.653461  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.647682  5927 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.674791  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:38.683313  4933 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.685496  4933 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:38.645675  5628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.016s	sys 0.013s
W20260709 13:01:38.666056  6068 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:38.666883  5929 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.640519  5884 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.714159  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.713513  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:38.698872  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 418304us
I20260709 13:01:38.715824  1603 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:38.714862  1600 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:38.718221  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.656436  5942 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.668001  5851 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.708105  6084 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:38.712337  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.727717  4933 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:38.722684  1677 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:38.723585  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.729851  1604 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.725596  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.730669  1600 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:01:38.676545  6062 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.724960  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.737023  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.737371  1608 raft_consensus.cc:2368] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6.
I20260709 13:01:38.737619  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.700950  6050 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:38.725179  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.740164  4933 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.739177  1680 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:38.742666  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.700120  6087 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:38.700042  5713 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.713794  5881 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.745452  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.769340  1602 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.706791  5940 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.769994  1604 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:01:38.701195  5628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.017s	sys 0.014s
I20260709 13:01:38.726317  5851 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.740525  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.722972  6019 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.772719  6050 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:38.773643  5805 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.740873  6088 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:01:38.774360  5942 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.776357  6077 raft_consensus.cc:993] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:38.779263  4933 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.745934  6087 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.809144  6090 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:01:38.812767  6083 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:38.818336  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.702538  6029 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.820519  1679 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:38.821242  5979 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.771148  6011 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.745129  5955 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.823504  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.845316  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.845898  1680 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:38.824779  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.825199  6016 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.805253  6019 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.772794  5618 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.826707  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.850701  1676 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:38.827463  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.827212  6050 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.827705  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.829234  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.829865  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.861848  2259 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.836964  6087 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.831094  6077 raft_consensus.cc:1081] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:38.829644  5881 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:38.865272  5881 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:38.866072  5881 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.867333  5881 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.833287  1602 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:38.834383  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:38.839668  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:38.841478  1677 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:38.847851  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.878042  1679 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:38.832865  5942 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.859190  6019 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.884682  2259 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:38.885958  2252 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:38.893640  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.896575  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:38.897624  1681 raft_consensus.cc:606] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:38.904503  6088 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.905189  6088 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.907843  6088 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.909888  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.910524  1679 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:38.911432  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.843679  6011 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.912832  1683 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:01:38.920910  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 426545us
I20260709 13:01:38.921731  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.927265  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:38.884259  6075 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:38.889122  6051 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.887641  5884 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.932665  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.937005  1608 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:38.909452  5833 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.946964  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.947829  1609 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:38.951555  6019 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.892235  5968 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:38.956562  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.894479  6077 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.957553  6077 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.959139  6011 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.960673  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:38.962642  1679 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:38.964429  6077 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.957568  6071 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:38.965430  6071 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.965739  6071 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.967070  5248 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.930864  6062 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:38.968398  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.968462  1677 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:38.938066  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.935617  5641 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:38.940933  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:38.941534  5942 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.942415  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:38.969698  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:38.971184  1608 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:38.937443  5927 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:01:38.945536  6048 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:38.916674  5984 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:01:38.920639  5618 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.980168  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.975466  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:38.974015  6079 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:39.001641  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:39.004766  5942 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.005627  5942 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.981285  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 773) took 1039 ms. Trace:
I20260709 13:01:39.006938  1530 rpcz_store.cc:276] 0709 13:01:37.942002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.942139 (+   137us) service_pool.cc:224] Handling call
0709 13:01:37.987349 (+ 45210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.988506 (+  1157us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:38.490458 (+501952us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.980846 (+490388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.980928 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:38.980980 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.981067 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.981214 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":602078,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":6086,"raft.queue_time_us":97,"thread_start_us":979528,"threads_started":2}
I20260709 13:01:39.009085   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:38.918005  6058 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.017480  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:38.978049  5248 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:39.028779  6096 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:01:38.977407  6048 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:39.030104  6048 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.999043  5618 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:38.964772  5851 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.034937  6058 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:39.035773  2260 raft_consensus.cc:2368] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:01:39.034929  5618 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:38.967319  5929 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:38.976660  6051 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.042399  6051 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.983279  6022 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.045603  1676 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:01:39.053740  5851 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.059446  5929 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:38.981009  6062 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.065253  6062 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.072522  6075 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.038288  5833 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.974478  6087 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.079332  6087 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.079543  6022 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:38.976389  5949 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:01:39.084349  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111368us
W20260709 13:01:39.086140  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 436978us
I20260709 13:01:39.097177  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.098095  6022 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.098888  6022 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:39.099350  6022 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.085052   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:39.027362  5248 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.976377  5641 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:39.109108  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 404484us
I20260709 13:01:39.110706  1498 leader_election.cc:400] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6.
I20260709 13:01:39.111110  1498 leader_election.cc:403] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:39.117344  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.118355  1531 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:01:39.122781  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.123648  1531 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:39.125188  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.126116  1531 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:39.139314  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.108589  5248 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:39.148203  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 493011us
I20260709 13:01:39.113777  6016 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6.
I20260709 13:01:39.155593  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.159508  1531 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.094408  5953 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.173636  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.174957  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.175179  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.175763  1532 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:39.180680  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.147637  5965 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.151677  6011 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:39.149075  6019 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:39.183130  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 97130.9us
I20260709 13:01:39.192058  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:39.184154  1532 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:39.187284  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.193369  1530 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:39.193912  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.189911  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.194825  1529 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:39.193043  1532 pending_rounds.cc:85] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 10
I20260709 13:01:39.195505  1532 pending_rounds.cc:107] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:39.195822  1532 raft_consensus.cc:2889] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:39.197860  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 301) took 38074 ms (client timeout 15000 ms). Trace:
W20260709 13:01:39.170805  6078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.013s
I20260709 13:01:39.162741  6023 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:39.204041  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.222658  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.223558  1606 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:39.226641  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.223156  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.228550  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.228210  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.232394  1679 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.228621  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.234402  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
W20260709 13:01:39.198604  1430 rpcz_store.cc:269] 0709 13:01:01.116772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.116974 (+   202us) service_pool.cc:224] Handling call
0709 13:01:39.190596 (+38073622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:34.205234 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:34.524296 (+319062us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:34.532846 (+  8550us) write_op.cc:435] Acquired schema lock
0709 13:01:34.536004 (+  3158us) tablet.cc:662] Decoding operations
0709 13:01:34.791161 (+255157us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:34.791274 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:34.791314 (+    40us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:34.792449 (+  1135us) tablet.cc:701] Row locks acquired
0709 13:01:34.792492 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:01:34.792673 (+   181us) write_op.cc:270] Start()
0709 13:01:34.792834 (+   161us) write_op.cc:276] Timestamp: P: 1783602094792602 usec, L: 0
0709 13:01:34.792868 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:01:34.793646 (+   778us) log.cc:844] Serialized 4752 byte log entry
0709 13:01:35.206033 (+412387us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b
0709 13:01:35.921125 (+715092us) op_driver.cc:464] REPLICATION: finished
0709 13:01:36.372219 (+451094us) write_op.cc:301] APPLY: starting
0709 13:01:36.384223 (+ 12004us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:37.056362 (+672139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:37.056422 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:37.574665 (+518243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:37.608741 (+ 34076us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:01:37.608817 (+    76us) write_op.cc:312] APPLY: finished
0709 13:01:37.609185 (+   368us) log.cc:844] Serialized 113 byte log entry
0709 13:01:37.912562 (+303377us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800416260. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a
0709 13:01:37.912751 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.912878 (+   127us) write_op.cc:454] Released schema lock
0709 13:01:37.912941 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:37.913352 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.913378 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2293401,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":398965,"apply.run_cpu_time_us":36931,"apply.run_wall_time_us":1568779,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54407,"num_ops":12,"prepare.queue_time_us":135802,"prepare.run_cpu_time_us":18937,"prepare.run_wall_time_us":1348371,"raft.queue_time_us":359094,"raft.run_cpu_time_us":15857,"raft.run_wall_time_us":429404,"replication_time_us":1083149,"spinlock_wait_cycles":219564544,"thread_start_us":1461402,"threads_started":5,"wal-append.queue_time_us":895609,"wal-append.run_cpu_time_us":47218,"wal-append.run_wall_time_us":2463191}]]}
I20260709 13:01:39.201144  2253 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:39.237123  1531 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:39.224617  6078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.014s
I20260709 13:01:39.196099  6088 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:39.242901  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.243557  1676 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:39.245752  1683 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:39.248077  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.248862  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.249521  1608 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.249719  2260 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:39.251597  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.249886  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.254004  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.226168  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.191045  6016 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.255858  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.256378  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:39.225473  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 331909us
I20260709 13:01:39.248845  1683 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:39.268667  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.269637  1534 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:39.258351  6115 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.270879  1530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:01:39.271575  1530 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.271948  1530 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.225013  5713 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.220537  6011 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:39.276715  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.277001  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.279832  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:39.228648  5858 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:39.282248  2258 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.280556  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.291425  1679 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:39.269454  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.282871  1677 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.284963  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.285151  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.297108  1533 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.306167  1533 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:39.233953  6107 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.191190  5965 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.323446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:39.317210  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47840.9us
I20260709 13:01:39.324738  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.324851  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:39.325456  1528 raft_consensus.cc:2376] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12. Re-sending same reply.
I20260709 13:01:39.259840  6058 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.323383  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.202566  6019 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.230041  6048 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.225266  6071 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.331947  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.228302  6023 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.275728  6115 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.332216  1531 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:39.286641  6112 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:39.317000  1676 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:39.357359  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.358946  1531 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:39.286063  5628 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:39.355629  1677 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:39.360821  1530 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.362440  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:39.336930  6066 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:39.364656  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.348948  6115 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:39.411799  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47224.4us
I20260709 13:01:39.415484  1528 raft_consensus.cc:2368] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:39.418987  1602 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:39.424091  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 142192us
I20260709 13:01:39.349113  6107 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.431605  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.432808  1533 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
W20260709 13:01:39.424264  6113 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:01:39.433931  6102 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:01:39.430382  5955 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.434995  5955 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:39.435262  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.435002  1528 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:39.436030  1531 raft_consensus.cc:2368] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:39.439628  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.441012  1534 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:01:39.442224  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.445312  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.446566  1528 raft_consensus.cc:2410] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:39.448495  1531 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:39.449061  6123 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:01:39.450218  6118 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:39.452584  6023 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.337466  5858 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:01:39.455717  5965 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.456472  5953 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.457736  5955 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.458427  6022 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.460510  1606 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:39.461591  6122 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:39.337006  6058 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.463828  6058 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.421888  6087 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:39.410597  6111 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.464936  6111 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.467120  6111 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.410600  5940 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:01:39.470060  6019 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.470582  6011 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.472222  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.478121  2258 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:39.482191  1602 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:39.418699  5979 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.494746  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:39.421238  6128 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.501031  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.357236  6112 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:39.486333  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 161566us
I20260709 13:01:39.511001  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.486974  5979 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.489053  6114 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.430277  5641 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.520517  1531 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:39.524333  6127 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:39.526968  6117 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:39.500927  6087 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:39.538556  6022 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.542778  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.546862  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.487481  5636 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:01:39.543747  6124 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:01:39.496805  6062 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:39.520958  5979 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.556134  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:39.560160  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 133604us
I20260709 13:01:39.561446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.561633  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.562058  1531 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.563589  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.564225  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:39.565351  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.565950  1532 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.567381  1608 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:01:39.567741  1608 pending_rounds.cc:85] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 6
I20260709 13:01:39.567956  1608 pending_rounds.cc:107] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:01:39.568168  1608 raft_consensus.cc:2889] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.570389  1531 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:39.544576  6114 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.573437  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.574935  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.576709  1609 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:39.574520  6127 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.571465  5636 consensus_queue.cc:1243] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:39.581624  1532 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:39.587577  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.587860  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.588537  1602 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:39.589363  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.589664  6071 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.590461  1604 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:39.549209  6107 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.601367  6048 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.588989  5636 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:39.606439  6087 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.607540  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.608731  6019 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.609257  6019 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:39.610397  6114 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.610070  6019 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.589002  6082 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:39.618221  1675 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:39.618583  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.618942  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.619524  1676 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:39.620481  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:39.614440  5248 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.553637  6058 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:39.627208  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.629099  1604 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:39.631727  1676 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.629810  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.632786  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.634727  5833 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:39.635215  5833 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.635614  5833 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.636408  1530 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.640614  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.641280  1680 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:39.641595  1680 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.611951  5955 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.643275  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.644671  5955 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.645615  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.645435  5833 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.646255  1674 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:39.647069  1679 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:39.647519  5833 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.648176  5833 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:39.648550  5833 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.616194  6082 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:39.658212  6082 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:39.659061  2253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1063) took 1300 ms (client timeout 1631 ms). Trace:
I20260709 13:01:39.659703  6082 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.651232  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:39.659503  2253 rpcz_store.cc:269] 0709 13:01:38.358914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.359049 (+   135us) service_pool.cc:224] Handling call
0709 13:01:39.658798 (+1299749us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400475c54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:39.658971 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867908480}
I20260709 13:01:39.624398  6029 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:39.661695  6078 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.663331  6078 raft_consensus.cc:993] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:39.663793  6078 raft_consensus.cc:1081] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:01:39.665858  6076 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:39.635978  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.652207  6109 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.623353  6071 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:01:39.667299  1609 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:39.669018  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47015.4us
I20260709 13:01:39.678983  5248 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:39.679422  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:39.448531  1425 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 8 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 11 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.681300  1425 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 7, term changed from 5 to 8, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:39.685874  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:39.615710  5954 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.675948  1525 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:39.677122  1676 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:39.690212  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.690846  1604 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.692787  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.693478  4933 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.694003  4933 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.666429  6076 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.695077  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.699894  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.701012  6075 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.700793  5954 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.701763  6075 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:39.670666  5833 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:39.688825  6132 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:01:39.717083  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.718200  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.718622  1604 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:39.720923  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:39.725301  4933 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.727138  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.728149  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.727098  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:39.729435  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50077.1us
I20260709 13:01:39.738220  1500 leader_election.cc:400] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 5 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 5. Current term is 6.
I20260709 13:01:39.738159  5713 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.738132  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:39.739296  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.705322  6094 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.746933  4933 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.744091  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:39.715852  6050 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.714227  5851 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:39.716491  6114 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:39.751547  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.753293  1602 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:39.706149  6011 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.744000  6022 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:39.740074  6111 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:39.736233  5929 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:39.736662  5881 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.758705  1604 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.740711  5858 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:39.732806  5636 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.715194  6016 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:01:39.760852  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.764900  6078 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:39.770543  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.631s (SENT) [suppressed 39 similar messages]
I20260709 13:01:39.745457  6071 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.748904  6050 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.753715  5851 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:39.822074  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.826804  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.779445  5881 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.754662  6094 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.772166  6022 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:39.789306  6111 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:39.816287  6050 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.792127  5858 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.835395  5248 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.816727  6075 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.761981  6114 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:39.837280  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 93252.2us
I20260709 13:01:39.842173  1573 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:39.832214  5881 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.827898  6116 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.835670  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.780660  6011 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.850445  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:39.843698  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.866505  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:39.876166  1607 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:39.684206  1425 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 9 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 11 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.835078  5636 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:39.893021  6127 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.889695  6048 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:39.862473  5851 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:39.892822  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 336757us
I20260709 13:01:39.898269  6048 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.887789  5821 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.899446  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:39.891280  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:39.901701  6114 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.902657  6011 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.768510  6076 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.906272  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:39.914366  1603 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:39.851625  5858 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.837149  6022 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.821722  6071 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.923431  1498 leader_election.cc:400] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:01:39.923792  1498 leader_election.cc:403] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:39.924507  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.925089  1525 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.928408  6078 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.929636  6078 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:39.933480  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 162956us
I20260709 13:01:39.942608  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.863801  5984 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:39.946054  2253 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:39.958303  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.958777  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.959012  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:39.957710  1530 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:39.958139  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.962080  2258 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:39.961997  2259 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:39.962944  2261 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:01:39.965394  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:39.947418  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:39.960763  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.967680  1527 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.897312  5801 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.970806  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.980391  2259 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:39.981299  2260 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:39.900813  6138 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.943140  6152 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:39.984985  1604 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:39.986065  1674 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:39.985030  6152 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:39.989199  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:39.990579  6152 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:39.990784  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.921317  6058 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:39.992504  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.995453  5641 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:39.995911  5641 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:39.996424  1525 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:39.996850  5641 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:39.921465  6048 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:39.999579  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:39.958454  5984 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:39.962607  6107 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.002511  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:39.894742  6029 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:01:39.968716  6076 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.004889  1532 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
W20260709 13:01:40.005311  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 189086us
I20260709 13:01:39.963730  6137 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:40.026226  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.029742  2259 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:39.968626  6154 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:39.881799  6115 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.044376  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:40.038916  6050 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.045156  2259 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.047184  5986 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:40.047611  5986 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:40.048501  5986 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.049785  5986 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.052434  2259 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:40.052704  6112 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.057552  1680 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.058611  1680 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.067209  5713 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.070911  6085 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.072454  5927 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.073127  6087 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:01:40.072986  5927 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:40.074811  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 248080us
W20260709 13:01:40.075901  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 152614us
I20260709 13:01:40.075989  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.077220  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.077729  6088 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.078397  6088 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.078702  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.079577  6114 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.079767  6016 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:40.079907  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.080354  6016 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.080852  6114 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:40.081343  6114 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:40.077277  6111 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.082401  6114 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.081648  5927 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.083084  6111 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.085729  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:40.086356  1530 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.090682  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.091920  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:40.093055  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:01:40.093104  1530 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:40.095500  1531 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.083616  6016 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.095886  1531 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.878759  6116 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.099756  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.046597  6050 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.107076  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:40.169965  6116 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.112790  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.170769  1532 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:40.172103  1532 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:40.113741  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.174328  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:40.175544  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.095933  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:40.115670  1527 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:40.117048  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.117158  6109 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.118861  6094 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.181074  1682 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
W20260709 13:01:40.117098  6158 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:40.121354  1680 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:40.122596  1534 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:40.186539  1677 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:01:40.124914  6141 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:01:40.139802  5979 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.000s
I20260709 13:01:40.146663  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.147729  6071 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.151736  1533 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.153084  6115 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.029002  6107 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.001570  5954 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:40.154686  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 130348us
I20260709 13:01:40.155346  6157 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:40.156524  5248 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.028776  6058 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:39.924660  5636 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.166229  5984 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.167874  5821 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.232574  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:40.233935  2258 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:40.234565  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.237950  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:40.238548  1532 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.238955  1603 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:40.241274  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:40.214421  6146 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:01:40.242609  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.223321  6142 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
W20260709 13:01:40.198570  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 468090us
W20260709 13:01:40.212081  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.903379  1425 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 4 to 8, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.155261  6156 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:01:40.224267  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.254352  2259 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:40.164367  6154 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.226449  5248 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.227861  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.256140  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.196033  1531 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.231905  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.199352  6020 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:40.249069  1677 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:40.250103  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.251277  1532 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:40.252491  1527 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.197707  1683 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:40.259244  2260 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:40.252831  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:40.266393  1683 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:40.268208  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.264770  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:40.271600  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:40.304005  1527 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:40.213757  5979 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.309388  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.308708  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:40.233055  5801 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:40.100088  6137 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.313730   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.316365  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.326429  2260 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:40.327322  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.319067  6094 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.330114  6094 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.330189  5713 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:40.322245  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:40.331079  5833 consensus_meta.cc:287] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:01:40.305650  5984 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.339531  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.345093  1528 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.345013  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.301534  5955 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.304632  5927 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.254493  6071 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:01:40.349387  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.349915  5248 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.353312  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:40.350060  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.251036  5821 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:40.335088  6082 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.003s
I20260709 13:01:40.354223  4933 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:40.355803  4933 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.337009  6094 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.362520  2253 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:01:40.271185  6162 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:01:40.362914  2253 pending_rounds.cc:85] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 11
I20260709 13:01:40.363565  2253 pending_rounds.cc:107] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:40.363822  2253 raft_consensus.cc:2889] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.346581  6115 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.371590  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.331065  5801 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.347821  5954 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.308980  6020 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.382076  6153 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:01:40.407068  5979 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.407408  6153 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:40.407864  6153 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:40.408888  6153 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.410301  6153 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.347440  6058 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.356040  6016 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.361236  6019 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.380692  2259 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:40.381135  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:40.386173  1608 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:40.423552  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.382372  6127 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.358675  6087 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:40.348505  5955 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.382607  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.383626  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.384071  4933 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.418601  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.384680  1605 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:40.416895  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.403142  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.433725  1534 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.436164  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:40.393193  6151 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:40.378453  6115 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.383204  6155 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.438805  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.344579  5833 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.453891  1601 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:40.455017  1603 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:40.458597  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:40.417421  5707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.012s
I20260709 13:01:40.453109  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.465409  1607 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:40.465683  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2178) took 1027 ms. Trace:
I20260709 13:01:40.393862  6107 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.396708  5641 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.472402  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.433956  6019 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.382879  5954 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:40.474773  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.475679  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.394928  6116 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:40.392028  6082 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.526942  1600 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:40.405900  6022 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.394383  6020 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.477595  6085 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:40.468753  6115 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.481208  6140 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:40.398320  6169 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:40.484666  5636 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:40.486858  5858 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 13:01:40.487993  6154 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.454437  6087 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.439038  5979 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:01:40.475121  5821 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.404685  6137 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.497918  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.434479  6127 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.501080  1533 rpcz_store.cc:276] 0709 13:01:39.437809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.450001 (+ 12192us) service_pool.cc:224] Handling call
0709 13:01:39.450384 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.206751 (+756367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.465456 (+258705us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540043c954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:40.465627 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612393344}
I20260709 13:01:40.461158  5955 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.520044  2261 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:40.523207  1674 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:40.525665  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.519064  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46773.2us
W20260709 13:01:40.502357  5707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.013s
I20260709 13:01:40.401551  5881 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:40.528582  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53003.9us
I20260709 13:01:40.460911  5968 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:01:40.533030  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 261493us
I20260709 13:01:40.504985  6155 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:40.527709  5954 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.527985  6019 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.544580  1604 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:40.531337  6016 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.578493  6127 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.540839  6169 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:40.503587  6114 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:40.528687  5984 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.580750  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.582305  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.530157  6116 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.585988  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.560715  6087 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.556926  6140 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:40.592094  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.595723  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.596426  1609 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:40.606585  4933 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.577442  1608 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.603884  1530 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:40.602403  1606 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:01:40.609139  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.609813  1525 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:40.610816  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.612221  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.610662  1533 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:40.613406  1533 pending_rounds.cc:85] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 3
I20260709 13:01:40.613682  1533 pending_rounds.cc:107] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:40.613950  1533 raft_consensus.cc:2889] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.401968  1425 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 8 to 10, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:40.611167  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.557577  5858 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.635136  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.635941  1528 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:40.599929  6128 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.641168  1608 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:40.642745  1608 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:40.644418  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.645325  4933 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.645918  4933 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.612532  6094 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:40.672637  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 212519us
W20260709 13:01:40.675179  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82441.1us
I20260709 13:01:40.676383  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:40.663962  6174 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:01:40.660414  5979 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.675652  5833 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.682457  4933 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.680812  6022 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.662133  6016 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:40.686522  5979 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:40.690811  6177 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:01:40.691833  5858 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.693895  5979 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.659855  6155 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.697932  6116 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:40.699719  5881 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:40.705696  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 473136us
I20260709 13:01:40.683498  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:40.687731  6094 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:40.708055  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 464721us
I20260709 13:01:40.674917  6169 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:40.712708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 404065us
I20260709 13:01:40.713757  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:40.715862  6161 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:40.686838  6020 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:40.691947  6176 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:40.729807  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.731133  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.731664  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:40.732338  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.718390  1574 leader_election.cc:400] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:40.719233  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.720424  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.724977  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.738579  1574 leader_election.cc:403] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.730506  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:40.739696  2252 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:40.741127  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 94791.6us
I20260709 13:01:40.745041  6020 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:40.745276  6154 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:40.746541  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.747164  1602 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:40.748082  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.748090  1574 leader_election.cc:400] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10.
I20260709 13:01:40.730010  6185 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:40.763451  2252 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:01:40.765740  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.773337  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.728700  5929 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.773945  1602 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.776901  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:40.741941  6162 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:40.782735  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74262.8us
I20260709 13:01:40.781740  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.685432  6140 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.753894  5858 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.740036  6094 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:01:40.746060  6020 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:40.789199  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64309.2us
I20260709 13:01:40.742913  6152 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:40.777400  5801 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.810361  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.812041  1531 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:40.801542  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:40.771935  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 56920.8us
I20260709 13:01:40.877465  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.801337  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:40.884809  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83322.2us
I20260709 13:01:40.886132  1602 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:01:40.887216  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:40.889336  6182 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:01:40.889986  1680 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:40.891204  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:40.891474  1675 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:40.891913  6162 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:40.892911  6162 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.894619  1679 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.895694  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.897009  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.898180  5833 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:40.898713  5833 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.900635  1683 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:40.788614  6185 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:40.903757  6185 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.887629  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.905398  6078 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.905915  6078 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:40.906757  6078 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:40.775991  6154 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:01:40.775655  5636 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:01:40.789690  6161 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:40.696638  1425 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.797465  6157 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.907600  1601 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:40.914456  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:40.927183  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:40.887985  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2252) took 1661 ms. Trace:
I20260709 13:01:40.794672  6022 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:40.919708  1500 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:40.903749  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 102476us
I20260709 13:01:40.909523  1606 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:40.939813  5833 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:40.912442  6170 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:40.904448  6193 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.931139  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:40.927942  1678 rpcz_store.cc:276] 0709 13:01:39.226996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.227119 (+   123us) service_pool.cc:224] Handling call
0709 13:01:39.241456 (+ 14337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.258569 (+ 17113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.258599 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.259048 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.657066 (+398018us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18003d00c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:01:39.844521 (+187455us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:40.333131 (+488610us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.875634 (+542503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.875718 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.875772 (+    54us) raft_consensus.cc:1685] finished
0709 13:01:40.887780 (+ 12008us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.887930 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":510574,"prepare.queue_time_us":115153,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":474596,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":38071,"spinlock_wait_cycles":16127232,"thread_start_us":662599,"threads_started":3,"wal-append.queue_time_us":619443}
I20260709 13:01:40.934733  6115 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.935436  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:40.952922  6179 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.157s	user 0.005s	sys 0.004s
I20260709 13:01:40.970724  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.906629  5949 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:40.819007  6076 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:01:40.972391  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:40.973471  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:40.983573  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.928443  6189 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:40.934803  6029 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:40.944281  6154 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:40.910050  5955 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:40.950026  6016 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:40.997059  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.994737  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.995781  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:40.985155  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:40.995260  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:40.995025  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:41.029244  1527 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:41.033761  5984 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:41.035061  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49982us
I20260709 13:01:41.042106  1529 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:41.045456  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.047098  1606 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:41.048523  1526 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:41.051808  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:40.962867  5833 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:01:41.054076  5248 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:40.990549  6137 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:01:41.057768  5955 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.060480  5248 consensus_queue.cc:1243] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:40.942090  6161 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.050335  6016 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:40.991485  6127 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.047410  5713 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:01:41.100988  5954 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.006s
I20260709 13:01:41.064472  6058 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.064284  5968 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.062695  6195 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:41.100750  6196 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:01:41.117403  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 181468us
I20260709 13:01:41.065112  5641 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:01:40.989176  6116 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.129590  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:41.141842  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 633) took 1206 ms. Trace:
I20260709 13:01:41.142061  1528 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:41.145249  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.094076  6194 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:41.142320  1676 rpcz_store.cc:276] 0709 13:01:39.935639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.935784 (+   145us) service_pool.cc:224] Handling call
0709 13:01:39.936141 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.257927 (+321786us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:40.317682 (+ 59755us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.772862 (+455180us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.776006 (+  3144us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.776177 (+   171us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:40.776426 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.900679 (+124253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.900761 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.141447 (+240686us) raft_consensus.cc:1685] finished
0709 13:01:41.141471 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.141770 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":300911,"prepare.queue_time_us":78716,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":76,"raft.queue_time_us":353194,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":20432640,"thread_start_us":566758,"threads_started":2,"wal-append.queue_time_us":328579}
I20260709 13:01:41.154381  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.126092  5927 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:41.126695  6029 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:41.161194  5927 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.128368  5954 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:41.176947  6198 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:41.179059  5927 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.179605  5927 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:41.179488  6111 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:41.181496  5833 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:41.182068  5833 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.185161  5833 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.186771  5954 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.187888  5927 consensus_queue.cc:1243] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:41.188396  6111 consensus_queue.cc:1243] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:41.189239  6111 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:41.195829  6197 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:41.198524  6127 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.181931  6029 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.201133  1425 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 4 to 11, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 11 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.205876  6202 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:41.206605  6202 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:41.142633  6116 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:41.215179  6087 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.005s
I20260709 13:01:41.211874  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:41.136860  6154 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:41.212016  1531 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:41.206970  6202 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:41.219218  6048 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:41.219039  6202 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.220551  6202 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.131332  6058 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.281212  5968 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:41.306341  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 266595us
I20260709 13:01:41.206401  6016 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.320597  6048 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.335147  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 808) took 1013 ms. Trace:
I20260709 13:01:41.337854  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2191) took 1243 ms. Trace:
I20260709 13:01:41.225592  6116 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.360033  1530 rpcz_store.cc:276] 0709 13:01:40.093963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.095713 (+  1750us) service_pool.cc:224] Handling call
0709 13:01:41.337597 (+1241884us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540008e3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:41.337783 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980041472}
I20260709 13:01:41.224481  6153 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:41.359249  2261 rpcz_store.cc:276] 0709 13:01:40.321367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.326973 (+  5606us) service_pool.cc:224] Handling call
0709 13:01:41.334916 (+1007943us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540040bfd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:41.335073 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441273088}
I20260709 13:01:41.369704  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:41.380244  1607 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:41.203833  1425 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 4 to 10, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 10 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.223098  6087 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.383427  1525 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:41.383893  5986 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:41.384279  5986 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:41.384472  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.385073  1608 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.370429  6048 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.388377  6048 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:41.382570  6200 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:01:41.391485  5641 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:41.391913  6164 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.392498  5986 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:41.393368  6207 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:01:41.393116  6164 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.395287  6164 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.395852  6167 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:41.396263  6167 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:41.397258  6167 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.398307  6167 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.399998  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:41.400269  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.400758  1530 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:41.401705  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.400935  1680 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:41.406446  6019 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.004s
I20260709 13:01:41.406935  6019 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.407627  6058 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.408167  1533 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:41.408332  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 643) took 1408 ms. Trace:
I20260709 13:01:41.408758  1682 rpcz_store.cc:276] 0709 13:01:40.000379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.181897 (+181518us) service_pool.cc:224] Handling call
0709 13:01:40.182301 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.711921 (+529620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.711951 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.724356 (+ 12405us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.926863 (+202507us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:40.926923 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.407873 (+480950us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b540024b8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:41.407926 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.407974 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:41.407988 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.408208 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494622,"raft.queue_time_us":460651,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":22248,"spinlock_wait_cycles":172101504,"thread_start_us":201804,"threads_started":1,"wal-append.queue_time_us":303034}
I20260709 13:01:41.411432  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 639) took 1434 ms. Trace:
I20260709 13:01:41.368657  6153 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:41.411829  1674 rpcz_store.cc:276] 0709 13:01:39.977473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.992266 (+ 14793us) service_pool.cc:224] Handling call
0709 13:01:41.411235 (+1418969us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000ec4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:41.411374 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214344448}
W20260709 13:01:41.414407  6199 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 13:01:41.415149  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:41.417759  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.418385  1683 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:41.418815  1683 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:41.382618  1425 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 2 to 6, term changed from 7 to 10, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:41.419622  1683 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.421283  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:41.422235  1608 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:41.423588  1607 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:41.426648  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.427289  1679 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.424440  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.428365  1676 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.430558  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.431186  1681 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.413349  6153 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.437620  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.438287  1607 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.435608  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:41.360972  5968 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.445588  5929 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.446152  5929 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.338838  6127 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:41.405799  5851 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.442318  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.455284  1677 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:01:41.453737  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.457248  1607 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:41.479663  1679 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:01:41.482709  1676 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:41.453998  6115 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.485718  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:41.497349  5929 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.392009  5641 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.533380  1499 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:41.535543  4933 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.456475  6127 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.495602  6153 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.484727  1681 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:41.438033  5858 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:41.457135  5927 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:41.439975  6050 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:41.520059  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 365735us
I20260709 13:01:41.521239  1534 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:41.549072  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:41.420467  1425 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 6 to 9, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 9 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:41.559257  1676 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:41.563956  6022 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.573273  4933 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.569464  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.573721  4933 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:41.570281  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.574532  4933 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.594861  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:41.596071  6161 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:41.572778  5833 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:01:41.569471  6050 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.567494  6112 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.512912  6154 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.615527  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.616036  1676 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:41.601468  5801 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.619433  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:41.605317  6144 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:41.625592  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.627657  1676 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.637048  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.593236  6022 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.615051  6050 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:41.628324  6170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.006s	sys 0.006s
I20260709 13:01:41.619581  6128 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:41.616829  6112 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:41.645563  6170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.007s	sys 0.006s
I20260709 13:01:41.650065  5833 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:41.651062  6213 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:41.651083  6112 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.656118  6127 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:41.659407  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.661523  6170 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.662055  6170 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.663374  5986 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.666395  5986 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.691829  6050 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:41.693823  6192 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.793s	user 0.001s	sys 0.002s
I20260709 13:01:41.695469  6050 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.697988  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:41.698930  1609 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:41.700078  1606 pending_rounds.cc:85] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 6
I20260709 13:01:41.700516  1606 pending_rounds.cc:107] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:01:41.700759  1606 raft_consensus.cc:2889] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.703164  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.703969  1681 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.707072  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:41.708011  1679 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:41.710563  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:41.673774  1676 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:41.673969  5801 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:41.673756  6191 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.675864  6152 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:41.678273  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:41.679876  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:41.682376  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:41.718772  2261 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.683585  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2155) took 1297 ms. Trace:
I20260709 13:01:41.719234  1604 rpcz_store.cc:276] 0709 13:01:40.386477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.386592 (+   115us) service_pool.cc:224] Handling call
0709 13:01:40.386866 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.594995 (+208129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.683332 (+1088337us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003c4e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:41.683520 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362243456}
I20260709 13:01:41.721630  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:41.664610  6170 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.715952  1600 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:41.726707  1604 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:41.687171  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:41.725096  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:41.724675  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:41.620155  5968 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.756699  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:41.764225  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 77126.4us
I20260709 13:01:41.763957  6206 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:41.775532  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:41.777582  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:41.778494  1681 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:41.718365  6094 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:41.756124  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 386413us
I20260709 13:01:41.649348  6087 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.793810  2259 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:41.789899  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:41.791795  2261 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:41.792716  2258 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:41.765151  6206 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.639990  6144 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.805905  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:41.765504  6112 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:41.752925  5986 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:41.817855  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:41.787634  6193 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:41.753859  6152 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.715492  6128 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.822268  6194 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.842206  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:41.811185  6206 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.787386  6050 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:41.830121  6193 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.847652  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.830330  6155 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.752370  6191 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.897588  6191 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:41.898234  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.899040  6022 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.899891  5641 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:41.902611  6116 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.004s
I20260709 13:01:41.903178  6116 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.844228  6170 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.904923  6170 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:41.907089  6170 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.908728  1609 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.860831  6050 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:41.880213  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:41.862464  6128 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.862911  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.918135  1604 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:41.824986  6112 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:41.865566  6152 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.838507  6231 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.867030  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:41.991040  1608 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:41.878849  6169 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.882189  5927 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:41.892292  1683 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.894709  6144 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:41.826421  6210 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:01:41.912079  6050 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:41.913113  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:41.840205  6019 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:41.852963  6194 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.863627  5968 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:41.908437  6193 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.648063  1425 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:41.995749  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75884.4us
I20260709 13:01:42.046586  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:42.017306  1602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.038s	sys 0.042s
W20260709 13:01:42.047181  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.038s	sys 0.042s
I20260709 13:01:42.025048  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:42.048200  1604 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:42.030402  1683 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:42.041507  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
W20260709 13:01:41.988734  6167 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 13:01:42.049145  1680 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:42.044051  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:42.048038  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:42.043365  1675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.046s	sys 0.071s
W20260709 13:01:42.051252  1675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.047s	sys 0.071s
I20260709 13:01:42.052232  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:42.001850  6116 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:41.994854  6029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.004s	sys 0.019s
I20260709 13:01:42.012213  1609 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:42.058158  1676 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:42.055869  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:42.019999  5927 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.061507  4933 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:42.043632  6194 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.017140  6155 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:42.048570  5858 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:42.091588  1526 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:42.065965  6029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.004s	sys 0.020s
I20260709 13:01:42.060582  5713 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.062359  6195 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:01:42.053215  6217 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:42.004065  6231 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.133950  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:42.198781  1608 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:42.049235  5801 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:01:42.193614  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 382206us
I20260709 13:01:42.202800  1526 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:42.203596  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.204383  1532 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:42.205145  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:42.204170  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:42.205655  1532 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.205762  1528 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:42.206883  1528 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:42.208005  1528 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:42.208410  1533 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:01:42.208803  1533 pending_rounds.cc:85] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 6
I20260709 13:01:42.209033  1533 pending_rounds.cc:107] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:01:42.209059  1500 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:42.209364  1533 raft_consensus.cc:2889] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.210049  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.212266  6087 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.212782  1532 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:42.213251  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:42.213868  1531 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.208606  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:42.217232  1534 raft_consensus.cc:2368] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
I20260709 13:01:42.220127  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:42.222294  1526 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:42.237607  6112 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.201251  6191 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:42.242269  6191 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:42.243384  6191 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.109418  6116 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:42.246452  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.247217  1527 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:42.191453  6058 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.228214  6140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.019s	sys 0.023s
I20260709 13:01:42.261463  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.268252  1531 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:42.272145  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:42.262388  6140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.019s	sys 0.023s
I20260709 13:01:42.252924  5954 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:42.263161  6191 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.195748  5713 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:42.280997  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.026s
I20260709 13:01:42.271135  6189 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:42.284899  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.008s	sys 0.026s
I20260709 13:01:42.284996  6189 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.273713  6155 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.289953  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.257701  6116 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.257380  6058 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:42.298956  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.039s	sys 0.077s
I20260709 13:01:42.302464  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:42.303021  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.040s	sys 0.077s
W20260709 13:01:42.299126  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.020s
W20260709 13:01:42.303876  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.008s	sys 0.020s
I20260709 13:01:42.307518  1607 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:01:42.334141  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2275) took 1120 ms. Trace:
I20260709 13:01:42.338500  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:42.334692  1529 rpcz_store.cc:276] 0709 13:01:41.213569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.213695 (+   126us) service_pool.cc:224] Handling call
0709 13:01:41.213976 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.214292 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.214317 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.227706 (+ 13389us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.764429 (+536723us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:41.796536 (+ 32107us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.014248 (+217712us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b1800470860. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:01:42.303007 (+288759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.303076 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.303118 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:42.333817 (+ 30699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.334053 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54336,"prepare.queue_time_us":31997,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":46,"raft.queue_time_us":274103,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":10355,"spinlock_wait_cycles":5349632,"thread_start_us":672988,"threads_started":2,"wal-append.queue_time_us":484037}
I20260709 13:01:42.298771  6094 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:42.324827  6111 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.283865  5954 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.377476  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:42.378315  2261 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:42.378893  6137 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:42.379750  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:42.380420  2259 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:42.381477  2258 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:42.383841  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:42.326308  6231 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.384763  6259 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:42.387850  6259 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:42.388224  6259 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:42.387471  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.420611  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.421218  1677 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:42.385802  6206 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.001s
I20260709 13:01:42.436983  6206 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.438481  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:42.439656  6206 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.440649  1600 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:42.441932  6256 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.442334  6256 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.442634  1683 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:42.442677  6256 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.443061  1679 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:01:42.443388  1679 pending_rounds.cc:85] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 5
I20260709 13:01:42.443677  1679 pending_rounds.cc:107] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:42.443447  5858 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:42.443955  1679 raft_consensus.cc:2889] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:42.445047  6240 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:42.431137  1677 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:42.418201  6237 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:42.432171  6234 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:01:42.432811  6194 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.436017  6094 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:42.443804  6225 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:01:42.446414  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.453991  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:42.456218  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:42.431531  6236 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:01:42.416103  6177 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:42.437357  6058 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.449887  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:42.480955  1677 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:42.493067  1678 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:42.392763  6111 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.436200  6193 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.483775  6257 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:42.483695  6022 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:42.481873  6265 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.488963  6237 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:42.463310  6062 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:42.540591  6022 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.541860  6231 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:42.542506  6231 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.543946  6022 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.544610  6231 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.503032  6255 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:42.551818  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2168) took 1806 ms. Trace:
I20260709 13:01:42.553195  1605 rpcz_store.cc:276] 0709 13:01:40.745201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.748782 (+  3581us) service_pool.cc:224] Handling call
0709 13:01:40.749079 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.749415 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.749442 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.749859 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.597188 (+847329us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180012b320. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:01:41.825594 (+228406us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:41.825633 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.825700 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.549542 (+723842us) raft_consensus.cc:1685] finished
0709 13:01:42.549562 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.551738 (+  2176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4432,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":22278,"spinlock_wait_cycles":3741056,"thread_start_us":227618,"threads_started":1,"wal-append.queue_time_us":1437319}
I20260709 13:01:42.556658  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.557685  1679 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:42.556764  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:42.566884  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 112973us
I20260709 13:01:42.568264  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:42.370675  1425 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 8 to 11, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 11 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.503407  6257 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:42.539537  6217 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:42.571547  6263 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:42.560446  6260 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.574739  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:42.570626  6170 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.523734  6259 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.571871  6210 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.580464  6217 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.575989  6051 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:42.577011  6116 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.606060  6263 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.568696  6169 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:42.616359  6257 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.634965  6257 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.575420  6154 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:01:42.636457  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.577807  6029 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:42.540499  6265 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.612646  5954 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.614588  6019 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.615348  6262 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.562848  6255 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.618690  6263 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.647517  1679 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:42.551776  6237 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.612287  6170 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:42.649392  5851 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.164s	user 0.012s	sys 0.000s
I20260709 13:01:42.643747  6154 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:42.637038  6051 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.663901  1606 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:01:42.664357  1606 pending_rounds.cc:85] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 4
I20260709 13:01:42.664609  1606 pending_rounds.cc:107] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:42.664867  1606 raft_consensus.cc:2889] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.665206  1606 pending_rounds.cc:107] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:42.665441  1606 raft_consensus.cc:2889] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.666668  6270 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:42.667697  6269 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:42.649302  6194 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:42.680678  6270 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:42.681798  6259 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:42.684278  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.689003  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:42.689877  1678 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:42.684355  1677 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:42.680677  6193 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:42.610867  6260 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.692440  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.662567  6154 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:42.649693  6019 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:42.697962  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88641.4us
I20260709 13:01:42.666112  6202 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.700956  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 128015us
W20260709 13:01:42.694573  6203 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.359s	user 0.007s	sys 0.000s
I20260709 13:01:42.705740  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:42.705734  1683 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.652508  6262 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.681862  6270 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.714582  1603 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:42.716768  6154 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.718075  6154 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.718493  6256 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.722968  1574 leader_election.cc:400] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 8. Current term is 9.
W20260709 13:01:42.712205  5927 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
I20260709 13:01:42.736166  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2481) took 1019 ms. Trace:
I20260709 13:01:42.726437  6094 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.726850  6169 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.707114  6202 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.747465  1683 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:42.736622  1608 rpcz_store.cc:276] 0709 13:01:41.716922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.305361 (+588439us) service_pool.cc:224] Handling call
0709 13:01:42.345377 (+ 40016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.345622 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:42.493389 (+147767us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.735844 (+242455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.735895 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:42.735939 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.736005 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.736112 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18169,"prepare.queue_time_us":180028,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":33,"raft.queue_time_us":36287,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":343688,"threads_started":3,"wal-append.queue_time_us":150178}
I20260709 13:01:42.727631  6153 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:42.775784  6256 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.777768  1608 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:42.728592  6281 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:42.779043  1604 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:42.783058  6217 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.787371  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:42.788172  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:42.786655  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:42.789894  2258 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.790735  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:42.735430  5927 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:42.796612  6152 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:42.797505  6152 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:42.833514  2258 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:42.794605  6128 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.794515  6116 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:42.842689  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.768723  6189 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.838793  5858 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:42.798650  6265 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:42.848672  1603 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:42.749888  6094 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:42.848750  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58325.7us
I20260709 13:01:42.851186  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:42.853222  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.854065  1681 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:42.839988  5979 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
W20260709 13:01:42.869059  6273 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:01:42.869890  6051 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.871929  6255 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:42.877311  6275 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:01:42.859563  6058 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:42.866433  6170 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.883085  6217 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.884435  6260 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.888576  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2166) took 1449 ms. Trace:
I20260709 13:01:42.888990  1680 rpcz_store.cc:276] 0709 13:01:41.439438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.441018 (+  1580us) service_pool.cc:224] Handling call
0709 13:01:42.048836 (+607818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.049743 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.888368 (+838625us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540031bad0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:42.888501 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397121408}
I20260709 13:01:42.854308  6019 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.891475  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:42.892745  1680 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:42.860286  6144 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.855051  6116 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:42.726594  1425 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 6 to 15, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.898131  6144 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.918682  6144 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.909134  6170 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:42.910192  6191 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:42.938309  5984 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:42.942370  5954 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:42.946240  6111 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.959649  6189 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:42.963969  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.964329  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:42.952857  5984 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:42.949826  5954 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:42.966535  5984 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:42.967020  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2485) took 1192 ms. Trace:
I20260709 13:01:42.967410  1609 rpcz_store.cc:276] 0709 13:01:41.774941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.828388 (+ 53447us) service_pool.cc:224] Handling call
0709 13:01:42.966868 (+1138480us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b5400207454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:42.966964 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121842560}
I20260709 13:01:42.978674  6094 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:42.979395  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:42.992880  2258 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
W20260709 13:01:42.980336  6279 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:42.948251  6265 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:43.012249  6265 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.015177  6265 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:43.023248  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2475) took 1325 ms. Trace:
I20260709 13:01:43.023727  1607 rpcz_store.cc:276] 0709 13:01:41.697623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.697735 (+   112us) service_pool.cc:224] Handling call
0709 13:01:43.023057 (+1325322us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400349ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:43.023185 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400162048}
I20260709 13:01:43.025050  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:43.028863  6108 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:43.029313  6108 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:43.029698  6108 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.035494  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2483) took 1267 ms. Trace:
I20260709 13:01:43.039517  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 802) took 1120 ms. Trace:
I20260709 13:01:43.040654  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 2180) took 1232 ms. Trace:
I20260709 13:01:43.039940  1602 rpcz_store.cc:276] 0709 13:01:41.919312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.524272 (+604960us) service_pool.cc:224] Handling call
0709 13:01:42.526977 (+  2705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.527342 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:42.527606 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.038689 (+511083us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b1800346300. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a
0709 13:01:43.039017 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.039197 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.039242 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:43.039281 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.039354 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.039459 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6126,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":936,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5708,"spinlock_wait_cycles":4782336,"thread_start_us":19745,"threads_started":1,"wal-append.queue_time_us":46918}
I20260709 13:01:43.042390  6169 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:43.042781  6169 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:43.043617  6169 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:42.987728  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 2162) took 1555 ms (client timeout 2053 ms). Trace:
I20260709 13:01:43.061401  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.044494  5979 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:43.044190  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.046252  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.966390  5954 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.047021  6214 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.981458  1425 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.050575  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.053550  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.067317  1534 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.054308  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.055051  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.068992  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.035981  1606 rpcz_store.cc:276] 0709 13:01:41.767890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.376456 (+608566us) service_pool.cc:224] Handling call
0709 13:01:42.376714 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.665964 (+289250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.035207 (+369243us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400336b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:43.035426 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659572992}
I20260709 13:01:43.055809  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.070336  1525 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:43.071272  1525 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:43.072438  1525 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:43.059058  1527 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:43.041069  1600 rpcz_store.cc:276] 0709 13:01:41.808769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.051968 (+243199us) service_pool.cc:224] Handling call
0709 13:01:43.040466 (+988498us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400207e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:43.040596 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891269888}
I20260709 13:01:43.060323  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:43.061715  1674 rpcz_store.cc:269] 0709 13:01:41.431979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.775205 (+343226us) service_pool.cc:224] Handling call
0709 13:01:42.987484 (+1212279us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000eced4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:42.987652 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609824640}
I20260709 13:01:43.075042  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.075428  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.062994  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.076475  1530 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:43.065430  1531 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:42.933744  6170 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.073916  1533 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:43.077369  1528 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:43.078280  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.083210  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.086524  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:42.963059  6116 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.066876  1675 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:01:43.092446  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.064574  5636 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:43.101850  5636 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:43.102283  5636 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:43.102494  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.103183  5636 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.103682  6284 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:43.105737  6284 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:43.106101  6284 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:43.106912  6284 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.105185  5984 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.108634  5984 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:43.109016  5984 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.110450  1528 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:43.110627  1425 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:43.113250  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:43.114286  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2471) took 2062 ms (client timeout 1615 ms). Trace:
W20260709 13:01:43.114681  1601 rpcz_store.cc:269] 0709 13:01:41.051453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.051573 (+   120us) service_pool.cc:224] Handling call
0709 13:01:43.114089 (+2062516us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003845d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:43.114208 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761239424}
I20260709 13:01:43.117966  1534 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:43.123055  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:43.124660  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:43.126873  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.130005  1534 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:43.129004  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:43.130856  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.131345  1606 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:43.135208  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 158026us
I20260709 13:01:43.136057  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.108091  6284 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.143009  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.145219  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.145460  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.085247  6088 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:43.090888  5954 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.146124  1534 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:43.126861  6169 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.158988  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:43.161388  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.161643  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.162523  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.163993  1600 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:43.138019  5636 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.170527  1682 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:43.168412  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:43.173660  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:43.085415  6265 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:43.179764  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.135196  5927 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:43.181234  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:43.179720  6164 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:01:43.189246  1606 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:43.190184  5713 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:43.190702  6062 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:43.191715  6153 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:43.191936  5927 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:43.193626  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.148993  6020 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:43.108179  6144 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.198019  6144 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:43.199256  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.141886  6263 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.205713  1678 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:01:43.207324  6263 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:43.170756  6271 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:43.208478  1601 raft_consensus.cc:2410] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:43.208235  6271 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.210542  6271 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.181524  5929 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:43.211541  1682 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:43.211858  1425 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 7 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 11 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.217783  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.081436  6214 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.177116  6022 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.164076  6088 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:43.251655  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.262738  1607 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:43.223194  6153 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.253574  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.254315  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.265753  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.266458  1604 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:43.267746  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:43.261365  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.261857  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:43.268962  1600 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:43.222373  5929 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:43.321719  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.323041  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.252178  6164 consensus_queue.cc:1243] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:43.179245  5833 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 13:01:43.331104  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60353.9us
I20260709 13:01:43.332623  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.227681  6217 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:43.168962  6282 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:01:43.343094  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.260924  5927 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:43.347270  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.349344  2253 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:43.352804  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.367476  2256 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:43.357595  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.251904  6062 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:43.228031  5949 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:01:43.343838  2259 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:43.364079  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:43.365224  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 653) took 1654 ms. Trace:
I20260709 13:01:43.371150  5858 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.373533  6050 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:43.380038  6275 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:01:43.383148  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.388872  5636 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:43.441711  5636 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:43.442651  5636 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.443872  5636 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.445221  6088 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.353662  6257 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:01:43.449091  6257 consensus_queue.cc:1243] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:43.449297  6286 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:01:43.366984  6153 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.450991  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.452203  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.366705  6263 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:43.457722  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.338583  6020 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:01:43.396889  6202 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:43.402885  1681 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:43.459153  6050 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.396621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:43.408103  6262 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:43.334592  5929 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:43.423111  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.264896  6115 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:43.467689  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.432801  1676 rpcz_store.cc:276] 0709 13:01:41.710350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.724389 (+ 14039us) service_pool.cc:224] Handling call
0709 13:01:43.364966 (+1640577us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001d8b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:43.365159 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750317312}
W20260709 13:01:43.433211  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 69231.1us
I20260709 13:01:43.470849  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.471613  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.433895  4933 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:43.434811  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77296.4us
I20260709 13:01:43.325163  5851 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:43.282331  6111 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.279539  6169 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.438961  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:43.457962  6170 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.404785  5927 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.472811  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.471520  2259 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:43.477223  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.425995  6164 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.483233  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:43.487434  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.511638  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:43.481113  2253 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:43.519580  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46867.8us
I20260709 13:01:43.523052  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:43.486140  6137 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:43.525166  6164 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.526999  5927 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.527523  6153 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:43.437651  6271 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.557672  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.476567  6247 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.509861  5858 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.564025  1682 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:01:43.552561  6295 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:43.540127  6259 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:43.528249  6169 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.586647  6169 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.509584  5851 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.510456  6111 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.565208  6164 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.559752  5707 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.486635  6237 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:01:43.619622  6137 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:43.577816  6062 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.702206  1528 raft_consensus.cc:1217] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[7.6-12.9]   Dedup: 9.7->[10.8-12.9]
I20260709 13:01:43.479159  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:43.704063  1528 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: [7.6-12.9]
W20260709 13:01:43.706773  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 227596us
W20260709 13:01:43.704214  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 224184us
W20260709 13:01:43.714811  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 453376us
W20260709 13:01:43.717651  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.730877  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:43.733548  1607 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:43.593142  2227 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:43.559643  6144 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:43.732231  1604 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:43.781666  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.782770  5858 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.874612  5858 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.878129  6259 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:43.881832  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:43.882795  1532 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.885769  6185 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:43.886399  6185 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:43.887822  6263 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:01:43.647204  6108 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:01:43.784308  1606 pending_rounds.cc:85] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:01:43.784745  5851 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.785298  4933 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.791095  6016 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:43.799307   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:43.621385  5707 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:43.908658  5707 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.651425  6214 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:43.642333  6116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.053s	sys 0.072s
W20260709 13:01:43.913241  6116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.053s	sys 0.073s
I20260709 13:01:43.807536  6169 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.914577  6169 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.917413  6169 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:43.813719  6167 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.918608  6167 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.837105  1609 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:43.850270  6137 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:43.860502  5927 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:43.869699  1607 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:01:43.907868  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.888779  6263 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.926710  6116 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.929015  6167 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:43.895805  1606 pending_rounds.cc:107] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:01:43.939215  5707 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.956889  1606 raft_consensus.cc:2889] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:43.985451  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.879797  6259 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:43.889652  6108 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.000046  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.922933  6137 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.888265  6185 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:43.988929  6167 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.012252  6232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.034s	sys 0.073s
I20260709 13:01:44.035202  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:43.988209  6016 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:44.042124  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 245043us
W20260709 13:01:44.039369  6232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.035s	sys 0.073s
I20260709 13:01:44.044694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.043447  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:44.061329  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.025415  6116 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.021346  5927 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.069660  6108 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.070019  6111 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.041471  5979 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:44.077951  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.078647  1674 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:44.078317  5979 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.076543  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.081599  1533 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:44.082751  5979 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.082947  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.099551  6116 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:44.106926  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 513737us
I20260709 13:01:44.108131  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:44.110080  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:44.075032  6303 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:44.064558  5707 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.112298  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:44.122984  1604 raft_consensus.cc:2410] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:01:44.123580  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.122677  6016 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.124626  6058 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:44.125126  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63040.5us
I20260709 13:01:44.125327  6111 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:44.127072  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.132977  6108 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:44.134284  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:44.065614  6167 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.137941  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.139570  6167 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.115123  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:44.144230  1529 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:44.146806  5929 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.630s	user 0.004s	sys 0.008s
I20260709 13:01:44.147342  5929 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.150220  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:44.152717  1604 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:44.114503  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:44.155810  5929 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:44.114506  6263 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.113797  6303 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.174436  6169 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:44.175199  6169 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:01:44.176105  6311 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:44.176532  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.176352  6169 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.177210  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:44.186626  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 52485.9us
I20260709 13:01:44.190068  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.190944  1600 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:01:44.196448  5979 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:44.200958  1609 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:44.205904  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2501) took 1041 ms. Trace:
I20260709 13:01:44.206446  1603 rpcz_store.cc:276] 0709 13:01:43.164263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.164781 (+   518us) service_pool.cc:224] Handling call
0709 13:01:43.165179 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.728980 (+563801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.729042 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.729983 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.973695 (+243712us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:43.973731 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.205360 (+231629us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:44.205416 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.205467 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:44.205480 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.205714 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13825,"raft.queue_time_us":73412,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":16848,"spinlock_wait_cycles":231708416,"thread_start_us":675670,"threads_started":2,"wal-append.queue_time_us":293726}
I20260709 13:01:44.209419  1532 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
W20260709 13:01:44.217604  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.223145  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.228473  1530 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 13:01:44.231722  5984 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.122s	user 0.008s	sys 0.008s
I20260709 13:01:44.232960  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.233909  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.237285  6263 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:44.237993  6263 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.242727  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:44.234552  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:44.197286  5979 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.232240  5984 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.273317  2260 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:44.277129  6050 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.008s
I20260709 13:01:44.271991  6088 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:01:44.278810  1525 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 6.
W20260709 13:01:44.266844  5636 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.760s	user 0.002s	sys 0.010s
I20260709 13:01:44.346710  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.344354  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2292) took 1397 ms. Trace:
I20260709 13:01:44.385152  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:44.386129  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 121710us
I20260709 13:01:44.279188  6303 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.358055  1674 rpcz_store.cc:276] 0709 13:01:42.946794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.074686 (+127892us) service_pool.cc:224] Handling call
0709 13:01:44.279316 (+1204630us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b5400107cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:44.344228 (+ 64912us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208275712}
I20260709 13:01:44.410565  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:44.412098  6016 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:44.412580  6016 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.412945  6016 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:44.409114  4933 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:44.417505  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 307627us
I20260709 13:01:44.417358  1600 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 6.
W20260709 13:01:44.427548  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 233727us
W20260709 13:01:44.434415  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.398592  5984 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:44.444936  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 332814us
I20260709 13:01:44.427325  5979 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.455294  2258 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:44.438073  6263 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:44.473284  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:44.446655  6167 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:44.452724  6050 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:44.479363  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:44.501998  6153 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.010s
W20260709 13:01:44.502493  6153 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.013s	sys 0.010s
I20260709 13:01:44.503366  6167 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.504612  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:44.506305  6050 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.508585  6050 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:44.508800  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58807.5us
I20260709 13:01:44.510396  6256 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:44.511001  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:44.506702  6167 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.512024  2253 raft_consensus.cc:2410] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:44.517846  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:44.520648  6191 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:44.473462  6161 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.465947  5833 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.526995  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46528.5us
I20260709 13:01:44.530339  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:44.544781  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 266257us
I20260709 13:01:44.547143  6050 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:44.547812  6050 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:44.548892  6050 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.549422  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:44.550175  2259 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:01:44.561671  5858 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.565673  5927 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:44.534719  5954 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.309s	user 0.009s	sys 0.009s
I20260709 13:01:44.584003  1602 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:01:44.584466  1602 pending_rounds.cc:85] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:01:44.584721  1602 pending_rounds.cc:107] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:44.584951  1602 raft_consensus.cc:2889] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.585408  1602 pending_rounds.cc:107] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:44.585680  1602 raft_consensus.cc:2889] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.588578  6256 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:44.589251  6256 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.593602  5833 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.594417  1678 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
W20260709 13:01:44.601527  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.606904  5954 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.607425  5954 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.610316  5954 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.578478  6016 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:44.579319  2261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.011s	sys 0.010s
W20260709 13:01:44.624644  2261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.011s	sys 0.010s
I20260709 13:01:44.615759  6116 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:44.617164  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:44.618156  6324 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:44.619343  6304 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.634565  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.621079  5927 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.578850  6262 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.615113  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 94765.5us
I20260709 13:01:44.626052  1532 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:01:44.624624  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48934.8us
I20260709 13:01:44.531536  6058 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.659282  6306 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:44.678869  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61820.2us
I20260709 13:01:44.679277  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:44.710410  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.745982  1526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.027s	sys 0.033s
I20260709 13:01:44.660118  6137 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.784677  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1087) took 1357 ms. Trace:
I20260709 13:01:44.672169  6306 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:44.631923  6304 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:44.798297  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 112213us
I20260709 13:01:44.807261  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:44.684908  5929 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:44.688457  6191 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:44.800451  6185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.029s
I20260709 13:01:44.788897  2261 rpcz_store.cc:276] 0709 13:01:43.331831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.336537 (+  4706us) service_pool.cc:224] Handling call
0709 13:01:43.336906 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:43.337308 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.337337 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.356755 (+ 19418us) log.cc:844] Serialized 52 byte log entry
0709 13:01:43.818013 (+461258us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:43.922282 (+104269us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b48000cc0d8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:01:44.625096 (+702814us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.650970 (+ 25874us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.651180 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.672849 (+ 21669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.682323 (+  9474us) raft_consensus.cc:1685] finished
0709 13:01:44.682342 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.689081 (+  6739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4420,"prepare.queue_time_us":47851,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":14885,"raft.run_cpu_time_us":2823,"raft.run_wall_time_us":570722,"spinlock_wait_cycles":21637760,"thread_start_us":1113939,"threads_started":2,"wal-append.queue_time_us":572575}
W20260709 13:01:44.828905  6185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.030s
I20260709 13:01:44.865862  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.867116  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:44.867883  1600 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:44.868587  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:44.868880  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:44.837152  1573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.866s (SENT) [suppressed 7 similar messages]
I20260709 13:01:44.870263  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.820343  5954 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:44.871439  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.871898  5954 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.872620  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:44.873255  6306 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.874161  5954 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.793850  6161 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:44.810837  6088 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:01:44.875535  6191 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.876680  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:44.877408  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:44.877988  6191 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.793641  6058 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:44.856549  6334 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.341s	user 0.003s	sys 0.000s
I20260709 13:01:44.838155  6137 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.872279  6271 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.879269  6237 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.880203  6140 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:44.880697  5929 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.790948  5927 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.688519  6262 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:44.882237  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:44.883801  6304 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:44.853910  6016 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:44.878795  1604 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:01:44.872026  6327 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.342s	user 0.000s	sys 0.003s
I20260709 13:01:44.878672  6287 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:44.896237  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 364225us
I20260709 13:01:44.874344  6306 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.891927  6271 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.896562  5954 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.961223  1603 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:01:44.894407  6237 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:44.964587  2253 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:44.969789  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2496) took 1844 ms. Trace:
I20260709 13:01:44.941109  6303 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.970234  1602 rpcz_store.cc:276] 0709 13:01:43.125874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.126532 (+   658us) service_pool.cc:224] Handling call
0709 13:01:43.129092 (+  2560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.586241 (+1457149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.960723 (+374482us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400384ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:44.969684 (+  8961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3344429696}
I20260709 13:01:44.949000  6271 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.970477  6237 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:45.001096  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 225634us
I20260709 13:01:44.980753  6259 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:44.967001  5954 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:44.955065  6140 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.009279  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:45.069072  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59889.8us
I20260709 13:01:45.061090  6263 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.098986  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2200) took 1317 ms. Trace:
I20260709 13:01:45.099650  1606 rpcz_store.cc:276] 0709 13:01:43.782002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.783079 (+  1077us) service_pool.cc:224] Handling call
0709 13:01:43.783657 (+   578us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:44.034643 (+250986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.034678 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:44.052144 (+ 17466us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.219199 (+167055us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.219242 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.219372 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.591860 (+372488us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:45.094789 (+502929us) raft_consensus.cc:1685] finished
0709 13:01:45.094816 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.098895 (+  4079us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3025,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":6984,"spinlock_wait_cycles":17900800,"thread_start_us":98196,"threads_started":1,"wal-append.queue_time_us":332368}
I20260709 13:01:45.107200  5954 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:45.111366  6346 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:45.001310  6303 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.107404  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.116752  6058 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:45.125072  6343 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
I20260709 13:01:45.093773  6169 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:45.129067  6169 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:45.129506  6169 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.134925  1677 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:01:45.141040  6348 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:01:45.145017  6354 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:45.145381  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.146438  1533 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:45.147367  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.148094  1534 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:45.149720  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.150552  1675 raft_consensus.cc:2410] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:01:45.151643  6326 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.624s	user 0.000s	sys 0.003s
W20260709 13:01:45.114203  6313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.021s	sys 0.004s
I20260709 13:01:45.164927  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.163501  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:45.167001  2253 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:45.167693  6313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.022s	sys 0.004s
I20260709 13:01:45.076511  6259 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.172120  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:45.174754  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67449.9us
I20260709 13:01:45.166432  5954 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:45.184755  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.151810  6263 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.154374  6088 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:01:45.193181  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.200124  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:45.202216  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.196496  6062 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:45.203354  1675 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:45.211784  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:45.212567  1606 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:45.180959  5927 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.177153  5929 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:45.176761  6137 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.181641  5979 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.222074  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.226558  1675 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:45.191632  6304 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:45.230011  1682 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:45.230616  1604 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:45.230643  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.211335  5833 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:45.242412  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64143.5us
I20260709 13:01:45.251086  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:45.251854  1600 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.258222  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.263168  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.251945  5954 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.231904  6062 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.241148  5979 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:45.299700  6331 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.788s	user 0.001s	sys 0.003s
W20260709 13:01:45.305397  6256 consensus_meta.cc:287] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.003s
W20260709 13:01:45.331271  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 84814.6us
I20260709 13:01:45.327040  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:45.333479  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.335292  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.336359  1680 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:01:45.332373  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:45.341741  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:45.333890  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:45.341946  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:45.351959  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.359763  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:45.337728  6304 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:45.336292  6357 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:45.381083  4933 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:45.327263  5954 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.349771  6303 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.382846  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:45.358260  6137 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:45.400368  6137 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:45.381956  6357 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.401191  6357 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.401364  6137 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.396432  6359 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:45.396919  6358 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:01:45.341213  6256 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.362900  6140 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.445861  1600 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:01:45.391247  5929 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:45.459890  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 100190us
W20260709 13:01:45.461632  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74379.3us
W20260709 13:01:45.459518  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 132575us
I20260709 13:01:45.465971  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.461633  6259 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:45.482054  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 133328us
I20260709 13:01:45.488502  1681 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:45.499608  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.489315  6167 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:45.510051  6303 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:45.500869  5954 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.513417  6155 raft_consensus.cc:2764] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:45.522505  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:01:45.505383  6167 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.527928  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:45.528816  6361 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260709 13:01:45.529033  6256 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.529426  6062 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.530097  6062 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:45.530591  6062 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:45.530716  6362 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.531309  6362 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.533481  6362 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.536547  6167 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:45.587136  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.588871  1606 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:01:45.589062  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.502199  5833 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:45.531615  6062 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:45.590559  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62703.5us
I20260709 13:01:45.602165  6370 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:45.654484  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56785.7us
I20260709 13:01:45.655267  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.698719  6304 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.699293  6304 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:45.699671  6304 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.694094  6259 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:45.722374  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 198603us
W20260709 13:01:45.726536  6169 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.003s
I20260709 13:01:45.733480  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:45.727453  5858 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:45.736646  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 230375us
I20260709 13:01:45.738262  6378 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:45.738582  6368 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:45.745599  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.747383  6372 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:45.751262  6381 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.735456  6169 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:45.754546  6380 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:01:45.737624  5858 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:45.737214  5979 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.760964  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.750525  5833 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:45.771284  5833 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.771373  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.771786  5833 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:45.772398  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:45.770360  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.768646  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.772531  6378 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:45.773972  5858 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.774542  6378 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.774922  6378 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.775233  5858 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:45.776294  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:45.777791  6373 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:45.769429  6371 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:01:45.778378  6373 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:45.766175  6370 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.814965  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:45.816601  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47554us
I20260709 13:01:45.808233  6191 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.817518  6191 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.822307  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.822999  1534 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
W20260709 13:01:45.822518  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.040s	sys 0.101s
W20260709 13:01:45.830822  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.041s	sys 0.102s
W20260709 13:01:45.831221  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 1.00645e+06us
I20260709 13:01:45.838776  1678 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:45.845021  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:45.845528  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114829us
I20260709 13:01:45.848714  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:45.816172  6370 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.861433  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.820168  6191 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.853124  6140 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.865015  6140 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.865988  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.867144  6140 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.868455  6357 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.870720  6357 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:45.872061  1532 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:01:45.872973  6154 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:45.873463  6154 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.863282  6370 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.875486  6154 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:45.849974  6237 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.000s
I20260709 13:01:45.876184  6237 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.878364  6237 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.880973  6373 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.853514  5927 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:45.884505  5927 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.884892  5927 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.884253  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:45.886966  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:45.887908  6390 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.888300  6390 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.888691  6390 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.759744  6381 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.884635  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.897714  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.900755  6386 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.901171  6386 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.901558  6386 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.823179  6385 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:45.894598  1534 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:45.911158  6384 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:45.913347  6262 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.915625  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.961849  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:45.965310  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67681us
W20260709 13:01:45.963955  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 107485us
I20260709 13:01:45.966902  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:45.967252  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:45.968441  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.968827  4933 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.969352  4933 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.969731  5979 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.970335  5979 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:45.971371  4933 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.972070  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.972739  1533 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:45.973547  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.974035  1533 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:01:45.974799  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:45.975453  1533 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 7: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:45.976657  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.976994  5979 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.977216  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:45.977420  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.978133  1531 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:45.978871  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:45.978971  6385 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.979118  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:45.979382  6385 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.979758  6385 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.979944  6153 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.980428  6153 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.980798  6153 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.982982  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.983531  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.984565  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.984651  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:45.984923  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:45.985091  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.985663  2254 raft_consensus.cc:2368] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:45.986469  6262 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.987018  6262 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.989081  6262 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:45.985108  6325 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.960s	user 0.014s	sys 0.005s
I20260709 13:01:45.990554  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.990852  6153 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.991430  2261 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:45.991830  6384 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.992452  6384 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.995047  6384 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.995628  6153 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.989601  6262 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.996454  6350 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:45.997763  6287 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.998610  6287 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:45.999306  6287 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.000353  6169 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:45.914383  6304 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.002893  1601 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:46.003470  6304 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:45.999253  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.004695  6357 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.005281  6357 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.976157  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:46.007048  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 136157us
I20260709 13:01:46.004863  1526 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.969472  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.006785  1527 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
W20260709 13:01:45.972096  6271 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.978s	user 0.007s	sys 0.005s
W20260709 13:01:46.014832  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.016520  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.019338  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.019640  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:45.959904  5833 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:45.996906  6262 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.021920  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.054370  2254 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:46.054744  1530 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.023105  1533 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:46.024570  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.031754  6287 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.022794  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.999392  6381 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.059942  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.062301  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:46.062990  1680 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.057164  1531 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:46.064451  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:46.067880  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 44554.8us
I20260709 13:01:46.068418  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:45.958705  6370 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.025964  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.074029  1531 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:46.078081  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.016247  6232 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:46.080601  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:46.057843  6379 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:01:46.005435  6378 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.076572  2258 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:46.086454  1527 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.086969  4933 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.086529  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.088033  1600 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:46.088625  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.090443  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:45.977440  6390 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.093147  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.096673  1675 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:46.074137  6381 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.098869  4933 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.089747  6362 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:46.100085  6362 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.100759  6381 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.101202  4933 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.103672  1603 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.105836  4933 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:46.106540  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:45.996986  6350 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.121119  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.122534  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.119076  4933 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.021461  6271 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.096271  6153 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:46.115636  6167 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
W20260709 13:01:46.135164  6369 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.480s	user 0.000s	sys 0.003s
I20260709 13:01:46.138094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:46.139737  1600 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:46.140689  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.101366  6381 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.144281  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.147135  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.158406  1677 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.096093  6232 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.194413  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:46.210911  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63864.4us
I20260709 13:01:46.211763  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.214998  1680 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:46.217420  6140 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.144006  6167 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.249382  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:46.236606  6389 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.343s	user 0.002s	sys 0.000s
I20260709 13:01:46.253306  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.233668  6169 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.239008  1600 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:46.238878  6257 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:46.272864  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.285828  5833 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.290589  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.270802  6362 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.298688  2258 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:46.307420  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:46.309257  1573 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.671s (SENT)
I20260709 13:01:46.309737  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.286582  6154 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.311331  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.319541  2258 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:46.284200  6374 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.311407  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:46.326097  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:46.327975  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84315.1us
I20260709 13:01:46.277719  6169 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.298620  6357 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.306051  6370 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.336875  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.340246  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.278339  6257 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.364540  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:46.368587  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 75823.7us
I20260709 13:01:46.323829  6390 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.375098  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.335505  6381 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:46.377660  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 98472.5us
I20260709 13:01:46.381620  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.394390  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.396962  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.404749  2258 raft_consensus.cc:2368] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:46.395181  1674 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:46.403990  1530 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:46.408067  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:46.423009  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49986.1us
I20260709 13:01:46.382316  6304 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.377692  6153 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.437325  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.446095  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.423789  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:46.398447  6396 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:01:46.426597  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:46.337924  6374 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.449200  1602 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.326486  6154 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.451705  2258 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:46.398898  5954 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:46.455070  6169 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.456135  6374 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.459900  6154 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.460717  6271 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.451054  6153 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.464607  6398 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:46.465339  6398 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:46.466281  6398 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.449156  6167 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:46.469923  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46223.7us
W20260709 13:01:46.442092  6401 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:46.392485  6350 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:46.453734  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 144502us
I20260709 13:01:46.453958  1525 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:46.480103  1527 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:46.480497  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.481323  2258 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:01:46.446722  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47582us
I20260709 13:01:46.476168  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.499044  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.520112  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.475878  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2530) took 1226 ms. Trace:
I20260709 13:01:46.478298  1526 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
W20260709 13:01:46.485997  6386 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:01:46.499882  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.489543  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.491310  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:46.493216  6257 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.464691  6153 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.460757  6429 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.441437  6232 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.499338  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.499610  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.498420  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:46.487537  1573 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.032s (SENT)
I20260709 13:01:46.584936  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.585773  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.586426  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.587162  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.521847  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.517830  1679 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:46.573297  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:46.496258  5927 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.005s
I20260709 13:01:46.574896  2258 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:46.577083  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.588397  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.577771  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:46.501025  6414 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:46.520903  1609 rpcz_store.cc:276] 0709 13:01:45.249183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.340426 (+ 91243us) service_pool.cc:224] Handling call
0709 13:01:45.340731 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.399749 (+ 59018us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:45.399785 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.399867 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:45.399922 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.475500 (+1075578us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b540034b2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:46.475559 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.475713 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487,"raft.queue_time_us":103510,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":15135,"spinlock_wait_cycles":134945536}
I20260709 13:01:46.582859  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:46.515793  6399 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:01:46.593695  1602 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.591774  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.591471  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.591441  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.597599  2260 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:46.598304  1676 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.598984  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2208) took 1407 ms. Trace:
I20260709 13:01:46.599591  6403 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.599274  1676 rpcz_store.cc:276] 0709 13:01:45.191511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.235081 (+ 43570us) service_pool.cc:224] Handling call
0709 13:01:46.590178 (+1355097us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:01:46.595991 (+  5813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.598725 (+  2734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.598910 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13242752}
I20260709 13:01:46.604846  6153 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.591344  6271 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.606335  6271 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.594877  5927 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.610476  5927 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.613006  6378 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.613866  1527 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:46.614982  6271 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.621408  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.626013  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.619947  1602 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:01:46.615103  1527 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:46.599362  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.633298  1680 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:46.635716  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.659554  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.662416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:46.659400  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.662528  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.665972  1525 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:46.661016  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 173533us
W20260709 13:01:46.667528  1573 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.796s (SENT)
I20260709 13:01:46.667943  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.689795  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.574483  6386 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.629052  6404 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:46.693111  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.700912  2260 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:46.694357  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.700047  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.703702  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.704487  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.705559  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.706188  1527 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.708382  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.709324  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.709920  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.710062  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:46.710673  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:46.700033  6399 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:46.714183  1648 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:46.716586  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.726708  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.727294  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.727768  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.728487  6108 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:46.720162  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.721876  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.703542  5929 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.721407  1609 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:01:46.717278  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:46.729614  1602 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:46.732820  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.733539  1609 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:46.708627  6404 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:46.737015  1500 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.711091  6257 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:46.734545  1603 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 7: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:46.739946  1609 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.732220  6185 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.742125  6155 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.744514  6423 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.742396  6384 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:46.743813  1559 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:41741 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:41741 timed out after 15.000s (SENT)
I20260709 13:01:46.751153  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.751303  6384 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:46.751950  6384 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.753248  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2206) took 1659 ms. Trace:
I20260709 13:01:46.755079  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.755970  1606 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:46.731069  6370 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.760560  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.761826  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.753661  1682 rpcz_store.cc:276] 0709 13:01:45.094025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.094236 (+   211us) service_pool.cc:224] Handling call
0709 13:01:45.154932 (+ 60696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.230504 (+ 75572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.752996 (+1522492us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b540007dad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:46.753183 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165561728}
I20260709 13:01:46.763099  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.766347  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.767750  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.770941  1527 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:46.774730  6232 raft_consensus.cc:2764] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:46.764349  6237 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.733336  6271 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.776023  6423 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:46.690794  6403 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.778649  2261 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:46.782578  1602 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.785085  6384 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.785842  6405 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.786324  6419 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:46.787258  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.795128  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.797633  1525 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:46.780984  5979 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:46.797818  6385 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.000s
I20260709 13:01:46.807461  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:46.808403  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:46.808954  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 141459us
I20260709 13:01:46.797509  6423 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:46.759618  6257 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.799466  6256 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.812760  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.816538  6422 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:46.801051  6306 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:46.867476  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60091.6us
I20260709 13:01:46.808164  6362 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.816720  6375 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.872704  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.900852  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.809011  6385 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.812469  6423 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.865783  6405 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:46.929718  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55240.7us
I20260709 13:01:46.933239  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.926577  6155 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:46.933861  1525 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:46.875252  6412 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:46.937866  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:46.939105  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:46.940949  2260 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:46.941123  2261 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:46.904743  6403 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:46.944422  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:46.944667  6447 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:01:46.948343  4933 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.949806  1602 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:46.949129  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.951464  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:46.876161  6375 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.820194  6404 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.902565  6306 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.957010  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:46.932739  6256 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:46.898243  6422 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:46.942625  6412 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.964895  6271 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:46.966338  6390 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:46.967461  6387 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.114s	user 0.003s	sys 0.005s
I20260709 13:01:46.968298  6439 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:46.963601  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:46.961395  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:46.978716  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:46.969971  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.948733  6386 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.973647  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:46.940805  6155 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:46.975689  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.979815  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:46.985368  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:46.981912  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:46.986621  6384 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:46.986788  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:46.987345  6445 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.175s	user 0.005s	sys 0.000s
I20260709 13:01:46.987903  6155 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.988466  6385 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:46.988910  6257 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.989471  1601 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:01:46.990264  6422 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:46.988173  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:46.961110  6398 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:01:46.991338  6304 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:46.975921  6390 consensus_queue.cc:1243] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:46.976346  6256 consensus_queue.cc:1243] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:47.000689  6412 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:46.983654  6370 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:47.001389  6370 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:47.001791  6370 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.990865  6161 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:46.991704  6441 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.058s	user 0.002s	sys 0.003s
I20260709 13:01:46.985317  6378 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:47.008131  1647 leader_election.cc:400] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:47.012380  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:47.000818  6375 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.007311  6154 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.006304  6385 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:47.018160  2227 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.020411  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.015774  6417 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:47.008942  6304 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.023288  1573 leader_election.cc:400] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:47.023586  1573 leader_election.cc:403] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.021248  6417 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.026224  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.027516  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.027766  6417 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:47.034802  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48771.3us
I20260709 13:01:47.035269  6263 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.035835  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.036597  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:47.029072  6446 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:01:47.038343  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:47.024878  6378 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.040729  6304 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.041646  6378 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.046700  6237 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:47.047168  6237 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:47.049278  6306 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.028916  6417 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.053056  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.054208  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.055390  6423 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.056555  6385 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.057686  5954 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.058244  5954 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.057921  6154 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.059033  6439 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:47.039224  6444 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:01:47.048014  6237 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.058378  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.067966  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.070950  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:47.072227  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 49046.8us
I20260709 13:01:47.073207  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.075297  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2318) took 1301 ms. Trace:
I20260709 13:01:47.082253  6412 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.081051  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.086200  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.090169  1573 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.091370  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.093060  6375 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.093827  6375 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:47.094560  6375 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:47.057698  6385 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.098198  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:01:47.098392  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.099078  1526 raft_consensus.cc:606] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.099516  1526 raft_consensus.cc:614] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:47.101545  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 813) took 1119 ms. Trace:
I20260709 13:01:47.101969  2259 rpcz_store.cc:276] 0709 13:01:45.982155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.985944 (+  3789us) service_pool.cc:224] Handling call
0709 13:01:45.986218 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.157948 (+171730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.157984 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.158028 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:46.193494 (+ 35466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.101274 (+907780us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:47.101323 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.101467 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368588672}
I20260709 13:01:47.099383  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 818) took 1093 ms. Trace:
I20260709 13:01:47.106945  2257 rpcz_store.cc:276] 0709 13:01:45.983661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.055343 (+ 71682us) service_pool.cc:224] Handling call
0709 13:01:46.101686 (+ 46343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.130655 (+ 28969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.130693 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.627016 (+496323us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:01:46.627419 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.730458 (+103039us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.730492 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.730621 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.061689 (+331068us) raft_consensus.cc:1685] finished
0709 13:01:47.061712 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.077087 (+ 15375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28596,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":6143360,"thread_start_us":102704,"threads_started":1,"wal-append.queue_time_us":183588}
I20260709 13:01:47.084277  6403 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:47.109766  6403 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.110131  6403 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:47.111004  6403 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.074795  6263 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.077440  6259 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.066828  6439 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.079003  6306 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:47.115685  6306 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.116093  6306 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:47.116426  6393 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.899s	user 0.002s	sys 0.000s
I20260709 13:01:47.052795  6370 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.121978  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.119239  1526 pending_rounds.cc:85] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 7
I20260709 13:01:47.125113  1573 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.106357  6423 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.125440  1526 pending_rounds.cc:107] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:47.075738  1681 rpcz_store.cc:276] 0709 13:01:45.773743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.773988 (+   245us) service_pool.cc:224] Handling call
0709 13:01:45.774312 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:45.806781 (+ 32469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.806812 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:45.818692 (+ 11880us) log.cc:844] Serialized 52 byte log entry
0709 13:01:47.061629 (+1242937us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800414d00. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1
0709 13:01:47.061788 (+   159us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:47.061823 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.061891 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.061944 (+    53us) raft_consensus.cc:1685] finished
0709 13:01:47.061955 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.075204 (+ 13249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7431,"raft.queue_time_us":45355,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11669,"spinlock_wait_cycles":3946368,"thread_start_us":33490,"threads_started":1,"wal-append.queue_time_us":142402,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1020226}
I20260709 13:01:47.126969  1526 raft_consensus.cc:2889] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.128209  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.079309  6237 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.125993  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:47.130363  1683 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:47.126686  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 2529) took 1884 ms. Trace:
I20260709 13:01:47.131492  1604 rpcz_store.cc:276] 0709 13:01:45.242407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.243095 (+   688us) service_pool.cc:224] Handling call
0709 13:01:45.254796 (+ 11701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.405880 (+151084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.405912 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.405951 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:45.405985 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.126452 (+1720467us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400455bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:47.126500 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.126632 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346987776}
I20260709 13:01:47.121511  6429 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.117441  6403 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.135732  6375 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:47.154265  6375 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:47.154690  6375 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.157816  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.116709  6439 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.152926  1676 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:47.143453  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.160691  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.158860  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.165649  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.167050  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:47.173589  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 158058us
I20260709 13:01:47.134649  6185 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:47.179944  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.131279  6153 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.134459  6257 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.126664  6359 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.175884  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.192386  6359 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.193115  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:47.193691  1680 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.194522  6359 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.196595  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.198320  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:47.199786  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:47.200160  6185 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:47.201236  6185 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.212535  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 680) took 1244 ms. Trace:
I20260709 13:01:47.212827  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.213651  1607 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:47.214099  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.214795  1606 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.219692  6154 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12.
I20260709 13:01:47.184214  6448 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:47.161109  6362 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:01:47.221609  6362 consensus_queue.cc:1243] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:47.187764  6451 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.186165  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:47.182179  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.220805  6448 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.155690  6375 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.238795  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.239529  1682 raft_consensus.cc:606] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:47.228142  1675 rpcz_store.cc:276] 0709 13:01:45.967682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.973365 (+  5683us) service_pool.cc:224] Handling call
0709 13:01:45.973611 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.097122 (+123511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.212272 (+1115150us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540024bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:47.212474 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282569088}
I20260709 13:01:47.270691  1534 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.273079  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:47.278687  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 96596.4us
I20260709 13:01:47.285951  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:47.288496  1680 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:47.289294  1606 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:47.284447  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.290748  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.296619  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.297322  1602 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.300004  1609 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
W20260709 13:01:47.300450  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 118989us
I20260709 13:01:47.301056  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.301301  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.268626  5858 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.304205  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:47.308212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.305496  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2241) took 1338 ms. Trace:
I20260709 13:01:47.316787  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:47.319993  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.327491  1607 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:47.289386  6413 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:47.338276  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:01:47.341979  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 213789us
I20260709 13:01:47.306674  6191 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.374891  1602 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:47.312568  6425 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:01:47.377698  6287 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.343744  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.345389  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.354794  1606 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:47.355463  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:47.312352  1533 rpcz_store.cc:276] 0709 13:01:45.966702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.067885 (+101183us) service_pool.cc:224] Handling call
0709 13:01:46.068257 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.086140 (+ 17883us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:47.055887 (+969747us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b540042c628. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6749b161 00007f7e6753330b 00007f7e67533259 00007f7e675331e9 00007f7e675331b1 00007f7e675324ad 000000000038f354 000000000038f199 00007f7e60a44475 00007f7e60a467c1 00007f7e60a46779
0709 13:01:47.086839 (+ 30952us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b18001f3f60. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf
0709 13:01:47.087003 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.304981 (+217978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.305039 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.305087 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.305153 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.305287 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39,"prepare.queue_time_us":153289,"prepare.run_cpu_time_us":3177,"prepare.run_wall_time_us":797428,"raft.queue_time_us":83,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":28539136,"thread_start_us":395189,"threads_started":2}
I20260709 13:01:47.356298  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.325533  6418 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.325214  6161 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.318935  5954 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.370437  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 679) took 1403 ms. Trace:
I20260709 13:01:47.314812  6359 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:47.373076  6370 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.299315  6381 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:01:47.383220  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45057.8us
W20260709 13:01:47.316831  6373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.433s	user 0.012s	sys 0.012s
W20260709 13:01:47.408600  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 124219us
I20260709 13:01:47.417761  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:47.427459  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.385114  6385 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:47.341665  6412 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.419247  1677 rpcz_store.cc:276] 0709 13:01:45.967416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.968385 (+   969us) service_pool.cc:224] Handling call
0709 13:01:45.968658 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.160889 (+192231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.370215 (+1209326us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:47.370377 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435911552}
I20260709 13:01:47.410147  6167 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:47.425535  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 135753us
W20260709 13:01:47.440938  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 97255.1us
I20260709 13:01:47.444082  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.445616  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.449134  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:47.440379  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 134120us
W20260709 13:01:47.426913  6373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.543s	user 0.012s	sys 0.012s
I20260709 13:01:47.421557  6359 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.451514  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.381702  6413 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.458855  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.460723  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:47.447371  6153 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.486424  6373 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.480460  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.454424  6167 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:47.460927  6359 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.460803  6429 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:47.508466  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57110.3us
I20260709 13:01:47.523723  6463 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:47.500880  6425 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.504662  6232 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.510255  6381 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.510443  6385 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:47.557864  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48647.3us
W20260709 13:01:47.539932  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 89151.1us
I20260709 13:01:47.524677  6262 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:47.549183  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 104760us
I20260709 13:01:47.523765  5927 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:47.570317  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.572422  6425 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.575855  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.505360  6373 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.508100  6306 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.608218  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:47.525503  6466 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 13:01:47.611351  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123709us
I20260709 13:01:47.613896  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.576855  5927 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.618830  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:47.630074  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 71424.5us
I20260709 13:01:47.630155  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.633742  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.614820  5929 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:47.590472  6271 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:01:47.653609  6454 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:01:47.653976  6381 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:47.654844  6456 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:01:47.611510  6463 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:47.671671  6461 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:47.672595  6470 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:47.673508  6477 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:47.645581  6385 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.627458  6386 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.673911  6477 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:47.623847  6418 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.675881  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:47.677414  6423 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.631072  5954 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.618161  6402 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:47.615067  6167 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.667475  6466 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:47.692410  5929 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:47.729628  6466 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:47.694612  5927 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:47.764906  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 127998us
I20260709 13:01:47.766520  6306 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.782222  5927 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:47.786206  6403 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260709 13:01:47.800638  6306 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:47.818186  6306 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:47.819705  6459 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.494s	user 0.001s	sys 0.000s
I20260709 13:01:47.820708  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:47.820801  6477 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:47.823757  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.824266  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.820164  6155 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:47.825248  6155 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.826437  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:47.829144  6161 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:47.829515  6161 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:47.826366  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:47.834156  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.828075  1679 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:47.838608  1603 pending_rounds.cc:85] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 5
I20260709 13:01:47.839022  1603 pending_rounds.cc:107] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:47.839257  1603 raft_consensus.cc:2889] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.839568  1603 pending_rounds.cc:107] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:01:47.839771  1603 raft_consensus.cc:2889] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:47.843602  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75493.7us
I20260709 13:01:47.767973  6463 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.846562  1601 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:47.852140  1606 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:47.853785  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.830255  6161 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:47.835564  6378 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.863265  1528 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:47.845021  6467 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:47.865454  6467 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.844442  6483 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:47.844952  6372 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.877002  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:47.884922  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:47.893658  1528 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:47.907130  6306 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.907474  6373 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.887058  6385 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:47.873966  6378 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.913655  6155 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:47.914247  6378 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.801203  5929 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.919421  6466 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.920897  1607 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:47.928215  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.929390  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:47.930351  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.951514  1530 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:47.952952  1530 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:47.953991  6306 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:47.956230  6458 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.606s	user 0.001s	sys 0.000s
I20260709 13:01:47.963735  6374 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:47.964293  6374 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:47.965122  6374 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.966427  6374 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.959451  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 821) took 1004 ms. Trace:
I20260709 13:01:47.967446  1609 rpcz_store.cc:276] 0709 13:01:46.957309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.058120 (+100811us) service_pool.cc:224] Handling call
0709 13:01:47.959275 (+901155us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540011dad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:47.959392 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370578816}
I20260709 13:01:47.970459  1530 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:47.971843  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:47.974324  6455 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.627s	user 0.000s	sys 0.002s
I20260709 13:01:47.976639  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:47.974035  6432 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:47.975232  6465 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:47.984927  6467 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:47.994261  1528 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:47.981861  6466 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:47.996469  6481 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:47.996016  6257 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:47.998241  6257 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:47.985116  6465 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:48.001291  6465 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.000370  6257 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:48.002429  6465 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:48.022609  6462 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.668s	user 0.000s	sys 0.002s
I20260709 13:01:48.027405  6477 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.028330  6475 raft_consensus.cc:2764] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
W20260709 13:01:48.030715  6392 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.871s	user 0.000s	sys 0.005s
I20260709 13:01:48.031908  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 880) took 2217 ms. Trace:
I20260709 13:01:48.033329  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2245) took 2060 ms. Trace:
W20260709 13:01:48.032678  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 184470us
I20260709 13:01:48.035511  1533 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:48.037408  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.038944  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.045382  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2220) took 1680 ms. Trace:
I20260709 13:01:48.033722  1531 rpcz_store.cc:276] 0709 13:01:45.973201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.093996 (+120795us) service_pool.cc:224] Handling call
0709 13:01:46.094303 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.102423 (+  8120us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:46.102454 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.103002 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.559326 (+456324us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:46.559363 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.032601 (+1473238us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b540042c2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:48.032648 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.032689 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:48.032701 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.033267 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18081664,"thread_start_us":456031,"threads_started":1,"wal-append.queue_time_us":590169,"wal-append.run_cpu_time_us":2104,"wal-append.run_wall_time_us":1117383}
I20260709 13:01:48.045768  1678 rpcz_store.cc:276] 0709 13:01:46.365386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.520776 (+155390us) service_pool.cc:224] Handling call
0709 13:01:46.582285 (+ 61509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.806182 (+223897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.806224 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.806270 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.806302 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.045159 (+1238857us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001081d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:48.045204 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.045330 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514388224}
I20260709 13:01:48.032733  1529 rpcz_store.cc:276] 0709 13:01:45.814090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.814777 (+   687us) service_pool.cc:224] Handling call
0709 13:01:45.820881 (+  6104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.821090 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.821114 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.821564 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.023510 (+201946us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:46.023543 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.023608 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.978574 (+1954966us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:48.031606 (+ 53032us) raft_consensus.cc:1685] finished
0709 13:01:48.031627 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.031832 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758720,"thread_start_us":201537,"threads_started":1,"wal-append.queue_time_us":286251}
W20260709 13:01:48.060608  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.061996  2227 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:48.044750  6185 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.058663  6451 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:48.016178  6359 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.071412  5954 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.096134  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:48.102293  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.104192  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.104350  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.107836  2257 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:48.104866  2260 raft_consensus.cc:2376] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14. Re-sending same reply.
I20260709 13:01:48.113934  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.131186  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.131428  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.133044  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:48.133144  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.133607  2258 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.140091  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.141664  2255 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:48.149510  1604 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:48.150569  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.152664  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:48.156728  2258 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:48.164708  1601 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:48.141400  6497 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.155619  6494 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:48.188110  6370 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:48.188618  6370 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:48.189438  6370 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.190689  6370 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.191959  6491 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:01:48.193324  6469 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.520s	user 0.001s	sys 0.000s
I20260709 13:01:48.194877  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2340) took 1191 ms. Trace:
I20260709 13:01:48.195233  1526 rpcz_store.cc:276] 0709 13:01:47.005161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.118310 (+113149us) service_pool.cc:224] Handling call
0709 13:01:47.119044 (+   734us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:47.187246 (+ 68202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.187278 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:47.242368 (+ 55090us) log.cc:844] Serialized 52 byte log entry
0709 13:01:47.454489 (+212121us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.454529 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.454595 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.192732 (+738137us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:48.194523 (+  1791us) raft_consensus.cc:1685] finished
0709 13:01:48.194546 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.194811 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16818,"raft.queue_time_us":21383,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":18990,"spinlock_wait_cycles":13991680,"thread_start_us":139317,"threads_started":1,"wal-append.queue_time_us":344760}
I20260709 13:01:48.207469  6448 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:48.210965  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2264) took 1202 ms. Trace:
I20260709 13:01:48.211382  1527 rpcz_store.cc:276] 0709 13:01:47.008381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.178263 (+169882us) service_pool.cc:224] Handling call
0709 13:01:47.178768 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.187455 (+  8687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.187506 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.196137 (+  8631us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.769283 (+573146us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b180037f5a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:01:47.878461 (+109178us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.878490 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.878552 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.210690 (+332138us) raft_consensus.cc:1685] finished
0709 13:01:48.210709 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.210910 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8258,"raft.queue_time_us":8364,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"spinlock_wait_cycles":18387584,"thread_start_us":109004,"threads_started":1,"wal-append.queue_time_us":789430}
I20260709 13:01:48.215822  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:48.216492  1676 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:48.217377  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:48.217896  1676 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:48.219455  1681 pending_rounds.cc:85] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 10
I20260709 13:01:48.219714  1681 pending_rounds.cc:107] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:48.219952  1681 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.221760  6161 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.223214  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:48.226183  1683 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:48.233404  2254 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:48.234925  5929 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:48.236476  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:48.237668  1526 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:48.238605  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:48.251061  1529 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:48.258590  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.235612  5929 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.274953  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:48.280488  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:01:48.281214  1529 raft_consensus.cc:606] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:48.281589  1529 raft_consensus.cc:614] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:48.285609  1647 leader_election.cc:400] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:01:48.286144  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:48.287065  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:01:48.287617  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:48.287787  1529 raft_consensus.cc:606] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:48.302839  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.249732  6488 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:48.285821  6496 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:48.316339  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 133698us
I20260709 13:01:48.276500  6304 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.260530  6460 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.286530  6185 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.183818  6497 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.258452  6464 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
W20260709 13:01:48.351212  6501 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:48.363373  6464 consensus_queue.cc:1243] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:48.372088  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.344990  6287 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:48.277104  6463 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:01:48.549314  2254 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:48.551930  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 200184us
W20260709 13:01:48.552189  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 180205us
I20260709 13:01:48.353749  6483 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.554116  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.354501  6404 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:48.562875  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.566516  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.353715  6304 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.568044  6016 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:48.554513  6359 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:48.347476  6488 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.581681  6448 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:48.622328  6304 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:48.559628  6287 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:48.625217  6471 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.960s	user 0.001s	sys 0.001s
I20260709 13:01:48.564500  6483 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.590427  6499 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:48.605901  6467 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:48.594450  6016 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.655367  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.646443  6499 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:48.659714  6511 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:01:48.663671  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.667029  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:48.667369  5929 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:48.669065  6488 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:48.669656  6304 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:48.670153  6304 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.672688  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:48.673322  1607 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:48.655524  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.710940  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.656766  6467 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.657756  6016 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.717821  2257 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:48.731597  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 414677us
I20260709 13:01:48.672204  6304 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:48.725901  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 153447us
W20260709 13:01:48.734711  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 447114us
I20260709 13:01:48.735605  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:48.731966  6477 consensus_meta.cc:287] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.002s
W20260709 13:01:48.731779  6161 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 13:01:48.729725  6467 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:48.752020  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 197970us
I20260709 13:01:48.766230  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:48.734278  6521 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:48.795202  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 58079.4us
I20260709 13:01:48.805259  6521 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:48.806267  6374 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:48.806741  6514 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:48.840852  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:48.842067  6185 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:48.659725  6499 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:48.873323  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.911023  6304 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.911736  6304 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.914754  6304 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:48.915244  6304 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:48.915706  6304 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:48.810922  6483 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:48.982316  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 356109us
I20260709 13:01:48.813674  6523 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.830653  6521 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:48.986510  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 150090us
I20260709 13:01:49.007728  6519 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.916640  6374 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:49.000053  6514 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:49.009440  6499 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.005457  6521 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.009357  6523 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.981037  6448 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:49.031404  6524 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:01:49.022605  6497 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.024077  6482 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:49.058280  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 316389us
I20260709 13:01:49.027002  6463 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:49.026039  6374 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:49.070155  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.010316  6519 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.054725  6527 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.041023  6521 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:49.096787  6518 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:49.098845  6466 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:49.099385  6466 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:49.101847  6536 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.102391  6536 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:49.103235  6492 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.974s	user 0.014s	sys 0.008s
W20260709 13:01:49.095343  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 112264us
W20260709 13:01:49.106528  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46913us
I20260709 13:01:49.089413  6527 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.043260  6523 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.115456  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.119336  1601 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:49.074421  6482 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:49.133997  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.134027  6523 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.136719  6287 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:49.137948  6457 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.631s	user 0.009s	sys 0.009s
I20260709 13:01:49.139853  6304 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.116528  6527 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.107239  6466 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.146687  6466 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.153303  6519 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.155790  6482 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.155618  6489 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:49.123492  6536 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.119853  6448 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.163630  6304 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:49.164207  6304 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.165091  6413 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.165690  6398 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.166308  6398 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:49.171924  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 429775us
W20260709 13:01:49.176369  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 380272us
I20260709 13:01:49.170902  6482 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.160723  6404 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.173482  5954 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.178812  6529 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.186153  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.184504  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.187532  1676 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:49.191025  1675 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:49.191466  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:49.192057  1681 raft_consensus.cc:606] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:49.192443  1681 raft_consensus.cc:614] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:49.193636  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.193192  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.179539  6535 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.176481  6161 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:49.200073  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.200742  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.190229  6539 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.203318  6535 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.193804  6529 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.240887  6467 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.242161  6529 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.242993  6467 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.243278  5929 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:49.239223  6521 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.202644  6531 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.261178  6531 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.261699  6531 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.262235  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2348) took 1436 ms. Trace:
I20260709 13:01:49.262663  1683 rpcz_store.cc:276] 0709 13:01:47.825489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.825732 (+   243us) service_pool.cc:224] Handling call
0709 13:01:47.825964 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.226624 (+400660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.261966 (+1035342us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540024b3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:49.262171 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919957248}
I20260709 13:01:49.191659  6374 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.245225  1682 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:49.205137  6488 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.263887  6488 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.264842  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.265447  1678 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:49.266003  6488 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.266645  6304 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:49.267014  6465 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.264s	user 0.008s	sys 0.004s
I20260709 13:01:49.243688  5929 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.272763  5929 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.274072  5929 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.186617  6482 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.276242  6398 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.204694  6539 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.239226  6404 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.278832  6539 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.248901  6535 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.250138  6451 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.280525  6527 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.280548  6451 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.282598  6451 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.284713  6529 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.285223  6529 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.285804  6482 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.286338  6375 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.287308  6529 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.296622  6535 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.297317  6535 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.299669  6535 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.243563  6467 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.308404  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.308883  1603 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:49.309180  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.309867  1606 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:49.310246  1608 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:49.310901  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.305171  6467 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.197563  6016 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.313004  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:49.313759  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.314160  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2237) took 1099 ms. Trace:
I20260709 13:01:49.315191  6465 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:49.315711  6538 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.317377  6465 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:49.318655  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1124) took 1079 ms. Trace:
I20260709 13:01:49.319067  2254 rpcz_store.cc:276] 0709 13:01:48.238732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.239180 (+   448us) service_pool.cc:224] Handling call
0709 13:01:49.318425 (+1079245us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400550354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:49.318564 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622332160}
I20260709 13:01:49.314551  1674 rpcz_store.cc:276] 0709 13:01:48.214888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.222553 (+  7665us) service_pool.cc:224] Handling call
0709 13:01:48.222807 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.313216 (+1090409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.313246 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.313285 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:49.313318 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.313955 (+   637us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540031bad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:49.313993 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.314103 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507228544}
I20260709 13:01:49.325078  6535 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.325695  6535 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:49.326691  6508 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.976s	user 0.010s	sys 0.007s
I20260709 13:01:49.327502  6423 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.328014  6423 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.328400  6527 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.328706  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.329345  1532 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:49.329942  6423 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.330478  6467 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.331099  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.335112  6531 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.192332  5954 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.196653  6373 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.336124  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.337067  6373 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.337517  6373 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.341501  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:49.336599  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.345386  1527 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:49.205322  5858 raft_consensus.cc:993] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:49.341521  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:49.346072  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 172024us
I20260709 13:01:49.351668  1533 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:49.346730   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:49.358543  1527 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:49.360357  4933 raft_consensus.cc:1081] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:49.363250  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.364094  1609 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:49.364423  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.365097  1533 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:49.369032  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:49.372318  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.369400  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.377982  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:49.372067  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 174874us
I20260709 13:01:49.372030  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.370589  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.378608  1683 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:49.393077  1533 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:49.396652  1683 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.400261  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:49.395869  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.401279  1527 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:49.400213  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.402560  1674 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:49.403100  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.404590  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.404824  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.406044  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.406883  1683 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.413950  1683 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.413553  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.415104  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.318821  6465 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:49.414286  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.418577  1680 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:49.399649  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:49.414929  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.420250  2257 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:49.412536  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.346580  6372 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:49.416985  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.369699  6263 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.429191  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.409591  6467 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.430114  6467 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.430826  5954 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.432583  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.433171  2259 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:49.434160  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.435246  6418 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.424299  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.425071  4933 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:49.423794  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.426411  6516 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.398175  6520 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.436357  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2280) took 1426 ms. Trace:
I20260709 13:01:49.398626  5929 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.443399  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.446133  1609 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:49.423863  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.425576  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.448992  4933 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:49.449271  4933 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.449506  4933 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.452943  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.453629  1529 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:49.454088  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:49.435331  6506 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.080s	user 0.004s	sys 0.022s
I20260709 13:01:49.454557  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.460774  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.461287  1526 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:49.456168  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.463339  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.452961  1533 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:49.458112  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.459151  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.459178  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.441884  1528 rpcz_store.cc:276] 0709 13:01:48.001946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.036011 (+ 34065us) service_pool.cc:224] Handling call
0709 13:01:48.036379 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.036703 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.036729 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.058500 (+ 21771us) log.cc:844] Serialized 52 byte log entry
0709 13:01:48.164823 (+106323us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:48.279112 (+114289us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.282209 (+  3097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.282296 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.325906 (+1043610us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:01:49.421528 (+ 95622us) raft_consensus.cc:1685] finished
0709 13:01:49.428102 (+  6574us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.428270 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25987,"prepare.queue_time_us":197329,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":10236,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":1984,"spinlock_wait_cycles":4701952,"thread_start_us":162582,"threads_started":2,"wal-append.queue_time_us":188099}
I20260709 13:01:49.467836  1679 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:49.464824  1525 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:49.432116  6467 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.418334  6465 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:49.470402  1674 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:49.369894  5833 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:49.471052  1605 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:49.472319  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.472488  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:49.472666  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.473762  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.453367  6263 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.482509  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.483843  6481 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.474220  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.465531  1527 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 7.
I20260709 13:01:49.476148  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.485525  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.485844  6016 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.484265  6481 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.486606  6482 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.489084  5833 consensus_queue.cc:1243] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:49.475374  6398 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.484508  6432 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:49.490731  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.533146  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.533349  1675 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:49.491106  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.490731  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:49.491791  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44456
I20260709 13:01:49.535332  1607 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:49.535883  1607 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.491899  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.497025  6465 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.504832  5927 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.486673  6408 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.507295  6535 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.459558  6516 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.469755  5929 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.484649  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.512458  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.515739  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.581996  5929 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.480641  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.583669  1674 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:49.521569  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:49.584672  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66743.8us
I20260709 13:01:49.586268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:49.589046  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73394.5us
I20260709 13:01:49.525542  4933 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.526160  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.592574  6496 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:49.592726  1681 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:49.520105  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:49.594009  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73998.2us
I20260709 13:01:49.595036  6466 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:49.595489  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.468772  6526 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.597183  5833 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:49.597486  6473 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:49.598548  5833 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:49.598856  6489 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:49.592479  6483 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:49.596637  6526 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.469069  6520 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.599772  6483 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.600284  1530 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:49.600906  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.601727  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.601894  6520 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.526875  6481 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.596516  6488 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.595638  6466 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.598454  6473 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.603672  6473 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.604058  6473 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.604621  6466 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.606520  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.536706  1601 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 7.
I20260709 13:01:49.608398  5833 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.609261  5833 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.611097  5833 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.455372  6372 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.612543  6306 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:49.601184  6526 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.613030  6372 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.435874  6418 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.484112  6263 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.535346  1527 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:49.558668  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.525125  6223 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.539986  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.599275  6489 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.525323  6386 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.571091  6534 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.572088  1682 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:49.576954  6465 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.577294  5927 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.578166  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.580156  6516 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:49.593163  6496 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.650424  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.602200  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.618454  1606 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 7.
I20260709 13:01:49.568686  6374 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.567437  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:49.620369  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.657359  1674 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:49.656876  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.628492  1683 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 13:01:49.629652  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 91199.7us
I20260709 13:01:49.633476  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:49.659271  1683 pending_rounds.cc:85] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 8
I20260709 13:01:49.659698  1683 pending_rounds.cc:107] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:49.631055  1607 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.635705  1682 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:49.637140  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.660919  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.638635  4933 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.532996  6432 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.532698  6398 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.641899  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:49.660007  1683 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.659993  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.661672  1606 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:49.618042  6418 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.618219  6223 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.660247  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:49.667579  6398 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.619089  6489 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:49.687897  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.632977  6386 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.648459  6259 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:01:49.672900  6432 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.674855  6536 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.758266  1607 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:49.675724  6423 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:49.754436  6386 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.752493  6543 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.784520  6543 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.674655  6473 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.656629  6496 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.642648  6464 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:49.800791  6464 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.779948   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:49.712121  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.803105  6464 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:49.803046  6448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.014s	sys 0.036s
W20260709 13:01:49.803854  6448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.036s
W20260709 13:01:49.713052  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.011s	sys 0.014s
I20260709 13:01:49.642867  6359 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.669971  6481 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.804425  6359 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.806082  6481 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:49.806455  6359 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:49.777678  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 117503us
I20260709 13:01:49.708076  6223 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.801355  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:49.786464  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.632225  6408 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.788527  6423 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.788813  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.789785  6516 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.792860  6370 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.781917  6489 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.752521  6451 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.643512  6534 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.687727  5929 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:01:49.680655  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:49.813541  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:49.811666  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:49.838531  1678 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:49.816998  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.687127  6374 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.890479  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:49.779749  6531 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:49.938951  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 258465us
I20260709 13:01:49.898270  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.899112  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.903100  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.885080  6423 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.768219  6418 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:49.934866  2255 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:49.947304  1607 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:49.910362  6404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.015s	sys 0.016s
I20260709 13:01:49.949735  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:49.946264  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 132815us
I20260709 13:01:49.886324  6370 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:49.889374  6516 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:49.954937  1606 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
W20260709 13:01:49.897033  6403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.001s	sys 0.027s
I20260709 13:01:49.943576  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.951494  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:49.959693  1499 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:49.960186  1602 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.767848  6536 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:49.960237  1600 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:49.965708  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.969754  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.970445  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.967392  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:01:49.953439  6404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.015s	sys 0.017s
I20260709 13:01:49.972393  5858 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:49.954483  6362 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.952222  6539 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.910490  6161 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:01:49.977676  1602 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:49.981235  6263 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:49.984570  6373 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.646s	user 0.003s	sys 0.008s
I20260709 13:01:49.999436  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.000248  6016 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:50.002327  6386 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:49.975014  6403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.002s	sys 0.027s
I20260709 13:01:49.963075  6370 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.912199  6451 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.028710  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:49.973369  6535 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.966220  6526 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:50.028716  1573 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:49.954239  6418 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:50.075619  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47016.9us
I20260709 13:01:50.076558  1573 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:50.076799  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 77495.2us
I20260709 13:01:50.077452  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.078441  1573 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.041054  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2342) took 2804 ms. Trace:
W20260709 13:01:50.041352  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 340131us
W20260709 13:01:50.040927  1533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.015s
W20260709 13:01:50.081971  1533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.016s	sys 0.016s
I20260709 13:01:50.023355  6362 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:50.070181  1602 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.033492  6263 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.027002  5858 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.085562  6263 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.087122  5858 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.035627  6016 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:50.090127  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.823s (SENT) [suppressed 17 similar messages]
I20260709 13:01:50.085003  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.080176  6116 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.079293  1534 rpcz_store.cc:276] 0709 13:01:47.237038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.278085 (+ 41047us) service_pool.cc:224] Handling call
0709 13:01:47.278419 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.196755 (+1918336us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:49.204952 (+  8197us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.807509 (+602557us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.807659 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.807701 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:49.807744 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.040796 (+233052us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54003052d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:50.040861 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.040995 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11422,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2577,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9913,"spinlock_wait_cycles":4436538880,"thread_start_us":599137,"threads_started":1,"wal-append.queue_time_us":758825}
I20260709 13:01:50.071427  6473 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.120810  6408 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.096987  6481 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.082846  6359 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.038573  6373 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.123543  6373 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.100987  5954 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.110260  6386 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.110940  6374 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.088553  6362 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.097491  6467 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.088462  6478 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.099682  6016 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.105813  6306 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.115316  6534 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.108479  6543 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.131881  6373 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:50.130508  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.110035  6526 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:50.135077  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.027s
W20260709 13:01:50.154565  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.146075  6306 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:50.154605  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.027s
I20260709 13:01:50.154197  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.163757  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.151160  6543 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.138161  6398 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.175961  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.180559  1677 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.157608  6464 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.128723  6496 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.185909  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.188661  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.152141  6432 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.153913  6534 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:01:50.180779  5954 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.202119  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.175854  6404 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.152842  6373 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.192436  6374 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.214148  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:50.214980  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 258290us
I20260709 13:01:50.220813  1605 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:50.224670  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.225289  1529 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:50.225747  1529 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:01:50.236976  6560 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:50.223829  6223 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.239637  6223 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.240557  2256 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.244606  6564 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:50.209715  6404 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.245529  6564 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.247742  6404 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.230566  1529 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.218091  6374 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:50.221688  5954 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.255410  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.223174  6478 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.279884  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.280683  1675 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:50.271553  6559 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:50.295924  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.296644  1679 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:50.267510  6432 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.298159  6373 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.272140  6374 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.225682  6536 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.278790  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.190887  6464 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.281273  5954 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:01:50.281925  6543 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:50.267246  6564 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:50.275544  6553 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:01:50.278517  6551 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:01:50.260821  6451 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.289961  6526 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.303269  6543 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:50.307472  6543 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.309652  6398 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.254149  6370 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.315215  6370 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.316011  1676 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:50.277305  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 174809us
I20260709 13:01:50.272404  6418 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:50.301460  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.320235  6423 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.321580  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.322223  1527 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:50.322578  6423 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.302278  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.322173  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.326535  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.327077  2257 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.329800  1677 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:50.330013  1676 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:50.331954  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.335137  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.336771  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.337150  6496 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.309356  6362 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.339426  6362 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.340880  6464 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.342525  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.342856  6306 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.343902  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.355944  6564 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:50.356596  2258 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:50.334585  6398 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:50.346131  6483 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.348018  6489 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.350222  1682 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.369499  1682 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:50.353035  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.355751  2227 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.357607  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.362284  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.371183  1534 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.371770  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.368901  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.373950  6362 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:50.374445  6362 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.374699  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.376456  6362 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.306797  6516 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.379472  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.381027  1534 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:50.380963  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.306946  6263 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.382465  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.383307  6263 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.383446  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.384119  1675 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:50.384685  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.384845  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.385236  1677 raft_consensus.cc:2376] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14. Re-sending same reply.
I20260709 13:01:50.385831  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.386080  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.386682  1677 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:50.386871  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.387741  6464 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.368829  6489 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:50.388896  6223 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.389158  1675 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:50.357546  6398 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.391235  6398 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.392598  1683 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:50.358147  6451 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.394639  1682 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:50.395051  1682 pending_rounds.cc:85] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 10
I20260709 13:01:50.395268  1682 pending_rounds.cc:107] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:50.395509  1682 raft_consensus.cc:2889] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.401620  1601 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.402057  2257 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:50.403728  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.407020  1677 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:50.322147  6539 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:50.376220  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:50.407645  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 702) took 1026 ms. Trace:
I20260709 13:01:50.409373  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.410928  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.409373  1500 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.409762  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:50.412467  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47572.1us
I20260709 13:01:50.410218  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.414971  2260 raft_consensus.cc:2410] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:50.417166  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.410307  1682 rpcz_store.cc:276] 0709 13:01:49.380176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.380317 (+   141us) service_pool.cc:224] Handling call
0709 13:01:49.416818 (+ 36501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.571920 (+155102us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540015b6a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:01:50.349845 (+777925us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540015b6a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aaf06f 00007f7e63b27f60 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62
0709 13:01:50.406318 (+ 56473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.406984 (+   666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533969408}
I20260709 13:01:50.423576  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.424240  1527 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.424868  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.423632  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.426033  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:50.408360  6390 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:01:50.424180  6464 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.419744  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.430333  1532 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.430882  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.431427  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.433084  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.431720  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.428999  6570 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:50.438390  6570 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:50.438748  6570 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.440773  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.442315  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.442888  2259 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:01:50.421550  6483 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:50.425294  6373 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.444082  6483 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.445297  6483 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.448473  6439 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.448935  6439 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:50.449288  6439 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.450021  5954 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.432734  6539 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.451203  2258 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:50.388886  6489 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.452343  6526 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:50.453141  6489 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.453706  6223 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.373592  6016 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.458073  6016 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.459491  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.460541  1533 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:50.459756  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.461443  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.460566  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.467211  6488 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.470940  6539 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.473654  6306 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:50.476871  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45223.9us
I20260709 13:01:50.477561  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.477774  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.478015  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.478678  1532 raft_consensus.cc:2368] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:50.466416  1604 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.480829  1532 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.481096  2260 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:50.482074  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.482831  2258 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:50.482952  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.483656  1606 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.488708  1648 leader_election.cc:400] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:50.484925  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.505687  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.504278  1648 leader_election.cc:403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:50.489962  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:50.512183  1527 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:50.514515  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.516180  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.516958  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 840) took 1004 ms. Trace:
I20260709 13:01:50.517344  1532 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:50.519068  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:50.488957  6306 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:50.520655  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.521111  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.521309  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.517313  1605 rpcz_store.cc:276] 0709 13:01:49.512219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.512431 (+   212us) service_pool.cc:224] Handling call
0709 13:01:49.512739 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.222857 (+710118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.516718 (+293861us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540011dad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:50.516902 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620643072}
I20260709 13:01:50.499184  6223 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.527179  6223 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.527638  6418 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.528102  6418 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:50.528330  6558 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:01:50.528478  6418 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.529320  6223 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.525352  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.530323  1604 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:01:50.525985  1609 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.526417  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.510790  6439 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.530961  1529 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.532570  1606 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.533999  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.534502  1681 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:50.506064  6570 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.512095  6526 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:50.503968  5954 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:50.537793  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:50.512497  6489 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:50.533035  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:50.539341  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:50.525888  5927 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.534888  6398 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.566689  1499 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.548362  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.568544  1532 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.548602  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.557554  1606 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:50.568611  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:50.573072  1606 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:50.573808  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.544664  6306 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:50.576134  1609 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:50.546933  6451 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.563431  6263 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:50.575784  6403 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.587077  6263 consensus_queue.cc:1243] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:50.561169  6375 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.577154  1606 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.546386  6526 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:50.560253  6565 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.539666  6370 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:50.582332  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.581403  6432 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.583783  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.571750  6568 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:50.589212  1532 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:50.593529  6375 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.587343  1601 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:50.539490  6259 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:50.579541  6448 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:50.610777  2253 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:50.609949  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.606324  6375 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.567852  6374 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.623114  5833 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:50.571255  6516 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:50.594693  6439 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.594457  5954 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:50.627507  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 79010.6us
I20260709 13:01:50.628476  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.601064  6565 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.629364  1529 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:50.633910  1674 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:01:50.614881  6412 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.594249  6569 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:01:50.619179  6403 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.660507  6403 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.660919  6403 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.661042  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.661440  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.661798  1607 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.616129  6432 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.626037  6448 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:50.666025  6418 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.666635  6448 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.652453  6412 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.669934  6374 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.671504  6412 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.673125  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.673983  2258 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:50.678522  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.681641  6418 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.690274  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.690969  2260 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.692677  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.693464  1531 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:50.693084  6403 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.694320  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.694746  2258 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:50.695182  1532 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:50.696354  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 911) took 1339 ms. Trace:
I20260709 13:01:50.696719  1530 rpcz_store.cc:276] 0709 13:01:49.356623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.357091 (+   468us) service_pool.cc:224] Handling call
0709 13:01:50.696121 (+1339030us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540042c7d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:50.696248 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469989248}
I20260709 13:01:50.634137  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.618193  6304 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:50.704717  6304 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:50.705752  6304 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:50.641788  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.643165  6375 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.709959  6362 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:50.710419  6375 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.710659  6362 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.628463  6161 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:01:50.712563  6161 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.712918  6161 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:50.713794  6161 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.651173  6306 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.619539  6568 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:50.716729  6568 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.714378  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.711532  6375 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:50.704967  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70908.2us
I20260709 13:01:50.722545  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.722941  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.724174  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:50.724673  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.724911  1606 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:50.726022  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.727372  1609 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:50.728011  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.728854  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.729494  1607 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:50.730660  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.731344  1609 raft_consensus.cc:2368] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:50.728852  6256 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.653329  6526 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.734609  6404 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.735013  6404 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:50.636729  6565 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.726016  6539 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.611060  6543 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.740442  1602 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:50.628589  5833 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:50.729435  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.742708  6417 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:50.743731  6539 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.743454  6417 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.744966  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.746115  1680 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.747334  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.748013  6573 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:50.748131  6390 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.665442  6432 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.750000  6539 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.750778  6362 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.659937  6570 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.754900  6161 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.741506  5833 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.746176  6417 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.757364  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.758527  1683 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:50.740257  1681 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:50.658368  6483 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.764470  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.760094  5833 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.766952  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.767951  6481 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.767753  1609 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.768847  6386 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:50.770304  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46296.2us
I20260709 13:01:50.770638  6481 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:50.771174  6481 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:50.772068  6481 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.772625  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.748449  6573 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:50.768625  6375 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.773655  6573 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.774320  6534 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.735845  6404 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.776300  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:50.777263  6534 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.768702  1601 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:50.778154  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.777467  2253 pending_rounds.cc:85] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 10
I20260709 13:01:50.779203  2253 pending_rounds.cc:107] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:50.779488  2253 raft_consensus.cc:2889] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.779770  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.781205  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.782081  1606 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:50.782920  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.784351  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:50.785032  1609 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.783138  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:50.766963  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 44108.2us
I20260709 13:01:50.788060  1600 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.789670  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.775090  6573 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.794835  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:50.765573  1676 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:50.795579  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.796187  2258 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:01:50.797992  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.798552  1528 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.798660  1606 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:50.799229  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.799703  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:50.798062  1533 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.802500  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.801745  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:50.789741  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.766376  6403 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:50.804888  1603 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:50.806125  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:50.806300  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:50.807718  1528 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:50.808216  2260 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:01:50.808636  2257 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:50.809288  1649 leader_election.cc:400] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:50.801954  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:50.812747  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.814262  1683 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:50.818109  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.741508  6543 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.822834  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.814100  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:50.827419  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.834599  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.835536  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.836880  1676 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.785205  6534 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.787757  6386 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.847344  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.840178  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.843151  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.844426  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.844024  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:50.846055  2256 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:50.790710  6263 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.853566  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.856618  1533 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:50.817147  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:50.857164  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.862107  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.861828  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.863281  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:50.860103  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.865000  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:50.865751  1533 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 8: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:50.866513  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49423.4us
I20260709 13:01:50.822223  6256 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.821414  6545 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.838032  6417 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:50.876070  1609 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:50.886579  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:50.887600  1528 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.901006  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.851444  6529 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:50.811527  6482 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:50.914710  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 2359) took 1398 ms. Trace:
I20260709 13:01:50.889119  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.890898  6374 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:50.895819  5833 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.896732  5927 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.787493  6412 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:50.848157  6534 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.922928  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:50.900801  6423 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:50.917294  1604 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.902050  6417 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:50.916996  1529 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:50.910455  6384 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:50.887713  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.854668   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:50.939263  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51634.2us
I20260709 13:01:50.915126  1525 rpcz_store.cc:276] 0709 13:01:49.515847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.515966 (+   119us) service_pool.cc:224] Handling call
0709 13:01:49.520879 (+  4913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.911157 (+390278us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:49.948844 (+ 37687us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.279799 (+330955us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18004a59c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf 00007f7e63b4b038
0709 13:01:50.279979 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.299696 (+ 19717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.299748 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:50.299797 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.584105 (+284308us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18004a59c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:50.860453 (+276348us) spinlock_profiling.cc:243] Waited 870 us on lock 0x7b18004a59c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419
0709 13:01:50.914479 (+ 54026us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540043c954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:50.914527 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.914650 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24384,"prepare.queue_time_us":676911,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":20818,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":36427,"spinlock_wait_cycles":907560704,"thread_start_us":201903,"threads_started":1,"wal-append.queue_time_us":286206}
I20260709 13:01:50.906538  6536 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.927666  1608 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.920706  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.941581  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:50.952075  6432 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.971454  6304 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:50.972097  6304 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:50.973016  6304 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.980679  6564 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.926247  5927 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.983876  5927 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.985850  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:50.986503  1678 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:50.988004  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:50.988230  6403 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.988700  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:50.989225  6403 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.990490  6483 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:50.991976  6520 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.992489  6520 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.992684  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:50.993525  2260 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:50.994854  6403 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:50.918169  6529 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:50.925478  6451 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:50.996500  6451 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:50.997506  6451 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.001672  5833 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:51.002364  5833 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.004633  5833 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:51.006992  6403 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:51.007608  6403 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:50.938467  6417 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.938079  6423 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:50.910913  6359 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:01:51.013757  6359 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.014128  6359 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:51.014998  6359 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.020869  6359 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.141835  1601 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:50.911835  6569 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:51.022135  6488 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.026762  6384 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:51.030378  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.030757  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.031575  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.032645  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:51.153329  2259 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 8: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:51.031536  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.041456  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:51.042066  6404 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.044209  6403 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:51.052685  6529 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.061142  6423 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.075606  6565 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.080722  6451 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.081951  6520 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.087891  5954 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.092792  6564 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:51.109449  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:51.112030  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:51.114029  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 81858.4us
I20260709 13:01:51.143567  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.186935  1677 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:51.144256  6161 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:51.188133  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44681.7us
I20260709 13:01:51.150194  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:51.152381  2256 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:51.161826  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.192759  1529 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:51.162876  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.163638  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.143875  6439 raft_consensus.cc:2764] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:51.171694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:51.174026  5833 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:51.208031  5833 consensus_queue.cc:1243] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:51.199656  1528 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:51.165416  6478 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:51.228286  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:51.206684  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:51.169869  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 181955us
I20260709 13:01:51.226981  1604 raft_consensus.cc:2368] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:51.229346  1648 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.234383  1681 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12.
I20260709 13:01:51.239784  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.243441  5833 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.151153  6488 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:51.176666  6423 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:51.254125  6423 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.250152  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:51.197916  6465 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.198314  6564 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.175457  5954 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:51.229852  6569 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:51.242398  6390 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.249552  6476 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.260066  6480 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:51.290937  6423 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:51.269999  6465 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.235831  6161 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.256570  6482 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:51.282799  6390 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.328088  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.304430  6569 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:51.313184  6465 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.288966  6384 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.314337  6483 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.311208  6480 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:51.347535  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 480325us
I20260709 13:01:51.367843  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:51.369455  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.370793  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.306586  6534 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.373925  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:51.347327  6448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.015s
I20260709 13:01:51.344528  6390 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.371068  6432 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.379642  2261 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:51.386361  2261 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:51.380290  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:51.382465  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.387060  2261 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.392779  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.361941  6483 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:51.377130  6448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.015s
I20260709 13:01:51.396166  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.373389  6476 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:01:51.330302  6417 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.373140  6403 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:51.385447  6543 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:51.410931  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 160854us
I20260709 13:01:51.395364  6306 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.411580  6483 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.384089  6386 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:01:51.426641  1500 leader_election.cc:400] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:51.428463  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:51.418851  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.428833  1500 leader_election.cc:403] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.429229  2259 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.371948  5954 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.431303  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:51.436337  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.381175  6488 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.418378  6565 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:51.420583  6306 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.418845  6568 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.420490  6403 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:51.421967  6476 consensus_queue.cc:1243] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:01:51.505807  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 121671us
I20260709 13:01:51.432737  6161 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:51.509933  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 128318us
I20260709 13:01:51.442008  6373 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.441691  6016 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.514220  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:51.516889  6467 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:51.407956  6480 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.410247  6569 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.458740  6534 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:51.522400  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 103618us
W20260709 13:01:51.516893  6581 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:51.550450  1528 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.551074  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:51.559834  1529 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:01:51.520643  6583 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:01:51.560750  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123128us
I20260709 13:01:51.550630  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.509652  6590 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.519039  6016 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.541527  6579 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:51.533461  6386 consensus_queue.cc:1243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:51.563210  1528 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:51.572903  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:51.542140  6573 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.000s
I20260709 13:01:51.564146  1525 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:01:51.560467  6589 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:01:51.533296  6375 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:51.574131  6598 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:51.574854  6588 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:01:51.586865  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:51.591059  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.533241  6467 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.571763  6016 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.594237  1608 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12.
I20260709 13:01:51.574007  6526 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.597918  6594 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:01:51.598490  6467 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.599014  6185 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:51.592437  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.603747  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.604749  6403 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.605262  6483 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:51.613402  6587 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:01:51.615123  2227 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12.
I20260709 13:01:51.615468  2227 leader_election.cc:403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.613272  6539 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.620023  1683 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:51.608022  6530 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.584784  6375 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.622676  6375 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.625694  6465 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.627833  6465 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.629648  6417 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:51.630278  6592 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 13:01:51.592344  6529 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.640012  2259 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:51.592231  6598 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:51.614193  6591 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:01:51.646322  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:51.659246  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:51.660825  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.657687  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.676003  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:51.677014  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:51.679821  1606 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:51.682229  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:51.682742  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:51.683492  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:51.684244  1675 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:51.685315  1674 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:51.687386  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:51.688007  1675 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:51.680776  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67705.6us
I20260709 13:01:51.689273  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:51.652473  6417 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12.
W20260709 13:01:51.665410  6359 consensus_meta.cc:287] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.007s
I20260709 13:01:51.691748  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:51.693588  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:51.690805  6603 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:51.691337  6423 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.695853  6529 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.696285  6602 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:51.696556  6599 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.697244  6483 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.699450  6598 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:51.700029  6304 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:51.702044  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:51.702862  1603 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:51.705199  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.706868  1675 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:51.668206  6386 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:51.708416  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.695034  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:51.722607  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.723944  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.703714  6568 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.771893  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 44675.3us
I20260709 13:01:51.815347  6306 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:51.727675  6386 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:51.820557  6386 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.711308  6359 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:51.829438  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 121117us
I20260709 13:01:51.830646  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:51.831489  2253 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:51.840736  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:51.726739  6481 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.774566  6602 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.728878  6304 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.918534  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:51.919021  1530 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:51.772953  6599 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.903430  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:51.766314  6390 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:51.920215  6306 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.774365  6564 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:52.002640  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50540.5us
I20260709 13:01:51.918840  6606 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.939101  6465 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.192s
W20260709 13:01:52.122327  6615 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:01:51.957717  6161 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:52.123087  6161 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.125187  6161 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:51.939239  6599 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.140895  6599 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:52.151068  6373 consensus_meta.cc:287] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.003s
I20260709 13:01:52.151559  6373 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12.
I20260709 13:01:51.902813  6359 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:51.965633  6481 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.175806  2259 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.177789  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.084868  6306 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:52.182025  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.012s	sys 0.023s
W20260709 13:01:52.191947  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.023s
W20260709 13:01:52.192507  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 630337us
I20260709 13:01:52.232439  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.233278  1680 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:52.236506  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:52.241191  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 140293us
I20260709 13:01:52.180714  6384 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.220122  6306 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.219877  6481 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:52.222105  6161 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:52.260797  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.282701  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:52.284207  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46326.2us
I20260709 13:01:52.291935  1674 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:52.303321  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:52.257726  6404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.022s	sys 0.043s
I20260709 13:01:52.261906  6568 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.310415  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.311194  1609 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:52.255344  6623 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.268384  6375 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.255021  6609 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.247052  6451 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:52.245517  6601 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:01:52.309243  6404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.023s	sys 0.043s
W20260709 13:01:52.315228  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 78823.5us
I20260709 13:01:52.247437  6386 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:01:52.287323  6573 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.254022  6384 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.312558  5927 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.287932  6161 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.322721  6412 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.326524  6373 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.324126  6609 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.317260  6568 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.321741  6375 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.360003  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:52.383862  1604 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:52.383118  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 716) took 1567 ms. Trace:
I20260709 13:01:52.365536  6628 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.358676  6634 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:52.359228  6530 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:52.359151  6465 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.281867   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.373018  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1140) took 1724 ms. Trace:
I20260709 13:01:52.389592  1683 rpcz_store.cc:276] 0709 13:01:50.817592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.817710 (+   118us) service_pool.cc:224] Handling call
0709 13:01:52.382913 (+1565203us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54001d9f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:52.383060 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842043776}
I20260709 13:01:52.338697  6603 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.319923  6623 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.338397  6451 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.380884  6390 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.382959  6564 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.383430  6359 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:52.410961  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 106290us
I20260709 13:01:52.392514  6628 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.402437  6530 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.468968  6628 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.400527  2255 rpcz_store.cc:276] 0709 13:01:50.648469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.648638 (+   169us) service_pool.cc:224] Handling call
0709 13:01:50.648995 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.649387 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.649416 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.650139 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.975108 (+324969us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:50.975146 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.975209 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.372175 (+1396966us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b24002fbbc8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a82fb0 00007f7e636f9488 00007f7e636f9be8 00007f7e636d1398 00007f7e636cc76a 00007f7e636cbbb6
0709 13:01:52.372692 (+   517us) raft_consensus.cc:1685] finished
0709 13:01:52.372715 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.372960 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1376,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":10529536,"thread_start_us":324583,"threads_started":1,"wal-append.queue_time_us":597343}
W20260709 13:01:52.469331  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 187) took 22808 ms (client timeout 15000 ms). Trace:
I20260709 13:01:52.384902  6609 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.471967  6623 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:52.380198  6016 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.000s
I20260709 13:01:52.414896  6599 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.384891  6384 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.368657  6412 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.403829  6634 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.372473  6373 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.337320  6481 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.332537  6573 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.473403  6568 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:52.474706  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 718) took 1655 ms (client timeout 1775 ms). Trace:
I20260709 13:01:52.455111  6631 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.414705  6161 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.476357  6375 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:52.479342  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 176090us
I20260709 13:01:52.484885  1608 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:52.488140  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.336961  5927 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:52.476438  6602 consensus_meta.cc:287] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.006s
I20260709 13:01:52.474948  6530 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:52.496101  1681 rpcz_store.cc:269] 0709 13:01:50.819432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.822506 (+  3074us) service_pool.cc:224] Handling call
0709 13:01:52.474499 (+1651993us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:52.474642 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944345984}
I20260709 13:01:52.494361  6623 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:52.498076  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.490718  6390 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.483001  6423 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.483129  6609 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.500919  6384 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.509174  1533 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:52.524400  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.509552  1528 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:52.494220  6451 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.455983  6603 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.521054  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:52.523303  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.509632  6423 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.501470  6631 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.518767  6412 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.504386  6606 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.507692  6602 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.520541  6599 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.505157  6568 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.508901  6623 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.509840  6609 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.503363  6643 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.535467  6609 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.535688  6643 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.512413  6647 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.537214  6647 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.538400  6643 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.507452  5927 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:52.542834  6584 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.206s	user 0.010s	sys 0.017s
I20260709 13:01:52.544242  6643 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:52.545873  1606 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:52.539359  6647 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.547047  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.551191  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.490582  6016 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.553452  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.554176  6016 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.554885  1525 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:52.555895  6588 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:52.511126  6636 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.523484  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.527787  1532 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.548120  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.522193  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.532523  1602 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:52.512256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.525254  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:52.525399  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.569154  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.570407  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.571048  1532 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:01:52.572606  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.571380  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.574208  1649 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.509413  6390 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.510125  6384 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.579690  6603 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.531750  6606 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.582257  6606 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:52.517542  6634 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.535034  6623 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.529702  6161 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:01:52.585747  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.586975  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.578349  6390 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.587150  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:52.580528  1609 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:52.533377  6306 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.580490  6384 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.590451  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.594856  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.595530  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.600435  1532 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:52.600839  1527 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:52.595829  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.597114  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.601899  1528 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:52.598111  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.599347  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.601213  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.604213  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:52.604275  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.605036  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:52.605670  1603 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.531032  6423 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.511271  6373 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.529222  6451 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.597327  6643 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.613076  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.613636  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.613721  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.618557  1677 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:52.614037  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.619544  1680 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:52.532492  6631 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.617444  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.599421  6263 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.607102  6384 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.613677  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.615713  6646 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.569075  6523 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:52.617712  6390 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:52.532963  6568 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.626097  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:52.633167  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 306906us
I20260709 13:01:52.634716  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.616640  6404 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.639544  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.572785  6636 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.642300  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:52.643754  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.644599  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.644640  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:52.647651  6263 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.648718  6306 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.638615  6643 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:52.652928  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.654317  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.654989  2255 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:52.635624  6646 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.655978  6481 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.656447  6481 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.656827  6481 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:52.469771  1425 rpcz_store.cc:269] 0709 13:01:29.660436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.661462 (+  1026us) service_pool.cc:224] Handling call
0709 13:01:52.469098 (+22807636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:44.073416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:44.078875 (+  5459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:44.078940 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:01:44.078975 (+    35us) tablet.cc:662] Decoding operations
0709 13:01:44.082415 (+  3440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:44.082514 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:44.082546 (+    32us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:44.083932 (+  1386us) tablet.cc:701] Row locks acquired
0709 13:01:44.083994 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:01:44.084170 (+   176us) write_op.cc:270] Start()
0709 13:01:44.122365 (+ 38195us) write_op.cc:276] Timestamp: P: 1783602104084101 usec, L: 0
0709 13:01:44.130359 (+  7994us) op_driver.cc:348] REPLICATION: starting
0709 13:01:44.421143 (+290784us) log.cc:844] Serialized 6466 byte log entry
0709 13:01:44.884478 (+463335us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b
0709 13:01:45.527457 (+642979us) op_driver.cc:464] REPLICATION: finished
0709 13:01:45.960079 (+432622us) write_op.cc:301] APPLY: starting
0709 13:01:45.968859 (+  8780us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:47.206659 (+1237800us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b18004628e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e63870129 00007f7e638bcc0a 00007f7e638bc4f7 00007f7e638bc490 00007f7e63873f48 00007f7e675881bb 00007f7e67588532 00007f7e675cfb93 00007f7e6747cde3
0709 13:01:47.352344 (+145685us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:47.352387 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:47.913914 (+561527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:47.914227 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:01:47.914283 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:47.914676 (+   393us) log.cc:844] Serialized 148 byte log entry
0709 13:01:48.092508 (+177832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.105683 (+ 13175us) write_op.cc:454] Released schema lock
0709 13:01:48.134357 (+ 28674us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:49.134633 (+1000276us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b18004628e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:01:49.134743 (+   110us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.134768 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":13346,"mutex_wait_us":57076,"reported_tablets":35,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":274376,"apply.run_cpu_time_us":50808,"apply.run_wall_time_us":2258187,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71167,"num_ops":16,"prepare.queue_time_us":344203,"prepare.run_cpu_time_us":34838,"prepare.run_wall_time_us":1140112,"raft.queue_time_us":99146,"raft.run_cpu_time_us":25695,"raft.run_wall_time_us":260194,"replication_time_us":1377869,"spinlock_wait_cycles":39208704,"thread_start_us":1251374,"threads_started":5,"wal-append.queue_time_us":1097876,"wal-append.run_cpu_time_us":46551,"wal-append.run_wall_time_us":2556581}]]}
I20260709 13:01:52.657500  6646 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.641494  6404 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.656725  6478 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.660573  1681 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:52.660882  6478 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.662680  6606 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.663666  6606 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.665283  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.641023  6647 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:52.673117  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.668044  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.673902  1608 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:52.669319  6451 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.664201  6606 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.664093  6161 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.676885  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.652837  6390 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:52.653033  6185 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.678660  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.679785  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.664687  6643 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:52.679207  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.683522  2257 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:52.678917  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:52.688540  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.689437  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.690011  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.691272  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.691562  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:52.681344  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.672345  6375 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.700405  6603 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.680276  6639 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.680238  6635 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:52.705940  6636 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.689929  6573 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.706017  6635 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.707192  6635 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.708185  6606 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.709717  6568 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.700702  6375 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.712774  6375 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.672358  6647 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.714499  6647 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.717135  6597 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.685544  1603 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:52.717746  6597 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.677698  6404 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.719440  6606 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.719782  6404 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.720407  6404 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.691820  1526 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.690733  1530 raft_consensus.cc:2410] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:52.693038  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.723198  6570 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.725250  6570 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:52.725551  5927 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.725713  6570 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.726107  5927 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.726481  5927 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.728519  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.730347  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.731158  1530 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:52.731074  1680 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:52.732239  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.721050  6606 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.733036  1675 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:52.693214  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.636169  6384 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.735685  6606 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.687682  6263 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.695465  6653 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.676801  6622 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:52.739144  6653 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.740513  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.741207  1528 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:52.741503  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.696821  2253 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:52.743165  2253 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:52.697007  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:52.698328  6306 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:52.689354  6643 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.699213  6390 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.745047  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:52.765350  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 68419.4us
I20260709 13:01:52.746577  1675 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.692637  1531 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:52.754241  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.755337  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.757498  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.767920  1681 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:52.758167  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.758720  1608 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:52.771708  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.743981  2253 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.772845  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.774874  2253 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.775727  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.779151  6653 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.780189  6569 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.722452  6404 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.793133  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.790705  6384 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.791487  6597 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.791445  6635 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.783375  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.798559  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.799373  1680 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.754350  6306 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.772245  6639 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.806754  2253 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:52.811715  2258 raft_consensus.cc:2368] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:52.782546  6451 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:52.805465  6306 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.806520  6417 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.809814  6223 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:52.819860  1680 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:52.808670  6601 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.823594  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:01:52.808739  6629 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:01:52.825275  6565 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:52.825700  6565 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:52.829238  5927 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.830729  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.831346  5927 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.804418  6384 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:01:52.834985  6621 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.647s	user 0.000s	sys 0.003s
I20260709 13:01:52.836920  6622 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.836495  6601 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.849056  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:52.838054  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:52.848002  2257 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:52.851475  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.824592  1532 raft_consensus.cc:606] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:52.840497  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.841976  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:52.844527  2256 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:52.857281  1527 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.844619  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:52.845487  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.845996  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.846695  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.861223  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.841260  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:52.862030  2259 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:52.862349  1609 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.865203  2226 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12.
I20260709 13:01:52.824858  6417 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.866812  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.862619  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:52.868999  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:52.875190  1681 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:52.875912  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.876324  6543 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.875217  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.879866  1527 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:52.879396  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.826661  6565 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.881021  1680 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.885778  6451 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:52.886473  6451 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.887028  6578 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.887513  6578 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.887869  6578 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.883174  6480 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:52.891691  6480 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.893672  6565 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.894387  6488 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.848049  6635 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.881114  6417 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:52.895828  6656 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:01:52.896190  6626 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.863261  6598 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.899996  2252 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:52.822176  6478 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.885504  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.902915  1609 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:52.903735  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.903919  1678 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:52.823526  6570 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.905786  6601 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.848466  6622 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:52.867616  6639 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.846964  6481 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.877657  6263 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.911542  1603 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:52.870801  6629 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.920871  6626 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.926421  6629 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.926951  6629 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.913149  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.908890  6543 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:52.930286  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:52.914769  1604 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:52.916591  1677 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.919732  1683 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.928705  1680 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:52.913420  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:52.912123  6161 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:52.883359  6647 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.933315  1533 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:52.935812  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:52.942451  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:52.921173  6598 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.933238  6263 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.937848  6384 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.945430  6628 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:52.951290  6628 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:52.952170  6628 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.953626  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:52.953945  6601 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:52.954730  6590 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:52.955364  6590 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:52.957368  1681 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:52.947084  1678 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:52.924769  6390 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:52.948207  1683 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:52.950235  1675 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:52.948721  1679 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.916589  6403 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:52.932619  6622 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.968868  6622 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.970715  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.971382  1681 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:52.950662  6543 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.973989  1680 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:52.942239  6451 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.976653  2252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:52.977516  6570 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:52.977396  2252 raft_consensus.cc:606] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:52.980546  2252 raft_consensus.cc:614] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:52.980895  6626 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:52.984246  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.991161  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.992415  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:52.960458  6390 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:52.980012  6481 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:52.994457  1674 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:52.994776  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.993943  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.956614  6590 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:52.995240  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:52.996232  1678 raft_consensus.cc:2368] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:52.997452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:52.998217  1603 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:52.999687  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.000017  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:52.977344  6478 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.002931  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.003757  1680 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:52.983278  5927 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.009815  6595 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 13:01:53.019593  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:53.021337  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.022821  1681 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:53.023149  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.022145  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.026623  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.029732  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:53.030555  6536 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:53.030963  6223 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:53.031575  6223 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:53.032614  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.033171  6223 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.034770  6390 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.015219  5927 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.030675  6570 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:01:53.037496  6570 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:53.037870  6570 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:53.038658  6570 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.040040  6570 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.017807  6480 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.040959  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.051425  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:53.052239  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.054628  1499 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.053061  6362 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.055864  6362 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:53.058310  6362 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.058485  5858 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.059793  1499 leader_election.cc:400] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:53.055184  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82df41f800684066955da1e5fcf37da0"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:53.060348  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.048651  6598 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.055608  6597 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:53.062443  5858 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:53.064369  5858 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.066864  6306 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.068113  5858 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.068495  6451 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.032234  6643 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.048956  6536 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:53.071301  2257 raft_consensus.cc:606] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:53.062901  1499 leader_election.cc:403] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.084746  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:53.087419  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.072149  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.091141  2252 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:53.092630  1498 leader_election.cc:400] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:53.063666  6529 raft_consensus.cc:993] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:01:53.079268  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:53.115918  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.080036  6607 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.118026  1679 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.105623  6451 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.094381  6578 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.145679  6578 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.147394  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:53.125295  6483 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.124233  6480 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.149078  6480 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.149479  6480 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.151737  6653 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:53.153131  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:53.130656  6665 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:53.131174  6306 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.141924  6482 raft_consensus.cc:993] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:53.152292  6653 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.119288  6448 raft_consensus.cc:1081] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:01:53.148579  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.154155  1533 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.143519  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2334) took 1455 ms. Trace:
I20260709 13:01:53.183959  1600 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:53.187084  1525 rpcz_store.cc:276] 0709 13:01:51.687969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.688108 (+   139us) service_pool.cc:224] Handling call
0709 13:01:51.689095 (+   987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.555255 (+866160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.143289 (+588034us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54003066d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:53.143461 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990730112}
I20260709 13:01:53.120990  6607 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:53.197196  6639 raft_consensus.cc:1081] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:53.143718  6643 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.206586  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.209723  6417 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:53.210263  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:53.216156  2255 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.208173  6482 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:53.218945  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.226706  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.230230  1679 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:53.252694  6647 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.211544  6417 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.256505  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:53.263738  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:53.266408  1532 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:53.267998  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:53.274003  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.271270  1529 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:53.282547  6629 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.256196  6417 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.306780  2255 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:53.307534  2257 raft_consensus.cc:606] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:53.307909  2257 raft_consensus.cc:614] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:53.236550  6635 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:01:53.312177  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:53.277349  6451 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:01:53.323349  6306 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:53.324011  6306 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.324898  1682 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:53.325747  6480 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.326576  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 2411) took 1036 ms. Trace:
I20260709 13:01:53.326704  6306 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.326948  1682 rpcz_store.cc:276] 0709 13:01:52.290615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.291388 (+   773us) service_pool.cc:224] Handling call
0709 13:01:52.291669 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.324627 (+1032958us) spinlock_profiling.cc:243] Waited 922 us on lock 0x7b5400425020. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b33d87 00007f7e63b34470 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:01:53.325274 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.326357 (+  1083us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540007d5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:53.326520 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661800576}
I20260709 13:01:53.327777  6480 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.330021  6569 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.330607  6569 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.331501  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:53.332191  1529 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.332726  2256 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:53.334012  6362 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.341132  1529 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:53.348652  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:53.349794  6635 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:53.350345  6635 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:53.353585  6016 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:53.354090  6016 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:53.351233  6635 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.354923  6016 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.356020  6016 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.360739  5954 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:53.315606  6620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.010s	sys 0.010s
I20260709 13:01:53.368810  6629 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.373239  1683 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:53.369164  6620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.010s	sys 0.010s
I20260709 13:01:53.374886  6362 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.371953  5927 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.374920  6480 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:53.381485  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.383318  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:53.388442  1606 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:53.389371  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:53.390123  2254 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:53.389142  6465 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.392230  6465 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.397868  2254 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.405795  6465 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.414587  2253 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:53.417369  1529 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.428164  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.429598  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.432437  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.433271  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.435902  5954 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.431979  6465 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.445946  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.446269  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.446660  1604 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:53.448495  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.449704  2253 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:53.450032  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.452682  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82df41f800684066955da1e5fcf37da0"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:49526
I20260709 13:01:53.453333  1600 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.453711  1600 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.454457  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:53.455123  1609 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.461373  1683 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.466753  1609 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:53.477210  6600 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:53.477766  6600 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:53.478662  6600 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.479805  6600 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.458559  6465 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.442631  6645 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:53.481148  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.457449  6647 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:53.492869  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 416462us
I20260709 13:01:53.496105  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:53.459890  6620 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:01:53.506668  1607 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:53.507652  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:53.509879  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.511121  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.500110  6448 raft_consensus.cc:2764] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:01:53.514088  1600 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.515648  1603 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.516546  2253 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:53.516857  2253 pending_rounds.cc:85] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 11
I20260709 13:01:53.517055  2253 pending_rounds.cc:107] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:53.517247  2253 raft_consensus.cc:2889] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.528674  1600 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.529621  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.531322  1681 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:53.534934  1600 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:53.515512  6478 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.513338  6480 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.521160  6645 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.505745  6417 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:53.539127  6478 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.523636  6534 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:53.542326  6645 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.557155  6263 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.558347  6564 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:53.558748  6564 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:53.555934  6478 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.564074  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 2323) took 1038 ms. Trace:
I20260709 13:01:53.565434  1606 rpcz_store.cc:276] 0709 13:01:52.525797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.547898 (+ 22101us) service_pool.cc:224] Handling call
0709 13:01:53.563848 (+1015950us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540034a3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:01:53.563999 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904208128}
I20260709 13:01:53.576227  1649 leader_election.cc:400] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:53.576623  1649 leader_election.cc:403] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.561700  6645 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.559545  6564 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.589468  6636 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:53.578824  6643 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:53.578603  6620 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:53.601186  5954 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.602324  6564 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.618821  1604 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:53.626986  6658 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.627502  6658 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:53.628465  6658 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.629709  6658 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.631968  6448 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.605947  6569 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.607749  6636 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.642311  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48209.7us
I20260709 13:01:53.655234  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:53.656872  6676 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:01:53.666723  6674 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:01:53.668344  6677 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:01:53.637080  6448 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.678121  6362 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
W20260709 13:01:53.678015  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 621465us
I20260709 13:01:53.679984  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:53.681267  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:53.682080  6016 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.682832  6016 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.683279  6016 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:53.683669  6016 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:53.689013  6675 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:01:53.688851  6570 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:53.690850  6570 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.693674  6570 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.645357  6636 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:53.703349  6636 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.705618  6448 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.711648  6478 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.714120  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:53.732664  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.737612  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:01:53.738327  1677 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.738772  1677 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.739820  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:53.722261  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:53.740826  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.723122  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.723646  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.724187  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:53.724750  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.741580  1678 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:53.742368  1608 raft_consensus.cc:2368] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:01:53.725683  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.719771  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:53.742960  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:53.742903  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.729663  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:53.741576  1606 raft_consensus.cc:2368] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:53.742946  1603 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:53.744853  5833 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.745302  5833 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:53.744325  1678 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:53.743927  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.745625  5833 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.747033  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:53.748241  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.749740  1602 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:53.750891  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:53.753407  1676 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:01:53.787034  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.768806  5833 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.755606  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:53.790794  1600 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:53.781589  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:53.734444  6362 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:53.820232  5833 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:53.777307  5927 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.830421  6653 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:53.832999  6465 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:53.835382  1674 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
W20260709 13:01:53.838061  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56558.7us
I20260709 13:01:53.840826  2261 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.821754  6362 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.788870  6578 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:53.927387  6523 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:53.942940  6609 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:53.987203  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.964124  6362 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.998265  6609 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.037072  6609 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:53.780884  6645 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:53.730320  6570 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.070307  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 314764us
I20260709 13:01:54.077708  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.079468  1674 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.082598  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.087179  6692 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.087814  6692 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.090194  1674 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:54.078577  1677 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.070252  6596 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.094034  6681 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.102406  6596 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.103133  6681 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.102439  6600 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.105067  6600 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.105597  6681 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:54.107245  6600 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:54.108589  6596 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.107482  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.113440  2257 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:54.142102  1677 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.144398  1682 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:54.149183  6635 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.158196  6607 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:54.160620  6564 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.003s
I20260709 13:01:54.100102  6608 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.162717  6608 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:54.163787  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.165395  6608 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.093940  6620 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.081259  6636 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.079239  6016 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.170454  6016 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.171514  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.172241  1680 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:54.174468  6645 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.177012  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.177758  2260 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:54.179064  6578 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:54.179478  6578 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:54.180131  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.180450  6523 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:54.180785  6464 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:54.181444  6578 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.183633  6578 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.185716  6464 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:54.185005  6684 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:54.184723  6523 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.186293  6464 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.187433  6607 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.185755  6478 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.188901  6692 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.195047  2261 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:54.195807  6651 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.196389  6651 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.200810  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1149) took 2822 ms. Trace:
I20260709 13:01:54.201439  2261 rpcz_store.cc:276] 0709 13:01:51.378632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.379307 (+   675us) service_pool.cc:224] Handling call
0709 13:01:51.379525 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.840157 (+2460632us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b58008b5ed0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63a8d0aa 00007f7e63b0f447 00007f7e63b27fe7 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:01:54.195667 (+355510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.200693 (+  5026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3812438784}
I20260709 13:01:54.207015  6645 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.210391  6645 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.211272  6362 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.212707  6645 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:54.209697  6651 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.213341  6362 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.189111  6464 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:54.216532  6602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.156s	sys 0.164s
W20260709 13:01:54.234754  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 705145us
W20260709 13:01:54.238255  6602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.156s	sys 0.165s
I20260709 13:01:54.240094  2227 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.093572  6570 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.242266  6482 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.243468  6570 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.279214  1424 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.283962  1424 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 7, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 7 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:54.286723  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.287707  1424 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 12, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:54.290709  1424 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:54.294752  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.294365  1424 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 2 to 8, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:54.306679  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 223987us
I20260709 13:01:54.309468  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.313752  1529 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:01:54.321789  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 81780.1us
I20260709 13:01:54.322635  5833 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.322439  2256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:54.323650  6478 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:54.327049  6578 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.327457  6478 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:54.328274  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.328773  2260 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:54.329905  6690 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.323794  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.325019  6569 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.333666  6609 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.336632  6692 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.336882  2254 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:54.340166  6694 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.340762  6694 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.341193  6694 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.341804  6523 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.342788  6523 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.343845  6596 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.344472  6596 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.335664  6448 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.346746  6448 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.347213  6596 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.347816  6596 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.348628  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.333598  5954 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.349720  6534 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.350281  5954 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.350505  6534 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.351895  6523 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.338543  6578 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.335729  6362 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.353860  6362 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.354197  6602 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.355068  6602 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.356606  6609 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.357445  6602 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.357611  1525 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:54.358381  1527 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:54.352705  6543 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.358946  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:54.359166  6609 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.344403  5927 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.337328  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:54.360940  2256 raft_consensus.cc:606] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:54.360069  5927 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.337536  6692 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.363248  5927 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.364329  6692 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.366350  6478 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.364135  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:54.367313  6482 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:54.368644  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 76290.2us
I20260709 13:01:54.332705  6690 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.372148  5954 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.372905  6543 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.343514  6687 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.374835  6687 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.375685  6543 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.349257  6448 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.377213  6687 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.360973  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:54.378628  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.378667  1533 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:54.376561  6578 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.381470  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:54.383955  6534 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.385896  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.392037  6607 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:54.392514  6362 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.392736  6464 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:54.394105  6464 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:54.393774  6596 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.394542  6464 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:54.396363  6645 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:54.380746  1424 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.396685  6464 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.372789  6690 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.397989  6476 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:54.398480  6464 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.398406  6476 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:54.399333  1682 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:54.400226  6476 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.401085  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.402700  6689 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:54.403129  6689 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.402225  1424 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 10, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.403513  6689 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.406489  6685 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.409000  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.409272  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.408784  6645 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:54.413407  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.410006  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.417928  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.425793  6687 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.426333  6692 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.426461  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:54.430224  6404 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.438011  6685 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.438675  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.422744  6607 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:54.440950  6686 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:54.449651  6404 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:54.450984  6476 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.450628  6404 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.438728  6685 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.453545  6404 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:54.455574  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.456717  2256 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 8.
I20260709 13:01:54.457737  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.458673  2254 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:01:54.429005  6596 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.460417  6685 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.466086  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:54.467039  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:54.429898  6692 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:54.486182  6692 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.492018  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.495568  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.504885  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.505892  1682 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:01:54.513429  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 186698us
I20260709 13:01:54.513797  6404 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:54.515352  6606 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:54.515815  6606 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:54.517360  6606 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.519335  1607 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:54.523849  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.527379  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:54.529470  6578 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.539903  1682 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:54.537635  1680 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:54.451303  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:54.547776  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.549234  6606 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.554586  6645 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.555729  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.555550  6645 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.527437  6686 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:54.571738  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:54.577375  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:54.578424  1604 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:54.406522  1424 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 9, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.582448  6645 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.583627  6263 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:54.585124  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.587157  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.590673  6578 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:54.591391  6578 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:54.597903  6578 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.601411  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:54.602648  5833 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:54.603030  5833 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.603355  5833 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:54.604780  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 153766us
I20260709 13:01:54.606115  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.607048  6534 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:54.607668  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:54.607810  6534 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:54.611079  6689 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:54.612901  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.621596  1682 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:54.595530  1424 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 9, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 9 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:54.629709  6694 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.612094  5833 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.653200  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.654549  6263 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:54.656492  6448 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.656844  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.657172  6448 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.654798  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.657697  6695 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.658353  6695 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.658891  6362 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.630839  1424 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 9, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 9 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:54.632135  6694 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.664256  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.663865  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.641271  6645 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.663568  6534 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.659584  6362 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.668664  5833 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.675681  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.677914  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:54.680788  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 125344us
I20260709 13:01:54.682300  6362 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.682664  1682 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:54.683287  6448 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.670614  6534 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.673461  5833 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.689375  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.694824  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.695672  1675 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.702134  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:54.711706  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:54.698864  6534 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.713490  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.720072  1675 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:54.701526  6448 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:54.705816  6404 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.737389  6596 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:54.738072  6596 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:54.744885  5833 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:54.751174  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49138us
I20260709 13:01:54.704537  6685 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.744529  6607 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.735862  6448 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:54.757300  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.761765  5833 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.730585  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:54.761142  6448 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.767261  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.774281  2254 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:54.754645  6404 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.780923  1675 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:54.787863  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.791409  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:54.792901  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 152531us
I20260709 13:01:54.767560  6478 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.795854  2254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:54.796448  2254 raft_consensus.cc:606] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:54.796759  2254 raft_consensus.cc:614] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:54.790128  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.798241  2260 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.795642  5927 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.845108  6695 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:54.845944  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.777463  6694 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:54.763002  6596 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.846820  6694 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.848945  6694 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.850003  6404 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.851445  6404 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:54.845237  5927 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.853927  5927 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.856174  6689 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.852243  6404 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.857252  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:54.858050  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145200us
I20260709 13:01:54.858903  6482 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:54.793968  6692 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.797323  6690 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.797525  6686 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:54.868618  6692 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.869710  6686 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.872532  6690 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:54.881726  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.878161  6692 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.883154   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:54.867012  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.842867  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.886101  2254 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.879006  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.813133  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:01:54.886304  2253 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:54.889636  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:54.895354  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 100323us
I20260709 13:01:54.905966  1681 raft_consensus.cc:2368] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:01:54.880050  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.907987  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:54.916760  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.800123  6645 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:54.918953  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:54.891047  6686 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.928905  2260 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:54.842875  6478 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.933676  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:54.895907  1529 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:54.938387  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.940833  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.918525  6690 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:54.920254  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:54.942746  1675 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:54.942924   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:54.932799  5927 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.980247  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.980499  5927 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:54.980902  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:54.973824  6694 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:55.011593  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84503.2us
I20260709 13:01:55.014261  6718 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:55.015048  6718 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.016384  6570 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:01:55.022683  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.023695  6694 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:55.036046  2259 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:55.030655  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 229091us
I20260709 13:01:54.973281  6685 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:54.937614  6645 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.024730  6543 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:55.115144  6718 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.116756  2258 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:55.117766  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.024928  6694 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.118599  2258 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:55.119549  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.121517  5833 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.122272  5833 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.124693  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:55.125802  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.124264  5833 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.126516  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.126191  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.131736  1681 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:55.126543  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.128074  1500 leader_election.cc:400] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:01:55.132661  1683 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
W20260709 13:01:55.121541  6476 consensus_meta.cc:287] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.670s	user 0.017s	sys 0.004s
I20260709 13:01:55.126941  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.133677  1500 leader_election.cc:400] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:01:55.141808  2258 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:55.111588  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.840s (SENT) [suppressed 2 similar messages]
I20260709 13:01:55.127357  6695 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:55.182008  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70443.8us
I20260709 13:01:55.136406  5927 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:55.188740  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63829.1us
I20260709 13:01:55.189106  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.189536  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:55.196171  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62654us
I20260709 13:01:55.145303  6689 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.185573  6404 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.186412  6523 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.159145  6476 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:01:55.186076  6695 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:55.209558  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.197642  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:55.211983  1680 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:55.212328  6523 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.216898  6689 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.219067  1604 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:55.198808  6697 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:55.209517  6543 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.233816  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:01:55.231565  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46278.7us
I20260709 13:01:55.238075  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.241312  1675 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:55.232427  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:55.218132  6708 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:01:55.269218  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.269948  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:55.273144  6715 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:55.273496  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:55.275180  1609 raft_consensus.cc:2410] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:55.276162  2257 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:01:55.280175  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70084.9us
I20260709 13:01:55.242131  1600 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:55.274281  5927 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:55.281167  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 87352.9us
W20260709 13:01:55.288895  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48276.6us
I20260709 13:01:55.233383  6578 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:55.286345  6697 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.297137  6697 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.298770  6689 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:55.299726  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 105129us
I20260709 13:01:55.300913  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.301455  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:55.301654  1528 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.303174  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:55.303908  6263 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:55.304472  6263 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.304868  6263 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.305056  5833 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:55.305594  5833 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:55.293339  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:55.307247  1608 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.303582  6686 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.289170  2256 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:01:55.269469  6464 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:55.305266  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.306654  5833 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.314545  2259 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:55.315022  2253 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:55.321626  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.233577  6185 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:55.324484  2260 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:55.269397  6478 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.286834  6362 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:55.332113  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.332728  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.333343  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:55.333443  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.334326  6404 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:55.334748  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.335405  1534 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:55.335675  6726 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:55.341475  6543 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.341977  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:01:55.348734  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 164959us
I20260709 13:01:55.320801  6569 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.342698  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.387494  1525 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:01:55.358345  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 117064us
I20260709 13:01:55.329497  6476 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.359505  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.360126  5927 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.321171  6464 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:55.362402  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:55.364584  6448 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.568s	user 0.000s	sys 0.010s
W20260709 13:01:55.365213  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 157748us
I20260709 13:01:55.430162  1528 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
W20260709 13:01:55.367211  6606 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.000s
I20260709 13:01:55.434448  6404 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.435051  6606 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:55.435585  6606 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.437388  6404 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:55.367074  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.367825  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.439076  1674 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:01:55.439462  5927 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.439675  6606 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:55.440465  6464 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.442109  6464 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.445631  1606 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 8.
I20260709 13:01:55.448112  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:55.449528  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:55.451526  6448 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.310098  5954 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:55.368762  6712 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:55.341346  6695 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:55.463394  2254 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.012s
I20260709 13:01:55.463838  2254 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:55.427639  6569 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:55.369675  6716 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:55.370283  6651 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.469039  6651 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.471143  6651 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:55.472396  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.427896  6185 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.473212  1527 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:55.473279  6185 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.374106  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.376616  6523 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.358565  6645 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.475369  6645 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.475451  6185 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.476112  6645 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:55.380685  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51320 (request call id 0) took 2287 ms. Trace:
I20260709 13:01:55.382145  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.477867  1526 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:55.477239  6482 rpcz_store.cc:276] 0709 13:01:53.070102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.395525 (+325423us) service_pool.cc:224] Handling call
0709 13:01:53.403619 (+  8094us) log.cc:844] Serialized 501 byte log entry
0709 13:01:54.148014 (+744395us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18002d7fc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63a8ab0b 00007f7e63b0fb63 00007f7e63b37752 00007f7e63b2f9fa
0709 13:01:55.353083 (+1205069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":572871,"raft.queue_time_us":618948,"raft.run_cpu_time_us":1576,"raft.run_wall_time_us":38498,"spinlock_wait_cycles":16208128,"thread_start_us":125549,"threads_started":1,"wal-append.queue_time_us":157980,"wal-append.run_cpu_time_us":2996,"wal-append.run_wall_time_us":1128315}
I20260709 13:01:55.478771  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.391711  1532 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:55.428072  1533 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:55.358575  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.481001  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.481143  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.430750  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:55.481328  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.328496  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.482164  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:55.481949  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51278.9us
I20260709 13:01:55.477540  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.484582  1525 raft_consensus.cc:2410] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:55.480031  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:55.471469  6534 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.000s
I20260709 13:01:55.354169  6362 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:55.487762  1534 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:55.488643  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.494910  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.495693  1533 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:55.496634  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.496837  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.498157  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.499361  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.505138  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a266117eb57049ceb80c4acd77766559 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:55.505722  6695 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.461629  6476 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.509083  6476 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:55.509433  6476 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:55.510337  6476 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:55.513330  1529 consensus_meta.cc:287] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.006s
I20260709 13:01:55.514786  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.516109  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.498165  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.467844  6569 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.445559  6724 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:55.371891  6692 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.563349  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.566197  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.568948  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.536249  6362 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.577536  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.582079  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.582542  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.583264  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.584280  1529 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:01:55.563477  5954 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.536566  6534 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.586092  1530 raft_consensus.cc:2410] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:55.587704  1532 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:55.571008  6606 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.598685  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.599134  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:55.600222  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 232547us
W20260709 13:01:55.601876  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 150782us
I20260709 13:01:55.604425  6016 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:55.604914  6016 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.605307  6016 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.605621  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.583298  6724 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.607542  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.571379  6263 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.608278  1525 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:01:55.610278  1525 pending_rounds.cc:85] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 9
I20260709 13:01:55.608301  1530 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:55.603372  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:55.611734  1529 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:55.612144  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:55.610426  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:55.610993  1525 pending_rounds.cc:107] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:01:55.620775  1525 raft_consensus.cc:2889] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.621209  1529 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:55.621737  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.621990  1677 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:55.622515  1530 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:55.623651  1529 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:55.625593  5954 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.633764  6534 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.636703  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:55.637463  2252 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.642002  6724 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.601832  6606 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.604070  6730 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:55.660730  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:55.661574  1677 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:55.664491  6724 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.665282  6724 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.666018  6569 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.669039  1529 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.672873  1608 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:55.677865  6724 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.681095  6730 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:55.679950  6724 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:55.681833  6730 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.614946  6607 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:55.690783  6606 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:55.692495  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 80428us
I20260709 13:01:55.701758  1529 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:55.668156  6569 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.718858  1574 leader_election.cc:400] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:01:55.720391  1574 leader_election.cc:403] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:55.721863  5954 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:55.723110  6724 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:01:55.707834  6730 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:55.726294  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:55.729719  1528 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:01:55.711612  6016 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:55.731122  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.725744  1573 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:55.699102  2252 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:55.735685  6724 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:55.738112  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:55.735713  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:55.739194  6596 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:55.739765  6596 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:55.740648  6733 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:55.741142  6733 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.740890  6596 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.741515  6733 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.744577  6448 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:55.711253  6362 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.746377  1531 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:55.746815  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:55.747648  1675 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:55.737085  5954 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.713405  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:55.938956  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 205342us
W20260709 13:01:55.866461  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.773963  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.767406  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.913174  1532 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:55.946099  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:55.954664  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:55.793476  6448 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.956652  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.779979  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.775303  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.751593  1526 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:55.964514  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 251469us
I20260709 13:01:55.988577  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:55.760658  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:55.944645  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:55.761024  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.991176  1675 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:55.941650  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:55.774789  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.946532  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:55.992326  1602 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
W20260709 13:01:55.994108  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50642.4us
I20260709 13:01:55.759933  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.996529  6523 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.997114  6523 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.998080   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.000167  6543 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:56.000643  6476 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.000559  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:55.781428  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:56.002544  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56087.1us
I20260709 13:01:55.951541  6651 raft_consensus.cc:993] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:55.995592  6569 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.748526  6362 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.002566  2260 raft_consensus.cc:2376] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12. Re-sending same reply.
I20260709 13:01:55.849967  6185 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.010432  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.964855  6692 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.011518  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.017693  2253 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:56.012177  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:55.765682  6263 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.011680  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.021119  6016 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.021651  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.022461  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.014892  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.023582  2255 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:56.023697  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.025027  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.016942  2258 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:56.025722  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.027112  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.787040  6570 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.241s
I20260709 13:01:56.023064  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:56.028568  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:55.995011  6744 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:56.029518  6744 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.012630  6742 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:56.030571  6742 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.030953  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.031229  6742 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.029991  6744 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.032454  6606 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.032816  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.034030  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.012532  6448 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.034967  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:55.964697  6686 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.000609  6543 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.042268  6543 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.042613  6523 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.043356  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.033190  6606 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.046008  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.047431  6606 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:56.049057  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:56.050143  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:56.051107  6534 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:56.051676  6534 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:56.052784  6534 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.029978  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.008947  1604 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.035521  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:56.063320  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 117284us
I20260709 13:01:56.008518  1609 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:56.097607  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.098095  1604 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:56.074668  1675 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:56.067596  6185 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:56.065423  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47800.3us
I20260709 13:01:56.067781  6730 raft_consensus.cc:1081] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:56.107223  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.108006  2261 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.063707  2255 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:01:56.078629  6744 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.085654  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.086362  6739 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.088891  1533 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:56.090500  6448 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:55.904907  6733 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:55.781680  6724 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.284s
I20260709 13:01:56.077057  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:55.993835  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:56.095567  1647 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:55.939057  5954 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:01:56.110179  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:56.124241  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 130485us
I20260709 13:01:56.124660  1683 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.111047  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:01:56.101173  6523 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.112880  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.123812  1600 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.113583  6263 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.118192  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.120085  2260 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:56.128492  2255 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:56.123874  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.130640  1607 raft_consensus.cc:2955] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:56.136991  2254 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:56.137429  2254 pending_rounds.cc:85] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 10
I20260709 13:01:56.137677  2254 pending_rounds.cc:107] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:56.137957  2254 raft_consensus.cc:2889] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.139700  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:56.141590  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.144982  1601 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
W20260709 13:01:56.147276  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49753.4us
I20260709 13:01:56.148940  1602 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:56.150084  1609 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:56.130131  6476 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.153211  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:56.135443  6606 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:56.153285  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.161032  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.152254  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:56.155822  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.156008  6596 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:56.157612  6748 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.159541  6185 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.161032  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:56.162561  6752 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 13:01:56.198202  6693 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:01:56.180758  6689 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:56.201023  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:56.201538  6733 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.201660  1675 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.147833  6016 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.202417  6016 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.204614  6016 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.153297  6362 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.142058  6404 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.210335  1675 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:56.129462  6523 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.165743  1682 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:56.166316  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.167739  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:56.168941  6543 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.169616  6744 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.172219  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.170833  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.214993  1609 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:56.178088  1683 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:56.180480  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.184618  6606 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:56.184969  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:56.221169  1606 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:56.185590  6748 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.197055  1604 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:56.142247  6569 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:56.183943  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.222440  1681 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:56.223903  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:56.222007  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 49860.7us
I20260709 13:01:56.213644  6404 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.230527  6404 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:56.233810  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:56.234364  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66730.5us
I20260709 13:01:56.210917  6689 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.235122  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.235621  6689 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.236594  6736 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.237020  6736 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.237409  6736 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.237845  6569 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.240833  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.243752  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.244627  1682 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:56.245158  1606 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:56.260968  1681 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:01:56.233839  6755 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:01:56.269188  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:01:56.232112  6523 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.294945  1609 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:56.239869  6016 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:56.297217  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 237560us
I20260709 13:01:56.306990  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:56.318936  2261 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:56.316756  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:56.320909  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:56.270306  1603 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.321504  1606 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.322402  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:56.325963  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:56.329514  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.334703  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.270249  5954 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:56.271015  6744 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.360496  6016 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.362172  6016 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.324075  6404 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.315521  6724 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.336153  6263 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.271032  6742 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.394927  6724 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.394658  6744 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:56.396412  6692 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:56.408676  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 104154us
I20260709 13:01:56.437063  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.420284  1606 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:01:56.373823  6263 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.441042  2256 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:56.391598  6606 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.370301  5954 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:56.444639  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 110154us
W20260709 13:01:56.454910  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 128326us
I20260709 13:01:56.455313  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.455807  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:56.450996  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:56.442840  6263 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:56.458806  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 288989us
I20260709 13:01:56.459671  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.463107  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.466092  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.460770  6692 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.449448  6744 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.473384  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.461674  6404 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:56.483726  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.487112  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.487324  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:56.474181  6543 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:56.486101  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 114841us
I20260709 13:01:56.487820  1681 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:56.496526  6772 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.498327  6772 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:56.498838  6772 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.478183  6768 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.502948  5954 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.508438  6768 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:56.509074  6768 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.510073  6768 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.509006  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:56.515038  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 142259us
I20260709 13:01:56.515298  6692 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.516391  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.519421  6762 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:56.519207  6736 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:56.520674  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69778.3us
I20260709 13:01:56.522307  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.522904  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:49526
I20260709 13:01:56.523676  1607 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.524111  1607 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.524521  6753 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:56.524931  6753 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.525264  6753 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.525667  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.526268  6733 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:56.525142  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.526710  6733 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:56.527865  6185 raft_consensus.cc:2764] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:56.526449  2256 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 9: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:56.528699  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:56.527637  6733 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.528614  6763 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:56.530113  6733 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.531423  6742 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.491849  6770 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.515600  6534 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.537927  6534 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.538403  6534 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.484690  6748 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:01:56.546015  6767 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:56.520972  1500 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.548947  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.549841  1607 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.559832  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.564997  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.565022  1609 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.565038  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.580056  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.581414  1500 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.586195  2256 raft_consensus.cc:2368] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:01:56.585053  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:56.587896  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 100815us
I20260709 13:01:56.582616  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.591235  2259 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:56.587811  1606 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:56.597010  2259 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.598536  1607 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.600642  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.601318  2259 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.601639  2259 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:56.601939  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.602222  6016 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:56.605772  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.610843  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.582212  6742 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:56.612848  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.616393  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.593899  6362 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.590466  6523 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.590301  6263 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.619243  6689 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:56.619756  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.621409  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:56.621706  1680 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.621954  6695 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.622602  1573 leader_election.cc:400] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:01:56.674105  1573 leader_election.cc:403] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.627290  6724 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:56.674676  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52237.7us
I20260709 13:01:56.675257  1681 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:56.613198  6718 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.628078  6774 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:56.675647  6263 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:56.676373  6523 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.589911  6692 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.590768  6685 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.631577  1676 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:56.678465  6523 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.599625  6770 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.642105  6736 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:01:56.668839  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47519.6us
I20260709 13:01:56.652989  2259 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.680225  2259 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:56.670477  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54197.5us
I20260709 13:01:56.680831  6016 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:56.660259  6687 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.608973  6570 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.673566  6404 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:56.680800  1500 leader_election.cc:400] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:01:56.696273  1500 leader_election.cc:403] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.687392  6016 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.673080  6748 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.690018  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:56.698292  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.674223  6772 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:56.702852  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.703737  2258 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
W20260709 13:01:56.682427  6729 consensus_queue.cc:1175] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "428f0180c2cd487c8b48e91f14dff65d" responder_term: 13 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:56.707901  6753 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.674767  6724 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:01:56.695358  6695 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:56.727449  6185 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.765988  2259 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:56.768661  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:56.711776  6534 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.781159  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:56.781915  1676 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:01:56.771379  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 71214.3us
W20260709 13:01:56.771587  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 90933.9us
W20260709 13:01:56.772042  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 82812.8us
W20260709 13:01:56.772651  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 283156us
I20260709 13:01:56.756091  6404 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:56.702771  6569 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:01:56.728194  6185 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.795212  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:56.798128  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:56.799721  6404 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.801399  6778 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.801923  6778 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.805878  6596 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:56.806280  6606 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:56.806967  6606 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:56.809962  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 293678us
I20260709 13:01:56.811128  6016 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.787832  6523 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:56.791931  6770 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.816665  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.818186  2261 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:56.769897  6748 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:01:56.818845  5833 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:56.821906  5833 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.822546  5833 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.819828  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.812661  6689 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.795044  6570 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:01:56.836450  6778 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.841234  6185 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:56.842192  6185 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.846764  5833 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.850997  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.819360  6718 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.836772  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:56.855180  2252 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.823791  6779 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:56.824951  6523 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:56.860352  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.867735  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.829057  6689 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.834802  6742 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:56.870395  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.807840  6606 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.876466  1533 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:01:56.871475  5927 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.871829  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.872601  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.866531  6779 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:56.875922  6718 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.882094  6742 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.903151  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.877318  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.875634  6543 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.893980  2252 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:01:56.860867  6695 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.906572  6695 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.907433  6695 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.908367  2252 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:56.905892  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:56.909749  6763 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.910136  6763 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.910475  6763 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.913269  6523 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.917001  1677 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:56.917284  5927 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.918213  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:56.867422  6736 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:56.919339  6736 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.908624  6695 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.906841  6724 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.922079  6736 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.891880  2255 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.906147  6543 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:56.924788  6543 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.871284  5833 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.917110  6534 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.932642  6753 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.904403  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:56.903625  6742 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.942619  6763 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.946285  2255 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:01:56.942874  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:56.920401  6718 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:56.947328  6718 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:56.947672  6718 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:56.947750  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:56.948043  6718 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.948490  6753 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:56.949168  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:56.950812  2252 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:56.946593  6476 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:56.951223  6476 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.951577  6476 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.952899  6543 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.954170  6689 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.955127  6689 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.959828  6448 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:56.960268  6448 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:56.962517  6779 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.962519  6448 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:56.964022  6448 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.965132  6742 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:56.963979  6779 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.967559  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:56.894819  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92674.4us
I20260709 13:01:56.977118  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:56.977571  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:56.977829  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.978369  1528 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:56.978633  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.978384  1533 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:56.979004  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.980088  1526 raft_consensus.cc:2410] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:56.980037  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:56.980902  1530 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:56.981439  6770 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:01:56.977591  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.980919  1426 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 6 to 7, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 7 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.982713  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:56.983314  1532 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:56.973244  6362 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:01:56.988531  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 180835us
W20260709 13:01:56.991997  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 193929us
I20260709 13:01:56.995759  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:57.024817  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.027176  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2351) took 1007 ms. Trace:
I20260709 13:01:57.000699  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:57.030120  6724 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:57.035449  6692 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:57.038640  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:57.044360  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 43761.2us
I20260709 13:01:57.045122  1608 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.045810  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.046533  1604 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:57.046196  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:57.043538  5927 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:57.052150  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:57.052647  2258 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:57.053400  1608 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.053350  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.061450  1603 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.062111  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.062668  1607 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:01:57.061331  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:57.064172  1602 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.027735  1601 rpcz_store.cc:276] 0709 13:01:56.019421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.197029 (+177608us) service_pool.cc:224] Handling call
0709 13:01:56.197397 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.521013 (+323616us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18003c41e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b29bfb 00007f7e63b3464b
0709 13:01:56.521169 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.521195 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.521743 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.790830 (+269087us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:56.826455 (+ 35625us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.826695 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.826765 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.987288 (+160523us) raft_consensus.cc:1685] finished
0709 13:01:57.026959 (+ 39671us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.027110 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12259,"prepare.queue_time_us":35306,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":123808,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":14194,"spinlock_wait_cycles":10122496,"thread_start_us":398504,"threads_started":2,"wal-append.queue_time_us":316001}
I20260709 13:01:57.067013  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.067840  1533 raft_consensus.cc:2410] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:57.068593  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:56.983752  1426 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 3 to 9, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 9 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.048998  6774 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:57.069319  1677 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:57.052858  6776 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:57.080475  5833 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:57.083324  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.084875  1533 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:57.086841  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:57.084237  6763 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.089190  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.089776  1533 raft_consensus.cc:2376] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13. Re-sending same reply.
I20260709 13:01:57.090615  5833 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:57.091019  5833 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:57.091928  5833 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.065850  6686 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.092988  5833 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.052731  6771 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:57.106958  6776 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:57.108774  6774 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:57.109709  6774 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.112588  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.113487  5833 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:57.113793  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54982.7us
I20260709 13:01:57.117419  6724 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:57.118333  6742 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.118940  6724 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:57.119314  6724 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:57.119581  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:57.120151  1681 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.090617  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.123027  1609 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:57.089926  1676 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:57.115643  6718 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.138957  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.141780  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.142541  5833 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.155639  1606 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:57.155822  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:01:57.156678  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75046.1us
I20260709 13:01:57.160007  5833 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.160542  1648 leader_election.cc:400] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13.
I20260709 13:01:57.161964  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:57.161908  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.163733  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.164840  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.165576  1526 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:57.167057  1534 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:57.167718  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.162642  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.153360  6778 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:57.173357  1531 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:57.186738  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.174080  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.178409  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:57.187546  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.187083  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.120183  6724 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.192639  6778 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.193611  6724 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.194810  6778 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:57.107925  6776 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.198534  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:57.199272  2255 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:01:57.201330  1647 leader_election.cc:400] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:01:57.201632  1647 leader_election.cc:403] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:57.202252  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:57.203094  5833 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.205067  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:57.206954  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:57.207571  1674 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.211745  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:57.211774  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:57.173555  6692 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.220368  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:57.215282  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.216655  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.217252  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.223366  1602 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:01:57.166388  6748 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:57.219714  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:57.229027  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.231592  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:57.189003  6523 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:57.233235  5833 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:57.212671  6778 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:57.235375  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.183607  6404 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:01:57.118252  6769 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:57.249416  5833 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:01:57.250998  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90568.4us
I20260709 13:01:57.252382  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.231805  6753 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:57.259301  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.263792  5833 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.242333  6759 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:57.228966  6779 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:01:57.307085  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67759.3us
W20260709 13:01:57.308254  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55984.5us
I20260709 13:01:57.308913  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:57.310734  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.311465  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:57.313786  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:57.317924  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.320272  1525 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:57.324589  1678 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:57.325843  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.327004  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:57.337057  6797 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:57.353500  1526 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:01:57.253248  6523 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.313177  6748 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.364925  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.305339  6793 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:01:57.323612  6789 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:57.363343  6753 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:57.339852  6792 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:57.454375  1679 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:57.384622  6742 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:57.473032  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 158159us
I20260709 13:01:57.364236  6759 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:01:57.385090  6476 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.452811  6792 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:57.485836  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.479532  6789 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.488663  6770 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.460470  6753 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:57.529613  6770 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.530229  6753 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:01:57.488659  6801 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:01:57.469863  6742 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.518481  6543 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.512557  6788 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.515442  6792 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:57.516947  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:01:57.528843  6803 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:57.537055  6742 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:57.545027  6724 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.545603  6724 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:57.545977  6724 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.546886  6476 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.549865  6523 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:57.534338  1674 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:57.558275  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:57.580786  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:57.581676  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:01:57.584900  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:57.556056  6770 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:57.602265  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.614916  1681 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:01:57.621613  1605 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:57.625872  1604 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:57.626555  1604 pending_rounds.cc:85] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 10
I20260709 13:01:57.626868  1604 pending_rounds.cc:107] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:57.627163  1604 raft_consensus.cc:2889] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.587054  6523 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:01:57.603518  6819 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:57.672739  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.587486  6792 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.611351  6362 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:57.676455  6778 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
W20260709 13:01:57.674402  6805 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:01:57.686058  6815 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:57.691452  1530 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:57.688894  6789 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:57.696954  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 78425us
I20260709 13:01:57.670779  6543 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.705323  6792 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:57.680416  6362 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.709668  6362 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.713228  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.715531  6763 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.715008  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.717092  6763 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.719168  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.719900  1606 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:01:57.699319  6724 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.726797  6724 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.727744  1608 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:57.774430  6534 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:57.778432  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.781906  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.781404  1426 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:57.782714  1530 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:57.774554  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55464.7us
I20260709 13:01:57.784063  1426 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 9, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 9 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.787150  1426 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 6 to 10, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.756127  1680 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:01:57.789572  1426 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 7 to 8, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:01:57.796540  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 196006us
I20260709 13:01:57.803326  1530 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:57.805933  6362 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.811813  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:57.812513  2259 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:57.808575  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 149515us
I20260709 13:01:57.821542  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:57.820084  6800 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.570s	user 0.005s	sys 0.005s
I20260709 13:01:57.829118  2259 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:01:57.836180  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:57.838972  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:57.834466  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:57.834317  2252 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:57.839362  6596 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:01:57.863051  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:57.865381  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.872884  6543 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:57.873970  6543 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:57.874338  6543 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:57.875324  6543 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.833182  6362 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:57.865018  6742 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:57.887744  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49613.7us
I20260709 13:01:57.892345  6772 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:57.892858  6772 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:57.893615  6820 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:57.894699  6820 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:57.895043  6820 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:57.885304  6596 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:57.893661  6772 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.884425  6729 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:57.901583  6729 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.895784  6820 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:57.902100  6729 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:57.902915  6820 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:57.903425  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 591964us
I20260709 13:01:57.885201  6825 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:01:57.904173  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.882611  6543 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:57.911731  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.905699  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.916045  2261 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:57.923364  6771 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:57.913771  6718 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:57.921917  1532 raft_consensus.cc:2376] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15. Re-sending same reply.
W20260709 13:01:57.932464  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.935036  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:57.901156  6772 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.904234  6729 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:57.911249  6733 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.904819  6596 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:57.936605  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:57.939723  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.904459  6742 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:01:57.943074  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 156361us
I20260709 13:01:57.934350  6569 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:57.944777  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.930s (SENT)
I20260709 13:01:57.946141  6777 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:57.948330  6799 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.699s	user 0.000s	sys 0.024s
I20260709 13:01:57.948518  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:58.011624  5833 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:01:58.016844  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.017154  5833 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.019202  5833 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.019711  6404 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.020257  6404 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.022325  6404 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.022840  6404 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.023288  6404 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.024540  6596 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:58.028004  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83244.2us
I20260709 13:01:58.029183  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.029872  1534 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:58.010656  6820 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.036414  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.944624  6733 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.038698  6813 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.049467  6742 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.092662  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:58.093987  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.094400  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:58.046393  6813 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.105137  6771 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.053905  6820 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.122609  6812 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:58.123234  6812 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:58.124100  6812 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.132104  5833 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:58.128914  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.141036  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.141769  1604 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:58.147714  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.152554  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.153815  1600 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:58.160638  1602 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:58.161875  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.168471  1601 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:58.150761  6808 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:58.171378  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:58.175540  5833 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:58.175916  5833 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.176275  5833 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.186645  6404 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.188292  6820 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.157392  6791 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.195510  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.195966  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.196942  1525 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:58.198938  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.169565  6810 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.220839  6813 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.198026  6820 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.224112  5833 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.215955  6790 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.228701  6790 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.231041  6790 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.233453  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:58.235581  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:57.817049   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:58.205866  6569 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:01:58.246986  6569 consensus_queue.cc:1243] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:58.247599  6813 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:58.204357  6791 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.248025  6813 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:58.248514  1426 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:58.248957  6813 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.250415  6813 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.250218  1426 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:58.250806  6791 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.251961  5833 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.252588  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.259559  1526 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:58.235572  6790 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.266548  6790 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.273602  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.274755  1528 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:58.276460  1601 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:58.277591  5833 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.277014  1648 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:58.278937  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 131319us
I20260709 13:01:58.279763  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.258455  6720 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.280975  5833 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.279784  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.233835  6820 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.281188  6569 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:58.299275  6569 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:58.300284  6569 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.301011  6759 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:58.302469  2259 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:58.303027  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.304278  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.306331  5833 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.307595  6808 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.308282  6837 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.309898  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.310636  6808 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.301456  6759 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:58.288673  1426 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 6 to 2, term changed from 10 to 9, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:58.322149  6476 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.322821  6476 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.283393  6720 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.331349  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.334697  6788 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:01:58.334929  1424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 297) took 26749 ms (client timeout 15000 ms). Trace:
I20260709 13:01:58.335276  6788 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.345252  6835 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:58.353718  6729 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:58.354501  6729 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.324858  6769 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:58.356521  6476 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.357818  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:58.353842  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.361500  6759 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.362043  6404 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:58.362715  6759 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.363229  6736 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.363731  6736 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.365778  6736 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.368909  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.362983  6772 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:58.371758  6772 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.362603  6404 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.373791  6772 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.376760  6476 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.377331  6476 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.379475  6476 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.322702  1426 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 5 to 8, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 8 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:58.381333  1426 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.383090  1426 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:01:58.359906  6770 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:01:58.385723  6841 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:58.388258  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.388413  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:58.391638  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53585.7us
I20260709 13:01:58.392624  6845 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:58.396064  6263 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.397294  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.357816  6729 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.372296  6792 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.373317  6820 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.399791  1528 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:58.400032  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:58.444698  1426 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.401968  1680 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:58.448653  2260 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:58.449203  6753 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.449728  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.450958  1607 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:58.452170  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.450827  6685 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:01:58.453637  2257 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:58.455055  6777 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:01:58.402107  1681 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:58.455541  6777 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.411615  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:58.376190  6404 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.420671  6743 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.457369  6743 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.459530  6790 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.459710  6743 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.449769  6753 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.466987  6753 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.474090  1528 pending_rounds.cc:85] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 10
I20260709 13:01:58.474427  1528 pending_rounds.cc:107] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:58.474684  1528 raft_consensus.cc:2889] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.476094  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:01:58.416584  1682 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:58.420395  6764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.000s	sys 0.025s
I20260709 13:01:58.417309  6263 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:01:58.416738  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.478551  1680 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:01:58.335501  1424 rpcz_store.cc:269] 0709 13:01:31.585036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.585228 (+   192us) service_pool.cc:224] Handling call
0709 13:01:58.334763 (+26749535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:55.056397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:55.132340 (+ 75943us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:55.132391 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:01:55.132435 (+    44us) tablet.cc:662] Decoding operations
0709 13:01:55.133566 (+  1131us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:55.133657 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:55.133681 (+    24us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:55.134536 (+   855us) tablet.cc:701] Row locks acquired
0709 13:01:55.134588 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:01:55.134749 (+   161us) write_op.cc:270] Start()
0709 13:01:55.134899 (+   150us) write_op.cc:276] Timestamp: P: 1783602115134679 usec, L: 0
0709 13:01:55.134944 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.135646 (+   702us) log.cc:844] Serialized 4024 byte log entry
0709 13:01:55.604787 (+469141us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.738018 (+133231us) write_op.cc:301] APPLY: starting
0709 13:01:55.738135 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.767608 (+ 29473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.767741 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:56.036550 (+268809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:56.036892 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:01:56.036962 (+    70us) write_op.cc:312] APPLY: finished
0709 13:01:56.037346 (+   384us) log.cc:844] Serialized 97 byte log entry
0709 13:01:56.037546 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:56.037682 (+   136us) write_op.cc:454] Released schema lock
0709 13:01:56.037747 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:56.038198 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:56.038228 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1232567,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":125397,"apply.run_cpu_time_us":15835,"apply.run_wall_time_us":304235,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46027,"num_ops":10,"prepare.queue_time_us":95491,"prepare.run_cpu_time_us":8150,"prepare.run_wall_time_us":163685,"raft.queue_time_us":245717,"raft.run_cpu_time_us":13124,"raft.run_wall_time_us":120638,"replication_time_us":469661,"thread_start_us":423201,"threads_started":4,"wal-append.queue_time_us":189269,"wal-append.run_cpu_time_us":25354,"wal-append.run_wall_time_us":1709178}]]}
I20260709 13:01:58.427964  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.417742  2252 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:58.431732  2258 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:58.482203  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.444085  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:58.415549  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.446744  1426 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:01:58.480397  1604 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:58.486601  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.490844  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:58.486528  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71068.4us
I20260709 13:01:58.488659  2257 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:58.495294  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.497773  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:58.498633  1528 raft_consensus.cc:2376] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15. Re-sending same reply.
I20260709 13:01:58.502653  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.505513  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:01:58.506635  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.443361  6720 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.505460  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:58.481578  6764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.000s	sys 0.026s
I20260709 13:01:58.513645  1529 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:01:58.518029  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.523424  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.528347  6846 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:58.530164  1676 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:58.533237  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.528636  1527 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:58.536552  1683 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:58.536732  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.548780  1680 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:58.549696  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.557837  5833 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:58.558061  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.558372  5833 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.513952  6753 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.477385  6792 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.565071  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.517271  6687 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:58.561695  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:58.561930  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.566854  1607 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:58.568352  5927 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:58.568648  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:58.568825  5927 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:58.571448  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.544333  6790 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:58.580027  6848 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:01:58.580587  6777 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.582096  6720 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:01:58.583498  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 78144.3us
I20260709 13:01:58.584400  6686 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.586359  5833 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.595878  5833 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.596470  5833 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.596977  1426 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 4 to 9, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 9 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.598577  5833 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:01:58.599267  1426 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 7 to 10, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.429031  6845 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.600263  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.603410  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.604429  1674 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.605583  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.593233  5927 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.602458  6720 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.570039  6687 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.624615  1674 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:58.591710  6810 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.604945  6790 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:01:58.585022  6819 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:58.585604  6835 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:01:58.642362  6819 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.643049  6819 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:58.645382  6790 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.614027  6686 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.654879  6263 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.656107  6792 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.656462  6733 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.629550  6687 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.665005  6743 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.665645  6743 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.669783  6788 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.672538  1682 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:58.632826  6771 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.674010  6771 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.680480  6686 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.687227  1600 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:58.643081  6732 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.689666  6732 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.693092  6732 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.705335  2227 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.710322  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.714339  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:58.717480  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 154882us
I20260709 13:01:58.718770  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.715188  1600 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:01:58.725589  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.726766  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:58.728147  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.728809  1528 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:01:58.730410  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.668079  6743 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:01:58.734961  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 166428us
I20260709 13:01:58.733999  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.736641  1531 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:58.736740  1607 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:58.672231  6788 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:58.660025  6845 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.734355  6778 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:58.758015  5833 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.744787  6777 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.760901  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.761989  1683 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:58.735033  6772 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.735677  6791 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.763808  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.736135  6732 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.771114  6824 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:58.748275  6776 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:58.736666  6846 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:01:58.774534  6851 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.643976  6819 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.770424  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:58.754904  6724 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:01:58.765296  5833 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.740752  6686 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:58.795779  2257 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:58.776512  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.782284  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:58.796931  1680 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:01:58.783720  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.781071  6851 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.800894  5833 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.801234  6851 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.801359  6686 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.801776  6853 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.793673  6846 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.803471  6686 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.804392  6846 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.804497  6736 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:58.806900  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:58.803927  6792 raft_consensus.cc:2764] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:58.783854  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.785161  1527 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.785356  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.809991  1526 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:58.734222  6569 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:58.765174  6778 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:01:58.807710  1680 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:01:58.808547  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.810886  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.812518  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.755823  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:01:58.833252  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49459.1us
I20260709 13:01:58.817144  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:58.834481  1526 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:01:58.835512  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:58.837214  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 81452.8us
I20260709 13:01:58.836354  1682 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:58.779310  6772 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:58.841516  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.842152  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.843197  1649 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.846205  2252 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:58.846386  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:58.794059  6771 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:58.848217  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.945336  1678 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
W20260709 13:01:58.948555  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 109212us
I20260709 13:01:58.970244  1678 pending_rounds.cc:85] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 12
I20260709 13:01:58.970563  1678 pending_rounds.cc:107] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:58.970795  1678 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.950711  6858 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.843401  6792 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.845486  6729 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.996682  6729 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.997077  6729 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.999349  2258 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:59.000901  6596 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.001169  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.001468  6596 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.003575  6596 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:58.952975  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.005004  1680 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:01:59.005864  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.006835  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.007777  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.010701  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.011763  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.013155  2260 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:59.013823  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.953758  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.955533  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:58.956292  6846 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:58.956530  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 113426us
I20260709 13:01:59.017565  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:58.959846  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.018465  1649 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:58.834571  6778 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.023752  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.024479  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.021016  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.025625  1604 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:59.028827  1601 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:59.029955  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.030061  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:01:59.030581  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.030828  1604 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:58.776037  6777 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:58.972541  1526 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:58.952178  1682 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
W20260709 13:01:58.984009  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.990533  2256 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:58.994344  6858 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.016049  1675 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:59.035655  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.036458  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.017069  1681 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:59.015138  1677 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:01:59.037078  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.035784  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.012034  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.018728  2259 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:58.848862  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:59.032892  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.013180  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.038889  2254 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:01:59.039966  6856 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:59.043210  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:59.043776  1680 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:59.027020  6845 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:59.050135  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 201303us
I20260709 13:01:59.046355  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:01:59.052961  1529 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:59.053853  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:59.055100  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.052160  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:01:59.078317  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.078696  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.051095  1677 raft_consensus.cc:606] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:59.083823  6772 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.037106  6720 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.088776  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.089684  1680 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:59.092377  1600 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:59.049621  6596 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.045774  6570 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:59.096698  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 78274.1us
I20260709 13:01:59.049402  6792 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.063442  6853 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:59.145481  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50208.4us
I20260709 13:01:59.090510  6569 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:59.102658  6596 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.112614  6853 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:59.227480  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 80486.4us
W20260709 13:01:59.204598  6855 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:01:59.234898  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84027.3us
I20260709 13:01:59.150388  6777 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:59.258864  6813 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:59.259549  6813 consensus_queue.cc:1243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:01:59.260540  6833 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:01:59.262243  6861 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:01:59.263767  6863 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:01:59.239454  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:01:59.240691  6865 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:59.234474  6759 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:01:59.250929  6858 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.205438  6596 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:59.266366  6862 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:01:59.226397  6853 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:59.258121  6687 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.001s
I20260709 13:01:59.272598  6687 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.275025  6687 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.279134  6853 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.285352  6778 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.286616  1676 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:59.288992  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60210.9us
I20260709 13:01:59.290438  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.293059  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.296518  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.297253  1605 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.300748  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.303776  1649 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:59.313405  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 264565us
I20260709 13:01:59.315447  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:01:59.334717  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 230812us
I20260709 13:01:59.365906  1605 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:01:59.368068  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52723.9us
I20260709 13:01:59.369032  1649 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.313079  6813 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:59.358059  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:59.317732  6788 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.317265  6846 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.318181  6845 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.377589  6016 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.383515  6016 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.383924  6016 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.288655  6729 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.378702  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.206897  6820 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.160s
I20260709 13:01:59.356815  6858 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.375569  6778 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:59.366950  6596 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.373610  6569 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.335347  6777 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:01:59.336054  6792 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:59.393739  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.375613  6866 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.413516  2253 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:01:59.389439  6824 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:59.391505  6871 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.401650  6686 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.387090  6790 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:59.387791  6846 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.387382  6869 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:59.421512  6687 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.424041  6824 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.393117  6858 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.419817  6692 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:01:59.437898  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.448462  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.449710  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.450258  1679 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.451942  6853 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.426092  6871 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.454886  6871 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:59.456409  1683 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:01:59.456786  6810 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.457320  6846 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:01:59.457877  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.458370  1679 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:01:59.458981  6729 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.459136  6858 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.442328  6819 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.460958  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.461680  1683 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:59.445381  6866 raft_consensus.cc:993] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:59.463454  6866 raft_consensus.cc:1081] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:01:59.464609  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:01:59.466825  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110058us
I20260709 13:01:59.470233  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.473340  6016 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.475469  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.478993  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.479274  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:59.481894  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.482914  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:01:59.464912  6851 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:59.490738  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.493012  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.492281  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.493309  6718 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:59.493884  6718 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:59.494570  1679 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:01:59.494858  6718 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.496948  6724 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.497440  6724 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.500133  1683 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:59.474553  6781 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.504413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.532684  1683 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.499701  6736 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:59.499267  6846 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.505299  6724 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.514817  6729 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.457255  6810 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.516760  1675 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.540745  6016 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.518214  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.520212  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.542842  1682 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:01:59.521340  6743 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:59.521800  6534 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.491595  6870 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.531378  6858 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.532150  6781 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:59.543853  6016 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.552043  1601 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:59.539809  6729 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:01:59.551621  6781 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.554852  6729 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.559207  2260 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:59.559902  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.559959  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:59.560777  2253 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 10
I20260709 13:01:59.547322  6685 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:59.563364  2253 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:59.565151  2253 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:59.566979  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74761.4us
I20260709 13:01:59.567862  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.568885  1683 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:59.551788  6534 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.570664  1675 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:59.558094  6743 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.573153  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.576906  6884 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.580610  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.584086  6808 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.584661  6808 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.586789  6808 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.579517  6743 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.588869  6884 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:59.590755  6743 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.591056  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:59.592043  6743 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:59.592687  6743 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.593108  6743 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:59.596565  6534 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.605581  6810 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.572593  6732 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:59.612046  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:59.616067  6686 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.617656  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.612720  2257 raft_consensus.cc:606] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:59.603633  6743 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:01:59.621522  6881 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
I20260709 13:01:59.643502  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.644914  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:01:59.645605  1607 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.645994  1607 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:59.655823  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 600250us
I20260709 13:01:59.670181  1681 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:59.671435  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.672101  2252 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:59.673197  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:01:59.670183  6866 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:01:59.682219  6729 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.683431  2258 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.684540  6743 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.671744  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.688542  1602 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.690316  2252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:59.691073  2252 raft_consensus.cc:606] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:59.691498  2252 raft_consensus.cc:614] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.702982  1526 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:59.711246  2259 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:01:59.712620  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:01:59.713424  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44743.5us
I20260709 13:01:59.715807  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.722968  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.629838  6824 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.706660  6793 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.726907  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.734467  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.735117  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.731995  2259 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:01:59.737943  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.738577  1604 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:01:59.736239  1607 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.739639  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.730799  1602 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:01:59.751641  2258 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:01:59.754771  2252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82df41f800684066955da1e5fcf37da0"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:59.755479  2252 raft_consensus.cc:606] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:59.755839  2252 raft_consensus.cc:614] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.760511  6819 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:59.761837  6534 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.764725  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:01:59.766136  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:01:59.760047  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.772673  6889 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.776019  6884 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.777036  5927 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:59.777604  5927 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:59.778685  5927 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.779723  5927 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:59.784736  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 61843.3us
W20260709 13:01:59.789619  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57905.5us
I20260709 13:01:59.790141  1602 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:59.792186  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57614.6us
I20260709 13:01:59.712867  6810 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:59.803192  1604 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:59.805063  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:59.808261  1607 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.806586  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:59.813572  6877 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.815876  1528 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:01:59.813506  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:01:59.816890  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:59.725521  6808 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:01:59.788367  6724 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:59.773048  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:59.837332  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64359.9us
I20260709 13:01:59.840216  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:01:59.846987  5927 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.847782  5927 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.853299  2255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:01:59.854141  2255 raft_consensus.cc:606] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.854549  2255 raft_consensus.cc:614] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.856480  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:01:59.858268  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46932.4us
I20260709 13:01:59.864113  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:01:59.848929  6884 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.873145  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:01:59.747082  6793 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.847059  6819 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:59.865219  6743 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.881284  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:01:59.892894  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 106729us
I20260709 13:01:59.866890  6791 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.853158  6853 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:59.865829  6869 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:01:59.875699  6778 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.893815  6724 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:59.899178  6819 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:01:59.905766  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:01:59.894333  6884 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.910125  1676 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.910802  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.894815  1532 raft_consensus.cc:2368] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:59.926069  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2393) took 1159 ms. Trace:
I20260709 13:01:59.874352  5927 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.927284  2226 leader_election.cc:400] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:59.927737  2226 leader_election.cc:403] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.923319  6778 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.932339  6729 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:01:59.932652  6778 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.933437  6824 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:01:59.909139  6770 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:59.926457  1674 rpcz_store.cc:276] 0709 13:01:58.758696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.758815 (+   119us) service_pool.cc:224] Handling call
0709 13:01:58.759089 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.794638 (+ 35549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.794669 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.794708 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:58.794736 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.917987 (+1123251us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b540007d0d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:01:59.918061 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.918219 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81337216}
I20260709 13:01:59.940402  5927 raft_consensus.cc:2764] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:59.939721  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:01:59.935675  6534 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.944818  1683 raft_consensus.cc:2368] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
W20260709 13:01:59.950482  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86455.3us
I20260709 13:01:59.953428  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:01:59.951480  6729 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:59.955857  6729 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.964713  6909 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:59.965337  6909 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.965689  6909 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.893989  6781 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.967964  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:01:59.927356  6884 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.917482  6724 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:01:59.970079  2260 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:01:59.972711  6778 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:01:59.971542  6770 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:01:59.986855  6770 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:01:59.941571  6743 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:01:59.989244  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:01:59.992859  1530 raft_consensus.cc:606] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:01:59.989239  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:00.001513  6362 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.002185  6362 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.004566  6362 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.005784  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.006570  1674 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:00.008952  1674 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:00.011559  5927 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.011981  5927 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.012432  5927 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.018667  6724 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.019958  6724 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.025187  6781 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:00.045655  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 186402us
I20260709 13:02:00.050061  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.050354   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:00.053659   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:00.055579  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:01:59.990253  6778 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.064116  6904 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.073930  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.078480  6914 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.081934  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.084628  6914 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:00.091470  6810 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:00.092056  6810 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.094156  6810 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.096913  2226 leader_election.cc:400] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13.
I20260709 13:02:00.098486  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.048223  6880 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:00.102998  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.109006  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:00.108464  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 168551us
I20260709 13:02:00.114245  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.127394  6793 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.102543  6880 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:00.128930  6880 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.106433  6689 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:02:00.137475  5927 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.113204  6685 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:02:00.159431  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.159755  6911 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.160373  6911 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.162387  6911 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.173967  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.174625  2256 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:02:00.174815  6884 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.176383  6877 raft_consensus.cc:993] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:00.176838  6877 raft_consensus.cc:1081] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:00.178500  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:49526
I20260709 13:02:00.179013  1603 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.179327  1603 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.181444  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:02:00.186857  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46958.6us
I20260709 13:02:00.187588  6899 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.188014  6899 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.188396  6899 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.188644  6808 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:00.189905  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:00.197494  6899 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.200727  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.201433  2260 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.204360  1603 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.209610  5927 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.210884  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.211544  2256 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.220674  6889 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.222718  6869 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.223300  6869 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.226891  1603 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.227074  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.227626  2253 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:00.227910  2253 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:00.229770  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:00.228688  2253 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.234676  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.236109  2253 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.215222  6899 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.239430  6910 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:00.240602  6869 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:00.244997  2260 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:02:00.252837  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:00.256673  6884 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.271452  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:00.258229  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:00.258498  2256 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:00.259483  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.260109  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.260735  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:00.261085  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.262351  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.274820  1682 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:00.263165  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.263947  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.264132  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:00.265722  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:00.257751  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.273801  1681 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:00.277159  1681 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:00.273200  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:00.278244  5927 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:00.278671  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:00.279507  6913 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:00.293898  6789 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.294462  6789 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.279388  6871 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.297566  6871 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.278693  5927 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:00.303789  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.311813  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.312605  1607 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:00.313616  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.317209  1532 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:00.319929  1604 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:00.321012  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.323284  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 2728) took 1012 ms. Trace:
I20260709 13:02:00.323738  1601 rpcz_store.cc:276] 0709 13:01:59.292668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.292791 (+   123us) service_pool.cc:224] Handling call
0709 13:02:00.304727 (+1011936us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54004371d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:00.304867 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594038656}
I20260709 13:02:00.273833  6911 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.307096  1681 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.333278  1681 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.326314  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:00.326418  5927 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.328751  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.287729  6596 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.273064  6742 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.286253  6720 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.349689  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.324205  6810 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:00.267789  6909 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.327576  6904 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:00.354032  6742 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.350397  6913 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:00.346949  6899 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.349777  6789 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.341799  6877 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.347824  6793 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.400790  6793 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.400504  6899 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.401208  6793 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.389056  1605 raft_consensus.cc:2368] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:00.389176  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 791) took 1392 ms. Trace:
I20260709 13:02:00.350868  6866 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:00.367954  6871 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.397310  6913 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.348893  6911 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.360785  6689 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:00.400279  6742 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.404362  6016 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:00.418371  6016 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:00.402943  1675 rpcz_store.cc:276] 0709 13:01:58.996641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.045048 (+ 48407us) service_pool.cc:224] Handling call
0709 13:01:59.516600 (+471552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.572253 (+ 55653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.388984 (+816731us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540024b8d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:00.389118 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083736320}
I20260709 13:02:00.367214  6810 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:00.409188  1681 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:00.357869  6720 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:00.427479  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67376.8us
I20260709 13:02:00.435442  6909 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.424620  6016 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.437104  6016 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.436846  6810 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:00.440323  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.451501  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 93354us
I20260709 13:02:00.460713  6899 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.460912  6720 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.403640  6877 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.478111  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.484707  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.489954  6877 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.492501  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:00.493752  5927 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.463407  6866 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.499653  6923 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.501940  6911 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.495276  6899 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:00.474709  6871 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.498101  5927 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.506690  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.511227  6759 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:00.511801  6759 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:00.515064  5927 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.518913  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:00.513799  6871 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.523622  6899 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:00.531064  6891 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.658s	user 0.002s	sys 0.000s
I20260709 13:02:00.532465  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:00.535156  1533 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.538117  5927 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:00.539129  5927 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:00.541255  1675 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:00.541999  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.542344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:00.543078  1674 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:00.543431  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:00.543915  1680 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:00.544731  1681 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:00.548730  6900 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:00.550185  6909 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:00.509629  6866 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.554041  6866 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:00.558286  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 239419us
I20260709 13:02:00.560549  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.566989  6866 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.567574  6866 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.569588  6866 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:00.569998  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.570688  6866 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.571164  6866 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.576478  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.577100  2261 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.579913  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.581328  6016 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.581955  6016 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.588804  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.590345  1533 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:00.590653  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:00.591554  2260 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:00.593334  1680 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:00.574584  5927 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.597819  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.598523  2256 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:00.532711  6759 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.600458  6759 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.611297  2261 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:00.605115  6924 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.612964  6924 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.615197  6924 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:00.620005  6928 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:00.624330  6869 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:00.624164  6016 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.624833  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.624172  6871 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.628947  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:00.629738  6810 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:00.630239  6810 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:00.630656  6792 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:02:00.630867  6793 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.611806  6866 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:00.641749  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.624805  6869 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:00.653882  6793 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.654323  6869 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.655732  6869 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.630260  6880 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.672919  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:00.631433  6810 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.677019  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:00.675544  6887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.008s
I20260709 13:02:00.676584  6695 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.689637  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:00.695401  6718 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.692430  6685 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:00.700063  6866 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:00.721689  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.725807  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.694864  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:00.726970  1600 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:00.736430  6695 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.737015  6695 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.739102  6695 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:00.740491  1604 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:00.741164  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46408.5us
I20260709 13:02:00.715250  6263 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.745088  6820 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.748660  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.749913  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:00.750474  1529 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:00.690971  6887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.006s	sys 0.008s
I20260709 13:02:00.753557  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:00.754138  6866 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.755934  1678 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:00.756677  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.757513  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.758028  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.758575  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.759167  1525 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:00.760061  1603 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:00.762267  2261 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.763526  6813 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.764036  6813 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:00.767443  6813 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:00.767823  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 788) took 1820 ms (client timeout 2163 ms). Trace:
I20260709 13:02:00.770488  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.771170  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.771495  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:00.776543  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 2.163s (SENT) [suppressed 16 similar messages]
I20260709 13:02:00.787735  1527 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:02:00.786095  1678 rpcz_store.cc:269] 0709 13:01:58.947843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.012963 (+ 65120us) service_pool.cc:224] Handling call
0709 13:02:00.767597 (+1754634us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:00.767740 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948556032}
I20260709 13:02:00.785590  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:00.792641  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:00.792711  1529 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:00.794286  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:00.838963  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.847560  5927 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.799767  6813 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.841337  6820 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:00.860495  6820 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.860987  6820 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.853164  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:00.867641  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.840155  6922 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:02:00.903301  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55575.3us
I20260709 13:02:00.905872  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.852607  6813 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:00.907941  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:00.910588  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:00.911128  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.916900  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.921624  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:00.922495  2258 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:00.875911  6695 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:00.924000  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 147478us
I20260709 13:02:00.868291  6778 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:00.938916  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:00.922431  6856 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.920257  6813 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.919044  6869 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.938352  6810 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:00.943095  6718 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.966424  6869 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.932446  6903 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:00.941888  6695 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:00.973708  6695 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.951833  6692 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:00.977188  6692 consensus_queue.cc:1243] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:00.950716  6856 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:00.986482  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.986675  6856 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:00.987253  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.987267  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:00.977054  6869 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:00.996855  6820 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.008668  2227 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.009744  6887 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:01.009899  2227 leader_election.cc:400] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:01.010350  2227 leader_election.cc:403] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.010928  6743 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:01.011782  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.018791  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:01.019189  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:01.020388  1680 raft_consensus.cc:2368] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:01.022473  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.023238  1680 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:00.937691  6569 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:00.944480  6778 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:01.027846  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.028838  5833 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.029953  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.030371  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.032284  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.032553  5833 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.033044  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
W20260709 13:02:01.024384  6902 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:00.944587  6858 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:02:01.044667  6820 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.074816  5833 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
W20260709 13:02:01.037909  6934 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:01.088624  1677 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:01.112336  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.039251  6778 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:01.116125  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.031533  6569 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:01.090840  6920 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:01.120615  1677 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:01.122942  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.163493  6871 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.164211  6871 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.166679  6871 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.167325  6871 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:01.167497  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.168583  1680 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 10.
I20260709 13:02:01.169737  6569 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:01.176141  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53270.5us
I20260709 13:02:01.186484  6743 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:01.187853  6569 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:01.214550  6869 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:01.218705  6720 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:01.258536  2253 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:01.263288  2256 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:01.228395  6569 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.247463  6476 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.271449  6569 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.249696  6869 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.256608  6720 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.210263  6871 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.332418  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.314452  6772 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.247490  6778 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.312669  6476 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.402325  6772 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.419066  6720 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.419780  6772 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.407465  6955 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:01.420161  6956 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:01.401692  6695 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:02:01.417364  6961 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:01.422333  6958 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.450779  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.425937  6955 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.453780  6955 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.431317  6957 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.451746  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.463969  1683 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:01.451714  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.465013  2258 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:01.459534  6869 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:01.465900  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.469408  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.470206  2258 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:01.457463  6871 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:01.454005  6951 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:02:01.473016  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.443284  6813 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.473598  6476 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:01.480436  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.440637  6958 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.489236  6958 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.472000  6957 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.491878  6957 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.494253  6813 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.433434  6961 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.497202  6961 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:01.494179  6962 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:01.497852  6769 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:01.514533  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:01.518684  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:01.519498  1676 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:01.515188  6769 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:01.521327  6911 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.521906  6911 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.521613  6769 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.524114  6911 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.526438  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:01.526939  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.527709  1679 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:01.525496  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.538303  6866 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.542693  6772 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.543290  6772 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.545555  6781 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:01.555336  6781 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.546491  6903 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:01.547312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.549338  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.567545  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.550300  6923 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:01.558202  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:01.546412  6772 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.566661  5927 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:01.572120  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.573109  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.576511  6016 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:01.575212  5927 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.535027  6813 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:01.582368  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.583866  1600 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.584797  1604 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.588212  5927 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.620103  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.591252  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:01.622464  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.590675  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.625475  1678 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.588979  6781 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.628364  6914 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.628881  6914 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.630889  6914 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.632495  6263 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.634625  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.635390  1533 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:01.636615  6909 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:01.637164  6909 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.637027  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:01.638622  6914 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:01.639051  6914 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.639405  6914 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:01.644742  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.625476  1679 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:01.657230  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:01.642714  6819 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:01.660915  6819 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.681414  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.683108  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.666391  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.671936  1647 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.693697  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.695153  1608 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:01.665956  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.639285  6909 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.699734  1680 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:01.704190  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.707023  2255 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:01.653252  6953 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:01.714757  2256 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:01.706013  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.716130  2258 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:01.623231  6813 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.717064  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:01.721167  1529 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:02:01.718343  1601 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:01.719784  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.724229  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.725343  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.725701  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.726034  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.726418  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.727015  1606 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 14. Ops: []
I20260709 13:02:01.727234  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.727458  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.727838  1603 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:01.579916  6923 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.728673  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.728753  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.729414  1603 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:01.729847  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.730540  6923 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.708778  6869 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.730188  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.579717  6903 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.681499  6819 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:01.734310  2227 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.734812  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.748731  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.735643  1677 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:01.755460  1573 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.751456  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.775102  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.780495  1601 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:02:01.739024  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:01.740809  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:01.745790  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.783623  1608 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:01.780006  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:01.748019  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.751433  1678 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:01.763442  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.784873  1604 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:01.787779  1604 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:01.778848  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44623.1us
W20260709 13:02:01.799465  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60549.9us
I20260709 13:02:01.800421  1674 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:01.771590  1649 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:01.812354  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 56988.7us
I20260709 13:02:01.742156  6903 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.814114  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.818935  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:01.820057  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:01.769306  6813 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.719612  6887 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:01.825145  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53626.8us
I20260709 13:02:01.929286  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:01.930068  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 108091us
I20260709 13:02:01.799135  6958 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:01.819702  6966 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:01.935251  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:01.709445  6914 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.934521  2255 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:01.817377  6476 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.818131  6819 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:01.821606  6781 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:01.771239  6866 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.159s
I20260709 13:02:01.949803  6910 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:02:01.929857  6788 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:01.967139  6788 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:01.928784  6689 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:02:01.942644  6887 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.974586  6887 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.822259  6569 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:01.978268  6569 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.981110  1675 raft_consensus.cc:2368] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:02:01.985176  6968 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:01.988473  6866 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:01.988955  6866 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:01.989728  6866 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.938436  6909 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.991562  6871 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.990612  6736 consensus_queue.cc:1175] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 14 index: 12 } }
I20260709 13:02:01.994618  6914 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.992067  6871 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:01.995339  1680 raft_consensus.cc:2368] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13.
I20260709 13:02:01.996517  6871 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:01.999393  6476 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.001570  6476 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:01.955310  6964 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:01.955662  6819 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.003203  6819 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:01.957775  6952 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:02:02.026037  6769 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.034318  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.042932  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:02.043589  1528 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.045219  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:02.045795  1533 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:02.040519  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 237858us
I20260709 13:02:02.050305  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.069998  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.080891  1528 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:02.080513  1533 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
W20260709 13:02:02.091109  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 161892us
I20260709 13:02:02.092929  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.097877  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:02.081884  6724 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.082089  6685 raft_consensus.cc:2764] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:02:02.106146  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.146358  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.147881  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:02.149260  6788 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:02.149668  6788 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.150007  6788 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:02.150730  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.083902  6759 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:02.099241  6569 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.145079  6914 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.153832  6869 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:01.179656   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:02.154446  6736 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:02.237597  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 169348us
I20260709 13:02:02.307399  1604 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:02.299542  6903 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.308164  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.301721  6736 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.178835  6263 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.298285  6909 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:02.314863  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.316177  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.316500  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.315213  5927 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:02.325877  2253 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:02.327080  6778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.013s	sys 0.018s
I20260709 13:02:02.335054  1527 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:02.329721  6016 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.330955  1528 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:02.336544  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.313367  6824 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:02.315155  6846 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.340945  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.319741  6736 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.325448  6922 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.345399  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:02.335966  6778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.013s	sys 0.018s
W20260709 13:02:02.351889  6976 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.004s
I20260709 13:02:02.321610  6903 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.327732  6819 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.362337  6903 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.329118  6770 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.357139  6922 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.363632  6922 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.327735  6695 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.364974  6736 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.347839  6869 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:02.379292  6971 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.274s	user 0.000s	sys 0.007s
I20260709 13:02:02.379549  6869 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:02.380657  6869 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.383174  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:02.348205  6569 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:02.384960  6569 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:02.385731  6736 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.378386  6813 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.339684  6824 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.370930  6695 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.398440  1529 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:02.399770  6824 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.400914  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.393527  6819 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.332084  6909 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.404651  6695 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:02.406704  6909 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.386143  6569 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.415033  6813 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.393879  6788 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.347329  6846 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.417383  6788 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:02.418807  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 268119us
I20260709 13:02:02.419034  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.419929  1528 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:02.423154  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.423614  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.423791  1600 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.424575  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.425112  1608 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.425351  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.428884  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.429462  1601 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.421598  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.429804  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.431087  1603 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.431316  1605 raft_consensus.cc:2368] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
W20260709 13:02:02.433768  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.434500  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.438769  1608 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:02.442638  1528 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:02:02.445209  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.447239  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.449492  6914 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:02.453858  1679 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:02.457558  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.458966  6772 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.459750  6772 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.462235  6772 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.465291  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.465492  6736 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.466250  1528 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:02.465277  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.470321  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.471716  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.468472  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.475140  6778 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.476295  6778 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.476786  6778 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.477005  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.477555  6778 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.479314  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.476752  6736 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.483386  1649 leader_election.cc:400] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:02:02.483716  1649 leader_election.cc:403] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.484733  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:02.417448  6846 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.511782  6016 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:02.513541  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:02.514196  2253 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.517879  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:02.519404  2252 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:02.526011  1603 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:02.485395  6772 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:02.531256  1600 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:02.492457  6813 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:02.512490  6977 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:02.533152  2252 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:02.533491  6016 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.521389  6743 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.534071  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:02.542207  6743 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.544436  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.545253  2257 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:02.547344  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 2447) took 1021 ms. Trace:
I20260709 13:02:02.547807  1675 rpcz_store.cc:276] 0709 13:02:01.526048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.526196 (+   148us) service_pool.cc:224] Handling call
0709 13:02:02.547107 (+1020911us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54003561d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:02.547271 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043189632}
I20260709 13:02:02.536198  6813 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.553589  2253 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:02.535976  6846 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:02.537199  6769 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.558571  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1009) took 1294 ms. Trace:
I20260709 13:02:02.559177  2261 rpcz_store.cc:276] 0709 13:02:01.257597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.257728 (+   131us) service_pool.cc:224] Handling call
0709 13:02:01.258053 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.404178 (+146125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.404218 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.404270 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:01.404336 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.551903 (+1147567us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540040bfd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:02.551974 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.552139 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335399680}
I20260709 13:02:02.545675  6914 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:02.545199  6977 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:02.554085  6813 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.548658  6887 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.584843  6887 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.587240  6887 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.571825  6016 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.573403  6922 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.598640  1532 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.576740  6743 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.607750  1601 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:02.577239  6263 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.554639  6986 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:02.615720  1532 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:02.572299  6869 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:02.598476  6866 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.598460  6922 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:02.621501  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.567173  6769 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.625489  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:02.646560  1606 raft_consensus.cc:2368] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16.
I20260709 13:02:02.566643  6846 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.622035  6569 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:02.658962  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.659457  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.660846  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.661407  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.662192  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.664146  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.664031  6736 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:02.665592  6736 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.668282  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.670439  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.671047  1534 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:02:02.671794  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.616503  6986 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:02.672782  6989 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:02.673513  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.674369  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.675047  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.676100  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.683791  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.684567  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:02.663398  2226 connection.cc:256] RPC call timeout handler was delayed by -1.0321816969999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:02:02.687898  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.688565  2226 leader_election.cc:400] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:02.623966  6869 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.689025  2260 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:02.676172  6569 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.696729  6986 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.697285  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.701879  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:02.709092  2253 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:02.662781  6914 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:02.708235  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.668243  6736 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.714277  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.715023  2260 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:02.712332  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:02.720851  2253 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:02.723129  1500 leader_election.cc:400] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16.
I20260709 13:02:02.723554  1500 leader_election.cc:403] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.723012  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.729226  6695 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16.
I20260709 13:02:02.730574  6869 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.722165  6964 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.721812  7000 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:02.732503  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.732611  6909 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.713487  6911 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.718454  6899 raft_consensus.cc:2764] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:02.734858  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.705502  6983 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.741767  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.689571  6887 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:02.748819  6887 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.744230  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:02.750174  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.747973  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.729107  6846 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.739737  7000 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.752844  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.756431  6914 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.763610  7000 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.769058  1423 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 3 to 12. New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:02.769846  6263 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:02.770320  6263 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.770509  6569 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.773272  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:02.774612  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.767910  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.785748  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:02.786605  2255 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:02.788547  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.790565  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.734176  6909 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:02:02.795324  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.795843  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:02.816579  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.818987  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.820106  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.676733  6977 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.755564  6983 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.830734  6983 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.782254  6887 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:02.831085  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.831429  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.725777  6813 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:02.834110  6813 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:02.837222  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:02.839541  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.849272  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:02.850628  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54845.8us
I20260709 13:02:02.808952  6916 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.864712  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:02.861111  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.837894  6900 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.875295  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:02.849828  6769 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:02.859617  6987 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:02.891047  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:02.890053  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 170742us
I20260709 13:02:02.849296  6978 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:02.848678  6889 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:02:02.907852  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 87841us
I20260709 13:02:02.889709  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.918102  1574 leader_election.cc:400] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13.
I20260709 13:02:02.852406  6869 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:02:02.888228  6813 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.921878  1499 leader_election.cc:400] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14.
I20260709 13:02:02.863722  6901 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:02:02.929647  6869 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:02.931561  6778 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.943022  6778 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:02.912456  6903 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.905171  6788 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.945756  6987 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:02.770643  1423 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 2 to 6, term changed from 9 to 14, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 14 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:02.923933  6769 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.956753  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.956584  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.873835  6916 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:02.920614  6866 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:02.971516  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:02.959550  6772 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:02:02.984198  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:02.976383  6778 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.977268  6909 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.979619  6788 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.004562  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:03.005293  1531 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.008291  1534 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:03.008569  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:03.009115  1527 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:03.014696  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 102777us
I20260709 13:02:03.018389  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:02.980793  6810 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:02.999908  6923 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.021225  1529 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:03.001744  6999 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:03.027707  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 152513us
I20260709 13:02:03.014374  6769 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:03.023525  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.042774  1527 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:03.045217  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:03.045929  2258 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.027376  6743 raft_consensus.cc:2764] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:03.053951  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:03.033932  6979 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:03.070621  6979 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:03.054239  6887 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:03.071628  6979 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.072239  6887 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:03.072762  6887 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.072992  6979 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.073745  6788 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:03.074293  6788 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.038470  6769 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.076823  1681 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:02:03.089550  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 72534.7us
I20260709 13:02:03.107065  7012 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.107806  6916 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:03.022853  6987 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:03.110556  7001 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:03.082038  6736 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:03.048669  6778 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:02:03.106922  6788 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:03.116766  1531 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:03.123410  2258 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:02:03.124531  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 56745.5us
I20260709 13:02:03.126308  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:03.128702  1534 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:03.034718  6999 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.133047  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:03.145038  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.147831  1674 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:03.149121  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.144671  6569 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:03.161602  6263 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.163566  6263 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:03.167172  1676 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:03.117262  6819 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:02:03.172791  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:03.176663  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:03.112116  6736 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.131197  7013 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:03.189985  1681 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.200120  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.200858  2256 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:03.203626  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:03.153975  7016 raft_consensus.cc:476] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:03.211269  6695 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.218653  6263 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:03.219393  6263 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:03.186057  6720 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:03.220597  6263 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.224908  1574 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.186473  6813 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:03.229534  6808 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.232250  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.240984  1680 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
W20260709 13:02:03.235921  7015 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:02:03.237206  6769 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:03.243145  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 189234us
I20260709 13:02:03.269184  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:03.254266  6813 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:03.239468  6720 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.276852  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.281268  6987 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.283260  6987 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.283840  6987 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.296618  6964 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:03.259644  6781 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:03.296880  6813 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.273762  6900 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:03.298820  6846 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:03.327728  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.324064  2253 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:02:03.326025  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47128.8us
I20260709 13:02:03.329843  6720 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:03.275305  6685 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:02:03.328483  1677 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:03.340349  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.344691  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.347585  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.353112  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:03.364286  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:03.364959  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:03.365693  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:03.305222  6889 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:03.297313  6964 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.335438  6846 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:03.206462  7013 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.374912  6887 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.376420  6770 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:03.376880  6770 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:03.377249  6887 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:03.377606  7023 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:02:03.379026  2260 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:03.381278  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.362178  6695 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:03.386173  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.386864  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:03.389223  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.393576  7013 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:03.396281  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:03.399866  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.408887  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:03.412159  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:03.414614  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.324100  6900 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.377243  6770 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.378726  6846 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.421196  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:03.450410  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 171412us
I20260709 13:02:03.378576  6999 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:03.499284  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 112506us
W20260709 13:02:03.503414  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50189us
I20260709 13:02:03.405500  6695 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:03.612469  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84359.2us
I20260709 13:02:03.421502  7003 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:03.529656  6793 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.629786  6743 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:03.642611  1423 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.626152  7007 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:02:03.682888  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 261756us
I20260709 13:02:03.621951  6977 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:03.684295  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:03.725952  7036 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:03.749882  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65685us
I20260709 13:02:03.754031  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.755398  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.757046  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.766763  7024 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:03.760092  6887 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.727346  6964 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:03.779508  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.781361  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:03.768262  6979 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.001s
I20260709 13:02:03.758576  6743 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.785173  1682 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.794442  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.800138  7012 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.800969  6964 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:03.801484  6987 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:02:03.801887  6987 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:03.805028  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 314) took 39119 ms (client timeout 15000 ms). Trace:
I20260709 13:02:03.745677  6977 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.816521  7024 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:03.812601  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 406217us
I20260709 13:02:03.816140  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:03.819420  1682 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.818385  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.828745  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:03.804934  6900 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:03.804206  6987 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:03.853199  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:03.853583  1682 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:03.854031  2252 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.835554  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:03.746853  6695 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:03.797441  6743 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:03.808409  7003 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.863375  2255 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:03.859750  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:03.865509  6964 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:03.866187  6743 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.829048  1423 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 10, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:03.905474  2252 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
W20260709 13:02:03.805540  1426 rpcz_store.cc:269] 0709 13:01:24.686044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.686339 (+   295us) service_pool.cc:224] Handling call
0709 13:02:03.804888 (+39118549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:58.801113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.801651 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.801687 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:01:58.801704 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:58.803333 (+  1629us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.803390 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.803416 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:58.804779 (+  1363us) tablet.cc:701] Row locks acquired
0709 13:01:58.804798 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:58.805061 (+   263us) write_op.cc:270] Start()
0709 13:01:58.805170 (+   109us) write_op.cc:276] Timestamp: P: 1783602118805011 usec, L: 0
0709 13:01:58.805190 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.942528 (+137338us) log.cc:844] Serialized 6633 byte log entry
0709 13:01:59.443406 (+500878us) op_driver.cc:464] REPLICATION: finished
0709 13:01:59.592394 (+148988us) write_op.cc:301] APPLY: starting
0709 13:01:59.592513 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:59.906842 (+314329us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:59.906962 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:00.082379 (+175417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:00.083299 (+   920us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:02:00.083515 (+   216us) write_op.cc:312] APPLY: finished
0709 13:02:00.086271 (+  2756us) log.cc:844] Serialized 148 byte log entry
0709 13:02:00.086792 (+   521us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.087569 (+   777us) write_op.cc:454] Released schema lock
0709 13:02:00.087730 (+   161us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:00.110160 (+ 22430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.120733 (+ 10573us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1151809,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":130200,"apply.run_cpu_time_us":24932,"apply.run_wall_time_us":521956,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71167,"num_ops":16,"prepare.queue_time_us":158770,"prepare.run_cpu_time_us":16329,"prepare.run_wall_time_us":228158,"raft.queue_time_us":158785,"raft.run_cpu_time_us":25912,"raft.run_wall_time_us":146715,"replication_time_us":627426,"spinlock_wait_cycles":3328,"thread_start_us":431158,"threads_started":4,"wal-append.queue_time_us":151798,"wal-append.run_cpu_time_us":26288,"wal-append.run_wall_time_us":1991447}]]}
I20260709 13:02:03.873768  7045 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:03.933817  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45350.8us
I20260709 13:02:03.944051  6846 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:03.908946  1423 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 18, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.949553  7030 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:03.953439  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:03.940096  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:03.967519  1677 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:03.970108  2256 raft_consensus.cc:2376] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16. Re-sending same reply.
W20260709 13:02:03.980909  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46799.4us
W20260709 13:02:03.980720  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123050us
I20260709 13:02:03.915910  6770 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:03.998903  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 2562) took 1255 ms (client timeout 1665 ms). Trace:
W20260709 13:02:03.999394  1676 rpcz_store.cc:269] 0709 13:02:02.743890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.744008 (+   118us) service_pool.cc:224] Handling call
0709 13:02:03.998707 (+1254699us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400107cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:03.998834 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543578880}
I20260709 13:02:04.003545  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.008279  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:04.007068  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 125711us
I20260709 13:02:03.985637  7045 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:04.022248  1608 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:04.014571  1525 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:04.015177  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:03.987824  7042 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:04.019052  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.020258  1601 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:04.020900  1604 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:04.014070  2256 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:04.028792  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.024271  6964 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.035686  7045 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.040872  6964 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:04.041473  6964 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.043838  6964 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.050554  6998 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:04.078554  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.084578  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55860.1us
I20260709 13:02:04.103096   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:04.077160  6903 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:04.111557  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:04.108119  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 117312us
I20260709 13:02:04.119362  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:04.124673  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:04.077950  1423 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.128362  1423 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 13, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.130156  1423 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 7 to 11, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 11 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.130901  6695 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.109588  6903 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:04.131963  6903 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.133836  6770 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.028743  7042 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.136067  6977 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.132958  6903 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.122314  7057 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.137379  7057 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.139564  6846 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.117429  7014 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.080286  6986 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:02:04.136585  7042 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.150378  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.154528  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:04.156373  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:04.162014  1423 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 12, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:04.166754  7057 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.168696  1534 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:04.170004  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:04.171110  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.171802  1604 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:02:04.172233  1604 pending_rounds.cc:85] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 9
I20260709 13:02:04.172482  1604 pending_rounds.cc:107] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:02:04.172740  1604 raft_consensus.cc:2889] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.173471  1532 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:04.173840  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:04.174737  1533 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:04.175143  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 164988us
I20260709 13:02:04.169068  6743 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.179600  1600 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:04.123813  6772 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:02:04.148824  7000 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:02:04.163996  1423 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.203405  6736 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.205868  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:04.209384  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 204468us
W20260709 13:02:04.206607  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47833us
I20260709 13:02:04.207934  2252 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.190142  6903 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.235767  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.236124  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:04.237457  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61649.7us
I20260709 13:02:04.238698  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.243315  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:04.193897  6977 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:02:04.247212  7062 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:04.249753  6569 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.261929  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.248522  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:04.263366  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:04.255378  6986 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.256855  6998 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:04.238298  6813 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.259157  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:04.253391  6689 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:04.267731  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:04.274564  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:04.283061  1533 raft_consensus.cc:606] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:04.258448  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.285140  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:04.211378  7010 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:04.292688  7052 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:04.255591  6743 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.294013  7046 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.295306  1423 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.266598  7048 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.276986  6889 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.309770  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:04.311921  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53569.9us
I20260709 13:02:04.312839  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:04.316025  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.313438  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:04.321321  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.325528  6569 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.326133  6569 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.326270  1423 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.282322  6869 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:04.332394  7052 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.327894  1423 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:04.333128  7011 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:04.314496  7046 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.334187  7046 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.318114  6772 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.349124  6772 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.351608  6772 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.336997  6846 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.352869  1423 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 15. New cstate: current_term: 15 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.354835  1423 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 13 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.356520  6569 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.317891  7027 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.357754  7027 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.314299  6813 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.266551  7013 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:02:04.270594  7062 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.356637  7054 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.235946  6903 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:04.368448  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49054.9us
I20260709 13:02:04.382977  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.384043  1678 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:04.417711  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.418418  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:04.419368  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:04.419997  1533 raft_consensus.cc:606] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:04.420341  1533 raft_consensus.cc:614] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:04.421955  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 111345us
I20260709 13:02:04.423560  7058 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.422830  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:04.428274  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:04.428653  7042 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.432247  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.336156  7046 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.438423  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.447546  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.276201  6986 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.477496  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.364455  7062 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.352242  6772 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.488840  7051 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:02:04.498062  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:02:04.504074  2257 raft_consensus.cc:606] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:04.504504  2257 raft_consensus.cc:614] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.368548  7027 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.523728  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:02:04.416254  1423 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 17, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.524413  2257 raft_consensus.cc:606] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:04.524786  2257 raft_consensus.cc:614] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.505970  6772 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.543833  7002 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.577402  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:04.547189  7055 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:04.571388  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44761.6us
I20260709 13:02:04.591427  7072 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.596508  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:04.604391  7067 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:04.583159  7055 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.605712  7060 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:04.595480  7028 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.592243  6718 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.611877  6903 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.620579  6996 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:04.568616  7002 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.567175  7046 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.627064  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.631867  6996 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.627487  7060 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:04.639671  6996 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.629005  6986 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:04.646226  7065 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 13:02:04.639725  6772 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.622311  7072 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.630769  7031 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:02:04.640834  7046 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.630753  7028 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.656492  7045 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:04.648928  7069 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.648165  7014 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.668772  7055 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.665819  7060 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:04.671756  7074 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:02:04.657837  7045 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:04.673686  7028 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.673699  6996 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.674280  7045 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.675443  7045 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.675936  6996 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.676221  7012 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:04.676455  7072 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.676726  7012 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:04.677273  7002 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.661993  7069 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.677613  7012 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.679145  7069 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:04.680112  7046 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.668112  7014 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.704994   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:04.715703  1423 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.737871  1423 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:04.616667  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:04.740181  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.741765  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 125054us
I20260709 13:02:04.743347  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:04.727869  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.723624   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:04.750833  1423 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 13 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.757112  1423 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:04.762921  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.775427  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.778837  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:04.779251  1674 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:04.766144  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:04.782491  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.771029  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.785391  2252 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:04.787326  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.790635  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.791653  2261 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:04.809391  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.810428  1676 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:04.812812  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:04.813408  6263 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.814208  6263 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.814517  6569 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.815244  6569 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.816792  6263 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.817261  6689 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.818051  6689 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.818620  6569 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.821798  6569 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.823395  6569 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.811110  1423 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 12, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:04.824443  1604 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:04.825997  6689 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.827934  6263 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:04.828402  6695 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.827934  1423 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 13, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.828869  6569 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:04.831430  6718 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.837513  1423 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 10, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.838364  6718 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.839716  6718 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.850733  6819 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:04.858289  6980 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:04.859227  6980 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.862772  6980 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.851781  6819 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:04.866608  6819 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.867357  6887 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.867844  6718 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:04.873353  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:04.831801  6263 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:04.888623  6263 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.893923  7012 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.899734  7014 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:04.907603  7060 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:04.911303  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.913975  1601 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:04.840324  1423 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:04.923964  1423 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.939971  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.940857  1601 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:02:04.945291  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 119315us
I20260709 13:02:04.961570  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:04.967928  1532 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:04.989105  1674 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:04.991678  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:04.992719  1678 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:04.994171  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:04.996676  7085 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:02:05.002595  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.004065  1534 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:05.005642  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.016654  7078 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:05.031003  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:05.032713  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48408.4us
I20260709 13:02:05.035485  6720 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.036254  6720 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.037240  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.041071  6720 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:05.042047  6899 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.042848  6899 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.045555  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.046864  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.047217  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.048146  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.045598  6899 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:05.048841  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:05.055431  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.059844  6899 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:02:05.073791  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.050117  7078 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.079658  7078 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:05.035177  1423 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 5 to 10, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.093808  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.099589  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.101800  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.103528  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.105105  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.106027  1528 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:05.109051  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.108956  2257 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:05.083576  1423 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:02:05.119469  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.131280  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.134749  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.135352  6819 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:05.138783  1681 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:05.139437  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.145967  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.152232  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.152691  6866 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:05.154372  6866 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.153028  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.165663  6866 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:05.174021  6720 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:05.175329  7060 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:05.175750  7060 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:05.176342  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:05.176764  7060 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.177495  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:05.173960  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:05.178500  7060 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:05.179183  2252 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:05.189913  1677 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:05.195566  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.202231  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.202839  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.202996  1423 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 14, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:05.203604  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.205597  1423 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.211321  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:05.213972  7060 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:05.214166  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.214609  7060 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.215076  7060 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.217280  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.217926  1534 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:02:05.225704  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.225983  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:05.223814  7060 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.229909  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.230836  7060 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:05.207523  1423 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 12, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 12 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.227344  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:05.252339  6866 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:05.254698  6866 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.255091  6866 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.256870  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.264387  1423 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 6 to 13, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.266587  1423 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:05.266960  6866 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.271524  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.280272  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:05.280530  6986 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:05.283634  6914 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:05.280941  1682 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:05.294831  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.293057  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.300689  6263 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.321798  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:05.333313  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.342522  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.346036  1649 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.364753  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.372234  1574 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.386026  6979 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.372644  6977 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.394294  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.393188  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.401203  6819 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.421721  7077 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.425290  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:05.418787  6866 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:05.430684  7031 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:02:05.440677  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:05.441668  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53052.2us
I20260709 13:02:05.444598  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.443406  1648 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.458065  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:05.460275  7002 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:05.466207  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90453.1us
I20260709 13:02:05.472489  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.474116  7078 raft_consensus.cc:993] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
W20260709 13:02:05.475517  7094 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:05.468657  6986 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.488492  7060 raft_consensus.cc:1081] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:05.492698  7078 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:05.502720  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.501024  7078 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:05.504887  7078 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.531610  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.532738  7062 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:05.533349  7062 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:05.533744  7062 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.535997  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:05.536713  1604 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.542025  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.546207  6986 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:05.546917  1574 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.549180  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.550132  6889 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:05.551036  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.551302  6889 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:05.555451  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52813.1us
I20260709 13:02:05.559557  7016 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.560928  7062 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.583791  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.593544  7002 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.595332  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.599164  7002 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:05.619746  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:05.620590  2261 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:05.622231  7062 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:05.623027  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 91502.3us
I20260709 13:02:05.630826  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.639796  1682 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:05.643292  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:05.657582  1604 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:05.662621  6866 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:05.650801  7077 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.667366  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44456
I20260709 13:02:05.668291  1602 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:05.668721  1602 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.672739  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:05.673627  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.553859  7102 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.681092  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:05.685309  6263 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:05.685806  6263 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:05.686626  6263 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.682168  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:05.689502  7077 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:05.690004  7077 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:05.690907  7077 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.680212  6866 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.709127  1648 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.710912  6977 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.712482  1602 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.713609  1603 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:05.711130  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.716857  1600 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:05.731173  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.737380  1602 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:05.739694  7045 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:05.740505  7045 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:05.743606  7045 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:05.751767  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:05.752473  2258 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.760720  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:05.760573  6986 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.768535  2258 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:02:05.770303  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 43913.2us
I20260709 13:02:05.779305  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:05.780069  1525 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:05.780342  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:05.780711  1525 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:05.783982  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:05.785908   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:05.786164  1674 raft_consensus.cc:2368] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:02:05.791277  6778 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:05.791770  6778 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:05.792160  6778 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.769500  6986 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:05.816886  1574 leader_election.cc:400] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:02:05.817261  1574 leader_election.cc:403] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.819128  6889 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.827458  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:05.832228  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:05.835027  7102 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:05.835731  7102 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:05.836781  7102 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.824779  1525 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.829931  7059 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:05.856767  7002 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:02:05.875644  7059 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:05.876842  7059 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.879642  6889 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16.
I20260709 13:02:05.902973  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:05.931556  1525 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.951131  6778 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:05.964116  6778 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:05.965265  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:05.966105  2260 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:05.995301  1525 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:02:05.999703  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44810.3us
I20260709 13:02:06.003158  6977 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:06.013018  6977 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.003182  7063 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.021881  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:06.024492  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:06.021631  7063 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:06.027519  7091 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:02:06.033016  7063 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:06.033924  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:06.037412  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:06.037909  1647 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:06.039721  6986 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.016162  6977 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:06.050966  1608 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:06.049993  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:06.054977  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:06.063373  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:06.067559  1529 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:02:06.060997  7062 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:02:06.069448  7062 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:06.069808  7062 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:06.070595  7062 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:06.072850  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:06.074280  6986 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:06.074924  6986 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:06.076049  6986 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.078583  7054 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.076782  7062 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.133055  1606 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:06.137370  6977 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:06.155910  1678 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.160040  7060 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.204958  1529 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:02:06.205354  1529 pending_rounds.cc:85] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 9
I20260709 13:02:06.205595  1529 pending_rounds.cc:107] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:02:06.206259  1529 raft_consensus.cc:2889] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:06.208935  6986 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:06.242215  1600 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.243470  1529 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:06.270535  7059 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:06.272540  6819 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.351055  1608 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:06.358065  7054 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.358871  7054 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.364457  7002 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.382290  7054 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:06.388859  7123 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 13:02:06.403294  2258 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:06.407891  6889 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.473057  7110 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.473796  7110 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.477344  7110 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:06.485886  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:06.486596  1674 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:06.489903  6986 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.490506  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:06.490473  6986 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.491773  7062 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.492173  7062 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.492555  7062 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.492789  6986 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:06.500483  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:06.507938  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:06.514427  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 143591us
I20260709 13:02:06.517509  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:06.518390  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:06.520604  1527 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:06.521642  2260 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:06.526315  1527 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:06.527886  7072 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.541332  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:06.545538  7062 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.578819  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:06.580559  7127 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:06.581005  7127 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.585839  7077 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:06.581360  7127 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.601913  1525 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:06.606530  2258 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:06.609303  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:06.610357  6914 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.610641  6998 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.613128  7054 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:06.613782  7054 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.616042  7054 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:06.617380  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:06.617340  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:06.618826  1525 raft_consensus.cc:2368] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:06.631340  2226 leader_election.cc:400] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:06.632043  2226 leader_election.cc:403] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.647439  7062 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:06.633900  7054 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.656888  7127 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.667091  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:06.669565  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:06.672281  6998 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.686631  1674 raft_consensus.cc:2368] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:06.686775  1428 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 7 to 2, term changed from 8 to 4, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 4 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:06.691805  2226 leader_election.cc:400] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:06.683959  6914 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:06.693224  6914 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.694554  1428 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 6 to 2, term changed from 14 to 5, leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 5 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:06.695744  6914 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:06.696696  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:06.696805  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:06.697535  2257 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14.
I20260709 13:02:06.697659  1525 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:06.698921  1647 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14.
I20260709 13:02:06.699218  1647 leader_election.cc:403] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.699839  6914 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.703378  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:06.704033  1525 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.705436  7127 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:06.739494  7054 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:06.743036  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:06.739540  6914 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14.
I20260709 13:02:06.748515  1525 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:06.749577  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:06.750757  2261 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:06.754451  7135 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:06.754985  7135 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:06.762715  7135 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.773507  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:06.774463  7046 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:06.776885  7046 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:06.778023  7046 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:06.792248  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:06.793061  1604 raft_consensus.cc:606] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Received request to transfer leadership
I20260709 13:02:06.801445  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:06.802057  1604 raft_consensus.cc:606] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Received request to transfer leadership
W20260709 13:02:06.808429  1419 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for e2ca98d137184e478468c21f485fafa4 already in progress
I20260709 13:02:06.818051  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:06.840415  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:06.841053  1606 raft_consensus.cc:606] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Received request to transfer leadership
I20260709 13:02:06.912029  1429 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:06.918147  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:02:06.918648  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e2ca98d137184e478468c21f485fafa4 already in progress
W20260709 13:02:06.918941  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e2ca98d137184e478468c21f485fafa4 already in progress
W20260709 13:02:06.977561  1417 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet a266117eb57049ceb80c4acd77766559 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 7
W20260709 13:02:06.985853  1423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 298) took 12399 ms (client timeout 15000 ms). Trace:
W20260709 13:02:06.989578  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 185) took 71839 ms (client timeout 15000 ms). Trace:
W20260709 13:02:06.986269  1423 rpcz_store.cc:269] 0709 13:01:54.586304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.586711 (+   407us) service_pool.cc:224] Handling call
0709 13:02:06.985727 (+12399016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:05.895419 (+     0us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e6756616c
0709 13:02:06.028500 (+133081us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.029248 (+   748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.029301 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:02:06.029334 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:06.128846 (+ 99512us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.128934 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.128955 (+    21us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:02:06.130515 (+  1560us) tablet.cc:701] Row locks acquired
0709 13:02:06.130564 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:02:06.130728 (+   164us) write_op.cc:270] Start()
0709 13:02:06.130965 (+   237us) write_op.cc:276] Timestamp: P: 1783602126130662 usec, L: 0
0709 13:02:06.131008 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.131750 (+   742us) log.cc:844] Serialized 12661 byte log entry
0709 13:02:06.194196 (+ 62446us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.228268 (+ 34072us) write_op.cc:301] APPLY: starting
0709 13:02:06.228396 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.378820 (+150424us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.378861 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.558092 (+179231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.558617 (+   525us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=0,mrs_lookups=0
0709 13:02:06.558688 (+    71us) write_op.cc:312] APPLY: finished
0709 13:02:06.559322 (+   634us) log.cc:844] Serialized 276 byte log entry
0709 13:02:06.560644 (+  1322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.560933 (+   289us) write_op.cc:454] Released schema lock
0709 13:02:06.561075 (+   142us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.564888 (+  3813us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.564918 (+    30us) write_op.cc:454] Released schema lock
0709 13:02:06.785912 (+220994us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.785948 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":703714,"reported_tablets":48,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":33784,"apply.run_cpu_time_us":41315,"apply.run_wall_time_us":336605,"cfile_cache_hit":130,"cfile_cache_hit_bytes":138207,"num_ops":32,"prepare.queue_time_us":207880,"prepare.run_cpu_time_us":11536,"prepare.run_wall_time_us":123122,"raft.queue_time_us":82048,"raft.run_cpu_time_us":8252,"raft.run_wall_time_us":25438,"replication_time_us":63024,"spinlock_wait_cycles":54769920,"thread_start_us":274173,"threads_started":5,"wal-append.queue_time_us":25961}]]}
W20260709 13:02:06.990015  1428 rpcz_store.cc:269] 0709 13:00:55.150567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.150736 (+   169us) service_pool.cc:224] Handling call
0709 13:00:55.601759 (+451023us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b5400030890. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0d0b2 00007f7e69986a89 00007f7e6991eda6 00007f7e698f0088 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc
0709 13:00:56.069785 (+468026us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:06.989463 (+70919678us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.704831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.706802 (+  1971us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.706836 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:06.706852 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:06.707326 (+   474us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.707488 (+   162us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.707527 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:06.707765 (+   238us) tablet.cc:701] Row locks acquired
0709 13:02:06.707783 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:06.707928 (+   145us) write_op.cc:270] Start()
0709 13:02:06.708027 (+    99us) write_op.cc:276] Timestamp: P: 1783602126707886 usec, L: 0
0709 13:02:06.708045 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.720644 (+ 12599us) log.cc:844] Serialized 1045 byte log entry
0709 13:02:06.778164 (+ 57520us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.778492 (+   328us) write_op.cc:301] APPLY: starting
0709 13:02:06.778596 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.779997 (+  1401us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.780092 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.781807 (+  1715us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.782070 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:02:06.782123 (+    53us) write_op.cc:312] APPLY: finished
0709 13:02:06.782345 (+   222us) log.cc:844] Serialized 33 byte log entry
0709 13:02:06.782545 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.782637 (+    92us) write_op.cc:454] Released schema lock
0709 13:02:06.782678 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":613194,"reported_tablets":34,"spinlock_wait_cycles":132953088,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":4810,"apply.run_wall_time_us":4808,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8380,"num_ops":2,"prepare.queue_time_us":3701,"prepare.run_cpu_time_us":3436,"prepare.run_wall_time_us":20619,"replication_time_us":69944,"thread_start_us":1561,"threads_started":1}]]}
W20260709 13:02:07.052968  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 313) took 65455 ms (client timeout 15000 ms). Trace:
I20260709 13:02:07.069075  1425 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 11, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 11 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:02:07.054374  1429 rpcz_store.cc:269] 0709 13:01:01.597807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.647103 (+ 49296us) service_pool.cc:224] Handling call
0709 13:02:07.052866 (+65405763us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.939331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.939833 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.939862 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:02:06.939878 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:06.940186 (+   308us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.940237 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.940268 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:06.941855 (+  1587us) tablet.cc:701] Row locks acquired
0709 13:02:06.941878 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:06.942013 (+   135us) write_op.cc:270] Start()
0709 13:02:06.942119 (+   106us) write_op.cc:276] Timestamp: P: 1783602126941967 usec, L: 0
0709 13:02:06.942140 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.942775 (+   635us) log.cc:844] Serialized 536 byte log entry
0709 13:02:06.944842 (+  2067us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.945272 (+   430us) write_op.cc:301] APPLY: starting
0709 13:02:06.945353 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.946203 (+   850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.946308 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.947308 (+  1000us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.947571 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:06.947622 (+    51us) write_op.cc:312] APPLY: finished
0709 13:02:06.947837 (+   215us) log.cc:844] Serialized 25 byte log entry
0709 13:02:06.948015 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.948101 (+    86us) write_op.cc:454] Released schema lock
0709 13:02:06.948140 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.949896 (+  1756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.949928 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":107994,"reported_tablets":49,"spinlock_wait_cycles":62080,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":3285,"apply.run_wall_time_us":3906,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":2369,"prepare.run_wall_time_us":3717,"replication_time_us":2561}]]}
I20260709 13:02:07.076627  1531 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:07.072929  1425 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 9 to 11, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.089759  1425 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 7, term changed from 4 to 10, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.113910  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:07.116518  1674 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:07.117287  7046 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:07.121135  7110 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:07.131664  1425 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 9 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.158812  1678 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:07.160354  7054 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:07.177104  7110 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 8 to 15, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.188293  2258 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 8 to 15, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.201958  2261 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:07.211315  1531 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:07.216341  7016 raft_consensus.cc:993] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:07.216835  7016 raft_consensus.cc:1081] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:07.219028  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 13:02:07.219575  1681 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:07.219882  1681 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.226619  1425 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 2 to 6, term changed from 5 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.229308  1425 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 10 to 12, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.247581  1425 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.253108  1425 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 11, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.262625  1681 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:07.255010  1425 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 14, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.264139  1674 raft_consensus.cc:2955] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 8 to 15, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.247380  7127 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:07.243471  7077 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:02:07.279728  1425 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 7 to 12, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.294791  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:07.295763  1525 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.305230  1525 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:07.312229  1531 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:07.313638  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:07.314342  1606 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:07.314666  1606 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:07.315464  1606 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:07.329574  1425 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 7 to 10, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.406363  1606 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.409154  1681 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:07.429293  1425 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:07.431352  1425 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.457573  1606 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:07.460976  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:07.461632  2258 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:07.562726  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 245277us
I20260709 13:02:07.495690  1681 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:07.589807   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:07.605521  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d36fd60901f543758f2f446ee106cf32 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:07.606313  1418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 142998us
I20260709 13:02:07.621464  7002 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:07.642939  2258 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
W20260709 13:02:07.662778  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 90191.7us
W20260709 13:02:07.702201  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.761359  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.760531  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47797.1us
I20260709 13:02:07.775333  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:07.819768  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48455.8us
I20260709 13:02:07.818295  7151 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.825076  7151 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:07.826128  7151 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:07.850468  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74440.2us
W20260709 13:02:07.879227  7163 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.196s	user 0.003s	sys 0.000s
W20260709 13:02:07.881157  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 92218.1us
I20260709 13:02:07.911005  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:07.911677  1527 raft_consensus.cc:606] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:07.913621  7077 raft_consensus.cc:993] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:07.914166  7077 raft_consensus.cc:1081] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
W20260709 13:02:07.959807  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49239.2us
W20260709 13:02:07.984148  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 94770.3us
I20260709 13:02:08.029382  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:02:08.030157  1678 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:08.030586  1678 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.038515  1678 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.051715  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:08.052623  1527 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:08.053032  1527 raft_consensus.cc:614] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:08.056828  1678 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:08.067101  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58311.6us
I20260709 13:02:08.085098  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:08.086900  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:08.087577  1602 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.091908  7151 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:08.092552  7151 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:08.095031  1602 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:08.095728  7151 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:08.097218  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:08.099035  1531 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:08.104758  1531 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:08.105773  1531 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.107012  1531 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.111069  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:08.113481  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:08.117770  1649 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:08.118813  7151 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:08.119398  7151 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:08.120441  7151 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.129483  7184 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:08.135704  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:08.193881  1531 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:08.210146  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:08.210795  1602 raft_consensus.cc:606] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:08.221004  1429 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 4 to 7, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 8 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.223331  1429 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.224826  1429 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 13, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 13 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.231527  1429 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 8 to 9, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 9 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.234480  1429 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.243711  1429 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.245617  1429 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 11 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:08.230619  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 303) took 15206 ms (client timeout 15000 ms). Trace:
I20260709 13:02:08.248839  1429 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from <none> to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.256924  1429 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 16, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.258334  1429 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:02:08.235422  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 54889.1us
I20260709 13:02:08.233709  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:08.264777  1531 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:08.250128  1425 rpcz_store.cc:269] 0709 13:01:53.024436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.028447 (+  4011us) service_pool.cc:224] Handling call
0709 13:02:08.230544 (+15202097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:07.774919 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:07.844811 (+ 69892us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:07.844847 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:07.844859 (+    12us) tablet.cc:662] Decoding operations
0709 13:02:07.845924 (+  1065us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:07.845998 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:07.846028 (+    30us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:07.847015 (+   987us) tablet.cc:701] Row locks acquired
0709 13:02:07.847033 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:07.847170 (+   137us) write_op.cc:270] Start()
0709 13:02:07.847281 (+   111us) write_op.cc:276] Timestamp: P: 1783602127847123 usec, L: 0
0709 13:02:07.847302 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:07.848015 (+   713us) log.cc:844] Serialized 5236 byte log entry
0709 13:02:07.981878 (+133863us) op_driver.cc:464] REPLICATION: finished
0709 13:02:08.047661 (+ 65783us) write_op.cc:301] APPLY: starting
0709 13:02:08.047770 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:08.086195 (+ 38425us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:08.112377 (+ 26182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:08.166452 (+ 54075us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:08.166711 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:02:08.166760 (+    49us) write_op.cc:312] APPLY: finished
0709 13:02:08.167123 (+   363us) log.cc:844] Serialized 121 byte log entry
0709 13:02:08.167311 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:08.167470 (+   159us) write_op.cc:454] Released schema lock
0709 13:02:08.167530 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:08.168029 (+   499us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:08.168062 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":103218,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":65410,"apply.run_cpu_time_us":17615,"apply.run_wall_time_us":120345,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58597,"num_ops":13,"prepare.queue_time_us":70231,"prepare.run_cpu_time_us":4561,"prepare.run_wall_time_us":88396,"replication_time_us":134394,"spinlock_wait_cycles":1871104,"thread_start_us":149888,"threads_started":2}]]}
I20260709 13:02:08.266279   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:08.268118   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:08.267261  1429 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.271603  1429 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.274602  1429 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 12, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 12 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.280041  1429 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.293797  1429 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.298599  1429 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.303258  1602 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:08.319024  1429 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.320751  1429 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.324605  1429 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 16, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.326196  1429 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 12, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 12 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.327945  1429 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 14, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.331616  1429 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.334395  1429 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 12, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.336702  1429 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.336410  1531 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:08.339902  1429 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 12, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.334082  7180 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:02:08.345629  7186 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:08.344822  1429 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 15, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:08.350286  7108 raft_consensus.cc:993] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:08.349911  1429 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.350757  7108 raft_consensus.cc:1081] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:08.351197  1429 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.353619  1674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:02:08.354148  1674 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:08.355821  1674 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.366726  1429 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 15, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 15 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.370090  1429 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.374395  1429 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 4 to 9, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 9 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.372929  1674 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:08.394619  1429 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 12, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:08.395733  1429 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.400951  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:08.401639  2260 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.408747  1674 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:08.410086  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:08.410704  1529 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:08.410976  1529 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:08.411665  1529 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:08.417536  1529 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.435794  1529 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:08.440630  2260 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:08.442094  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:08.449507  7186 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:08.484881  2260 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:08.462307  7186 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:08.493852  7181 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:08.504334  7171 raft_consensus.cc:993] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:08.510365  7171 raft_consensus.cc:1081] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:08.515077  1674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 13:02:08.515735  1674 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:08.516114  1674 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.525581  1674 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.529157  1674 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:08.532397  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:08.533133  1604 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:08.533455  1604 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:08.534309  1604 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.535656  1604 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.504355  7186 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:08.540428  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:08.542351  1531 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.549681  7170 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:08.550328  7170 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:08.555496  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:08.555778  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:08.556129  1529 raft_consensus.cc:1813] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Handling vote request from an unknown peer 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:08.556847  1529 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:08.557649  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:08.561563  7193 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:08.564705  1573 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:08.566318  1531 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:08.569666  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:08.570057  7016 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.566785  7170 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:08.573825  7181 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:08.590503  1602 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:08.597458  1604 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:08.609253  7180 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:08.635267  7016 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.666224  7181 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:08.710997  7181 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:08.716884  1531 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:08.719671  7186 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:08.867101  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57323.8us
I20260709 13:02:09.004127  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:09.006327  6914 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:09.034785  1531 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:09.036332  6914 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:09.163532  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 299) took 2066 ms. Trace:
I20260709 13:02:09.179018  1531 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:09.181007  1427 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.164027  1429 rpcz_store.cc:276] 0709 13:02:07.097556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.097856 (+   300us) service_pool.cc:224] Handling call
0709 13:02:09.163409 (+2065553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:08.552788 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:08.553321 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:08.553355 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:08.553372 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:08.598710 (+ 45338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:08.598795 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:08.598821 (+    26us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:02:08.600870 (+  2049us) tablet.cc:701] Row locks acquired
0709 13:02:08.600889 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:08.601031 (+   142us) write_op.cc:270] Start()
0709 13:02:08.601157 (+   126us) write_op.cc:276] Timestamp: P: 1783602128600983 usec, L: 0
0709 13:02:08.604536 (+  3379us) op_driver.cc:348] REPLICATION: starting
0709 13:02:08.611844 (+  7308us) log.cc:844] Serialized 12994 byte log entry
0709 13:02:08.663816 (+ 51972us) op_driver.cc:464] REPLICATION: finished
0709 13:02:08.664546 (+   730us) write_op.cc:301] APPLY: starting
0709 13:02:08.664641 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:08.869819 (+205178us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:08.876339 (+  6520us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:09.041178 (+164839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:09.052690 (+ 11512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=0,mrs_lookups=0
0709 13:02:09.052735 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:09.053245 (+   510us) log.cc:844] Serialized 284 byte log entry
0709 13:02:09.072480 (+ 19235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.072716 (+   236us) write_op.cc:454] Released schema lock
0709 13:02:09.072785 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:09.101373 (+ 28588us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.101414 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7516,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":464,"apply.run_cpu_time_us":39512,"apply.run_wall_time_us":436769,"cfile_cache_hit":132,"cfile_cache_hit_bytes":138270,"num_ops":33,"prepare.queue_time_us":58539,"prepare.run_cpu_time_us":7052,"prepare.run_wall_time_us":69999,"replication_time_us":59136,"thread_start_us":52423,"threads_started":1}]]}
I20260709 13:02:09.214368  2258 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:09.216454  1601 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:09.218020  7046 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:09.219784  6977 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:09.236896  1678 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:09.242934  7174 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:09.245618  1529 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:09.248998  7198 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:09.269479   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:09.301558  1429 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:09.303378  1429 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.304733  1429 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 8 to 15, term changed from 17 to 18, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 18 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.306228  1429 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 13, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.308848  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet a266117eb57049ceb80c4acd77766559 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:09.326889  7205 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.355778  1678 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.378089  2260 raft_consensus.cc:2955] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.382689  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet d36fd60901f543758f2f446ee106cf32 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:09.380048  7223 tablet_replica.cc:333] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:02:09.386565  7223 raft_consensus.cc:2243] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.388897  7223 raft_consensus.cc:2272] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.397481  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0746dbce2334050a0a5359c93c14f2c with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:09.402954  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 315) took 18825 ms (client timeout 15000 ms). Trace:
I20260709 13:02:09.419543  7224 tablet_replica.cc:333] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:02:09.420809  7224 raft_consensus.cc:2243] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.421635  7224 raft_consensus.cc:2272] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.428409  7224 ts_tablet_manager.cc:1916] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:09.413579  1428 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 11 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.437719  1428 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 13, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.460646  1428 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.447556  7223 ts_tablet_manager.cc:1916] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:09.406775  1427 rpcz_store.cc:269] 0709 13:01:50.577957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.578270 (+   313us) service_pool.cc:224] Handling call
0709 13:01:50.706016 (+127746us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5400030890. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0d0b2 00007f7e69986a89 00007f7e6991eda6 00007f7e698f0088 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc
0709 13:02:09.402843 (+18696827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:09.241164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:09.241685 (+   521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:09.241720 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:02:09.241737 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:09.242040 (+   303us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:09.242106 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:09.242138 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:09.242320 (+   182us) tablet.cc:701] Row locks acquired
0709 13:02:09.242337 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:09.242497 (+   160us) write_op.cc:270] Start()
0709 13:02:09.242920 (+   423us) write_op.cc:276] Timestamp: P: 1783602129242450 usec, L: 0
0709 13:02:09.242943 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:09.243545 (+   602us) log.cc:844] Serialized 536 byte log entry
0709 13:02:09.273172 (+ 29627us) op_driver.cc:464] REPLICATION: finished
0709 13:02:09.279394 (+  6222us) write_op.cc:301] APPLY: starting
0709 13:02:09.279480 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:09.280278 (+   798us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:09.280400 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:09.281494 (+  1094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:09.281635 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:09.281676 (+    41us) write_op.cc:312] APPLY: finished
0709 13:02:09.281835 (+   159us) log.cc:844] Serialized 25 byte log entry
0709 13:02:09.281993 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.282078 (+    85us) write_op.cc:454] Released schema lock
0709 13:02:09.282114 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:09.282415 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.282445 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223678,"reported_tablets":50,"spinlock_wait_cycles":3665536,"child_traces":[["op",{"apply.queue_time_us":1742,"apply.run_cpu_time_us":3029,"apply.run_wall_time_us":3716,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":39327,"prepare.run_cpu_time_us":2571,"prepare.run_wall_time_us":25512,"replication_time_us":30056,"thread_start_us":10873,"threads_started":1}]]}
I20260709 13:02:09.463310  1428 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 8 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 16 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.489831  1428 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 13, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 13 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:09.425724  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 108580us
I20260709 13:02:09.507083  1428 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 15 to 20, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.516201  1428 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 9 to 17, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.534727  1428 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 16 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.536624  1428 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:09.538911  7223 ts_tablet_manager.cc:1929] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 13:02:09.542035  7223 log.cc:1199] T a266117eb57049ceb80c4acd77766559 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/a266117eb57049ceb80c4acd77766559
I20260709 13:02:09.548103  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet a266117eb57049ceb80c4acd77766559 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:09.553686  7224 ts_tablet_manager.cc:1929] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 13:02:09.554171  7224 log.cc:1199] T d36fd60901f543758f2f446ee106cf32 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/d36fd60901f543758f2f446ee106cf32
I20260709 13:02:09.568658  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet d36fd60901f543758f2f446ee106cf32 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:09.600258  1429 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:09.694133  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet a266117eb57049ceb80c4acd77766559 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:09.696149  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet a266117eb57049ceb80c4acd77766559 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:09.709403  1429 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 7 to 11, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.717832  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 304) took 1595 ms. Trace:
I20260709 13:02:09.729414  1428 rpcz_store.cc:276] 0709 13:02:08.121999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.122138 (+   139us) service_pool.cc:224] Handling call
0709 13:02:09.717768 (+1595630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:09.563701 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:09.564252 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:09.564300 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:02:09.564343 (+    43us) tablet.cc:662] Decoding operations
0709 13:02:09.565257 (+   914us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:09.565331 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:09.565360 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:09.566060 (+   700us) tablet.cc:701] Row locks acquired
0709 13:02:09.566078 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:09.566223 (+   145us) write_op.cc:270] Start()
0709 13:02:09.566329 (+   106us) write_op.cc:276] Timestamp: P: 1783602129566172 usec, L: 0
0709 13:02:09.566348 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:09.566940 (+   592us) log.cc:844] Serialized 3597 byte log entry
0709 13:02:09.569490 (+  2550us) op_driver.cc:464] REPLICATION: finished
0709 13:02:09.569975 (+   485us) write_op.cc:301] APPLY: starting
0709 13:02:09.570047 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:09.574524 (+  4477us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:09.574616 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:09.597024 (+ 22408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:09.597219 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:02:09.597259 (+    40us) write_op.cc:312] APPLY: finished
0709 13:02:09.597523 (+   264us) log.cc:844] Serialized 89 byte log entry
0709 13:02:09.598305 (+   782us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.598433 (+   128us) write_op.cc:454] Released schema lock
0709 13:02:09.598486 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:09.598862 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.598894 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5775,"reported_tablets":49,"spinlock_wait_cycles":19200,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":11459,"apply.run_wall_time_us":28848,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37710,"num_ops":9,"prepare.queue_time_us":320,"prepare.run_cpu_time_us":3553,"prepare.run_wall_time_us":5714,"replication_time_us":3025}]]}
I20260709 13:02:09.763353  1430 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet a266117eb57049ceb80c4acd77766559 with cas_config_opid_index 4: aborting the task: latest config opid_index 7; task opid_index 4
W20260709 13:02:09.788475  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 188) took 21812 ms (client timeout 15000 ms). Trace:
W20260709 13:02:09.796461  1430 rpcz_store.cc:269] 0709 13:01:47.986519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.004723 (+ 18204us) service_pool.cc:224] Handling call
0709 13:02:09.788386 (+21783663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15657,"reported_tablets":35}
I20260709 13:02:09.729317  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet e0746dbce2334050a0a5359c93c14f2c with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:09.801759  7224 tablet_replica.cc:333] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:02:09.807647  7224 raft_consensus.cc:2243] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.814669  1431 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet a266117eb57049ceb80c4acd77766559 with cas_config_opid_index 4: aborting the task: latest config opid_index 7; task opid_index 4
I20260709 13:02:09.813279  7224 raft_consensus.cc:2272] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.818734  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 186) took 57844 ms (client timeout 15000 ms). Trace:
W20260709 13:02:09.819139  1431 rpcz_store.cc:269] 0709 13:01:11.974896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.975115 (+   219us) service_pool.cc:224] Handling call
0709 13:02:09.818647 (+57843532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24950,"reported_tablets":35,"spinlock_wait_cycles":1792}
I20260709 13:02:09.820541  7224 ts_tablet_manager.cc:1916] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:09.922011  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51000.1us
W20260709 13:02:10.004823  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73908us
I20260709 13:02:10.058871  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet a266117eb57049ceb80c4acd77766559 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:58882
W20260709 13:02:10.065326  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 302) took 46015 ms (client timeout 15000 ms). Trace:
W20260709 13:02:10.065896  1432 rpcz_store.cc:269] 0709 13:01:24.050277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.053726 (+  3449us) service_pool.cc:224] Handling call
0709 13:02:10.065126 (+46011400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56278,"reported_tablets":49,"spinlock_wait_cycles":2304}
I20260709 13:02:10.067770  7224 ts_tablet_manager.cc:1929] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:02:10.068301  7224 log.cc:1199] T e0746dbce2334050a0a5359c93c14f2c P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/e0746dbce2334050a0a5359c93c14f2c
W20260709 13:02:10.076921  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 142333us
I20260709 13:02:10.061141  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet a266117eb57049ceb80c4acd77766559 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.126957  1678 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:10.134850  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51108.5us
W20260709 13:02:10.142587  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 97379.5us
I20260709 13:02:10.169787  2258 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:10.196485  1426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 189) took 5137 ms. Trace:
I20260709 13:02:10.197229  1426 rpcz_store.cc:276] 0709 13:02:05.004461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.004714 (+   253us) service_pool.cc:224] Handling call
0709 13:02:10.141751 (+5137037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117051,"reported_tablets":35}
W20260709 13:02:10.215502  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 178056us
W20260709 13:02:10.216233  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 70028.1us
I20260709 13:02:10.218906  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet e0746dbce2334050a0a5359c93c14f2c (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.255981  2261 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:10.259595  7226 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:10.263180  1529 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:10.265697  1529 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:10.272607  7236 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:10.273905  1676 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:10.301473  7236 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:02:10.316375  6977 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:10.322729  7127 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.328356  1531 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.360611  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87db66ba9ff145009d8e513e5d0ef1e4 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:10.376670  7226 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.384840  2261 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.391489  1676 raft_consensus.cc:2955] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.408200  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e2ca98d137184e478468c21f485fafa4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:10.423026  1428 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 6 to 10, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.428746  1432 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 4 to 9, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.434631  1529 raft_consensus.cc:2955] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:10.446358  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet e0746dbce2334050a0a5359c93c14f2c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:10.448210  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet e0746dbce2334050a0a5359c93c14f2c (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.461897  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet d36fd60901f543758f2f446ee106cf32 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 15)) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:10.463450  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet d36fd60901f543758f2f446ee106cf32 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.464676  1424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 316) took 4541 ms. Trace:
I20260709 13:02:10.465077  1424 rpcz_store.cc:276] 0709 13:02:05.922972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.927955 (+  4983us) service_pool.cc:224] Handling call
0709 13:02:10.464517 (+4536562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7328,"reported_tablets":50}
I20260709 13:02:10.484612   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.528362  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet 87db66ba9ff145009d8e513e5d0ef1e4 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:10.529353  7224 tablet_replica.cc:333] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:02:10.530414  7224 raft_consensus.cc:2243] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:10.531399  7224 raft_consensus.cc:2272] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:10.557268  1592 tablet_service.cc:1558] Processing DeleteTablet for tablet e2ca98d137184e478468c21f485fafa4 with delete_type TABLET_DATA_TOMBSTONED (TS 428f0180c2cd487c8b48e91f14dff65d not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59792
I20260709 13:02:10.584069  7224 ts_tablet_manager.cc:1916] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:10.653597  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01534d11942740ccb67a981fcde65180"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:10.654206  1680 raft_consensus.cc:606] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:10.655447  7224 ts_tablet_manager.cc:1929] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:02:10.655928  7224 log.cc:1199] T 87db66ba9ff145009d8e513e5d0ef1e4 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/87db66ba9ff145009d8e513e5d0ef1e4
I20260709 13:02:10.683087  7224 tablet_replica.cc:333] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:02:10.684690  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet 87db66ba9ff145009d8e513e5d0ef1e4 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.695092  7224 raft_consensus.cc:2243] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:10.695843  7224 raft_consensus.cc:2272] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:10.700697  7224 ts_tablet_manager.cc:1916] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:10.707968  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:10.708848  1676 raft_consensus.cc:606] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:10.712121  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:10.712771  1602 raft_consensus.cc:606] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:10.715946  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:10.716548  1676 raft_consensus.cc:606] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:10.719475  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:10.720078  1602 raft_consensus.cc:606] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:10.721483   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:10.723132   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:10.734732  7232 raft_consensus.cc:993] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:10.735280  7232 raft_consensus.cc:1081] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:10.737327  7224 ts_tablet_manager.cc:1929] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.8
I20260709 13:02:10.737836  7224 log.cc:1199] T e2ca98d137184e478468c21f485fafa4 P 428f0180c2cd487c8b48e91f14dff65d: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-1-root/wals/e2ca98d137184e478468c21f485fafa4
I20260709 13:02:10.739387  1419 catalog_manager.cc:5028] TS 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): tablet e2ca98d137184e478468c21f485fafa4 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:10.740221  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33608
I20260709 13:02:10.740877  1531 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.741223  1531 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.755738  1531 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:10.771064  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:10.771682  1676 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.783584  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:10.784632  1602 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:10.785037  1602 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:10.785912  1602 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:10.786815  1602 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.790423  1676 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:10.791227  1680 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:10.792030  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:10.792950  7205 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:10.793401  7205 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:10.794255  7205 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:10.815658  6889 raft_consensus.cc:993] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:10.816185  6889 raft_consensus.cc:1081] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:10.818322  2258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:02:10.818975  2258 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.819347  2258 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.828526  1531 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:10.834087  1602 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:10.848001  1424 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.859798  2258 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:10.865574  2258 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:10.867978  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:10.868680  1531 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.870267  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:10.874965  1602 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:10.876581  1602 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:10.877521  1602 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:10.878865  1602 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.883352  1531 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:10.884655  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:10.885921  1602 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:10.885851  7236 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:10.916604  7236 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:10.920440  7236 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:10.947815  1424 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 11 to 12, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.996547  7226 raft_consensus.cc:993] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:10.997052  7226 raft_consensus.cc:1081] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:10.999644  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:02:11.000190  1602 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.000545  1602 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.008421  7228 raft_consensus.cc:993] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:11.008967  7228 raft_consensus.cc:1081] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:11.010610  2261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01534d11942740ccb67a981fcde65180"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 13:02:11.011179  2261 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.011516  2261 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.022830  2261 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.028378  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:11.029063  1601 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.028784  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:11.029772  1676 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:11.030068  1676 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:11.030786  1676 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.031875  1676 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.026975  1602 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:11.028585  2261 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:11.035982  1602 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:11.036809  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:11.036968  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:11.037405  1531 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.037564  1680 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:11.038726  1680 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:11.039564  1680 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:11.040866  1680 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.046686  1676 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:11.050062  1531 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:11.058037  1680 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:11.067931  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:11.069176  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:11.070019  6889 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:11.070551  6889 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:11.071439  6889 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:11.073267  7236 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:11.073884  7236 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:11.074856  7236 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.054049  1601 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:11.113914  1424 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 13 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.115053  1432 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 14 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.120051  7228 raft_consensus.cc:993] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:11.120632  7228 raft_consensus.cc:1081] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:11.122577  2261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 13:02:11.123173  2261 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.123515  2261 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.151158  2261 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.154498  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:11.155146  1531 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.155205  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:11.156070  1680 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:11.156446  1680 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:11.157225  1680 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.158041  2261 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:11.158427  1680 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.166244  1531 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:11.175061  1601 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:11.175153  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:11.176294  7236 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:11.176834  7236 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:11.177778  7236 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:11.182338  7229 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:11.183578  1680 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:11.232846  1432 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 11 to 12, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.254891  1680 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:11.256580  7159 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:11.394064  1602 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:11.395869  7236 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:11.459679  1531 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:11.461282  7247 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:11.496435  1531 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:11.501117  6889 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:11.542507  1602 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:11.544325  7127 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.555516  1680 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:11.557824  7127 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.615509  1676 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:11.617467  7232 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:11.664490  1529 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:11.667007  7127 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:11.724472   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.732832  1676 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:11.734750  7127 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:12.036108  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70975.1us
I20260709 13:02:12.063071  1680 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:12.201018  1601 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:12.204502  1528 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:12.202632  7267 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:02:12.215983  1647 consensus_peers.cc:597] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8322d0fcf8904d3f8e1b6f9d1f2db7ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.218304  7198 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:02:12.226682  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55519.9us
W20260709 13:02:12.382124  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 106977us
I20260709 13:02:12.422005  1529 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.417029  7225 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.449553  1601 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.475471  1424 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.521451  1602 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:12.567814  1682 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:02:12.570434  1573 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15aeeeb202e74ebd91872b6a150c5ddc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.570624  7270 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:12.577762  1528 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:12.580634  7270 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:12.605894  7270 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.608757  1682 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.626138  1676 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:12.631565  1528 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.666335  1602 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:12.666548  1432 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.667970  7278 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:12.680289  1647 consensus_peers.cc:597] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a63db4a447849f8a1a34a53cd5ccefa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.749516  1528 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:12.751590  7228 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:12.753062  1602 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.779285  1528 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.801414  1431 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.813452  7293 ts_tablet_manager.cc:933] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:12.800836  7198 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.856770  7293 tablet_copy_client.cc:323] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 13:02:12.858973  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 13:02:12.859537  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-8322d0fcf8904d3f8e1b6f9d1f2db7ba
I20260709 13:02:12.866094   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.875876  1692 tablet_copy_source_session.cc:215] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:12.880764  1606 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:12.882944  7293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:12.917215  1682 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:12.920387  7232 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:12.922612  1573 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 460ae43de4d04023a24854ca2a19da88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.928490  1528 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:12.934653  7232 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:12.948122  7277 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.949846  1676 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:12.954525  7293 tablet_copy_client.cc:806] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:12.955158  7293 tablet_copy_client.cc:670] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:12.969152  7293 tablet_copy_client.cc:538] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:12.993335  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:12.993968  1676 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:12.999327  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:12.999898  1528 raft_consensus.cc:606] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:13.001255  1431 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:13.006145  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:13.006718  1682 raft_consensus.cc:606] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:13.010192  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:13.010741  1606 raft_consensus.cc:606] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:13.014839  1531 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:13.019645  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:13.020257  1682 raft_consensus.cc:606] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:13.035686   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:13.037338   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:13.084614  7293 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:02:13.153908  7299 ts_tablet_manager.cc:933] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:13.160377  7276 raft_consensus.cc:993] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.160929  7276 raft_consensus.cc:1081] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.162829  2258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:02:13.163383  2258 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.163731  2258 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.191370  7198 raft_consensus.cc:993] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:13.191866  7198 raft_consensus.cc:1081] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:13.193975  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:02:13.194540  1531 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.194859  1531 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.207686  1531 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:13.221632  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:13.222292  1602 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.230149  1602 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:13.222368  2258 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.232399  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:13.238668  1682 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:13.239032  1682 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:13.239562  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:13.239842  1682 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:13.241009  1682 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.244552  7282 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:13.245108  7282 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:13.245954  7282 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:13.233251  7299 tablet_copy_client.cc:323] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 13:02:13.250372  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 15aeeeb202e74ebd91872b6a150c5ddc from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 13:02:13.250924  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 15aeeeb202e74ebd91872b6a150c5ddc from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-15aeeeb202e74ebd91872b6a150c5ddc
I20260709 13:02:13.268339  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:13.269321  1601 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.238014  1531 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:13.272738  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:13.273356  1530 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:13.273631  1530 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:13.274356  1530 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.275501  1530 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.276868  2258 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:13.295699  1601 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:13.299436  1682 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:13.300065  1619 tablet_copy_source_session.cc:215] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:13.309726  1530 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:13.313164  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:13.314126  7273 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:13.314635  7273 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:13.315480  7273 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.317005  7299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aeeeb202e74ebd91872b6a150c5ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.329949  1431 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 16 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:13.360499  7293 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.365708  1432 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 12 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 13 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.368345  7293 tablet_bootstrap.cc:492] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:02:13.374061  7293 ts_tablet_manager.cc:1403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 0.290s	user 0.054s	sys 0.046s
I20260709 13:02:13.372689  7304 ts_tablet_manager.cc:933] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:13.377923  7293 raft_consensus.cc:359] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:13.378844  7293 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:02:13.379498  7293 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:13.382112  7267 raft_consensus.cc:993] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:13.382695  7267 raft_consensus.cc:1081] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:13.384292  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:02:13.384868  1602 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.385228  1602 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.401106  7293 ts_tablet_manager.cc:1434] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:02:13.413136  1602 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:13.417116  1602 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:13.418304  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:13.418695  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:13.420745  1530 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.420835  1682 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.421325  1682 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:13.423681  6889 raft_consensus.cc:993] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.423298  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8322d0fcf8904d3f8e1b6f9d1f2db7ba received from {username='slave'} at 127.0.0.1:33564
I20260709 13:02:13.424197  6889 raft_consensus.cc:1081] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.424546  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-8322d0fcf8904d3f8e1b6f9d1f2db7ba on tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:13.426234  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:02:13.426777  2260 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.427175  2260 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.422127  1682 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:13.440013  1682 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.449427  1682 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:13.451148  1530 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:13.451833  1531 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.444196  7303 ts_tablet_manager.cc:933] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:13.452071  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:13.458817  7228 raft_consensus.cc:993] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.459371  7228 raft_consensus.cc:1081] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:13.456501  7270 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:13.460767  7270 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:13.461891  7270 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:13.483500  2258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 13:02:13.484237  2258 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.484699  2258 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:13.485077  2260 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.482663  7304 tablet_copy_client.cc:323] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 13:02:13.508880  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:13.509557  1602 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:13.509840  1602 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:13.514488  1602 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.515604  1602 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.514330  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 6a63db4a447849f8a1a34a53cd5ccefa from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 13:02:13.517180  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 6a63db4a447849f8a1a34a53cd5ccefa from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-6a63db4a447849f8a1a34a53cd5ccefa
I20260709 13:02:13.524165  1692 tablet_copy_source_session.cc:215] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:13.516343  6889 consensus_queue.cc:1175] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 16 status { last_received { term: 16 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 16 index: 13 } }
I20260709 13:02:13.527985  7304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a63db4a447849f8a1a34a53cd5ccefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.530843  2258 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.544157  7299 tablet_copy_client.cc:806] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:13.560032  7299 tablet_copy_client.cc:670] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:13.571389  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:13.572108  1529 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:13.578156  1602 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:13.579483  2258 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:13.596417  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:13.599285  1682 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:13.602839  1682 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:13.596038  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:13.604950  1682 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.605775  7273 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:13.606724  7299 tablet_copy_client.cc:538] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:13.608678  7273 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:13.606626  1432 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:13.608925  1682 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:13.610160  1529 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:13.608206  2260 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:13.612847  7273 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.621683  7303 tablet_copy_client.cc:323] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 13:02:13.631008  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 460ae43de4d04023a24854ca2a19da88 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 13:02:13.631594  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 460ae43de4d04023a24854ca2a19da88 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-460ae43de4d04023a24854ca2a19da88
I20260709 13:02:13.650018  1682 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
W20260709 13:02:13.651469  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54331us
I20260709 13:02:13.653787  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:13.654378  1674 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.659602  1619 tablet_copy_source_session.cc:215] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:13.665529  1674 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:13.670096  7299 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:02:13.689467  1602 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:13.691324  7230 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:13.719094  7304 tablet_copy_client.cc:806] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:13.719954  7304 tablet_copy_client.cc:670] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:13.725627  7303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460ae43de4d04023a24854ca2a19da88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.736181  1432 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 16 to 17, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 17 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.777417  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:13.779227  1674 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:13.794659  7312 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:13.795279  7312 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:13.796213  7312 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:13.828843  7304 tablet_copy_client.cc:538] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:13.824494  7282 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:02:13.925453  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49949.2us
W20260709 13:02:13.982779  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54832us
I20260709 13:02:13.949293  1432 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 15 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 16 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:13.998827  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54887.6us
I20260709 13:02:14.086908   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:14.171011  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 186013us
I20260709 13:02:14.207664  1602 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:14.237576  1602 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:14.241564  7273 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:14.247879  1674 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:14.255759  6889 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:14.273617  7304 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
W20260709 13:02:14.276356  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 272055us
I20260709 13:02:14.257640  7273 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:02:14.352852  1529 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:14.385803  1530 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:14.388247  6889 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:14.416191  7303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48926 (request call id 1221) took 1109 ms. Trace:
I20260709 13:02:14.447184  1674 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:14.453758  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67391.6us
W20260709 13:02:14.511264  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 87154.2us
W20260709 13:02:14.523415  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 125265us
I20260709 13:02:14.456251  7338 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 13:02:14.529237  7343 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:14.433648  7303 rpcz_store.cc:276] 0709 13:02:13.306341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.307675 (+  1334us) service_pool.cc:224] Handling call
0709 13:02:13.456431 (+148756us) ts_tablet_manager.cc:934] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
0709 13:02:13.724180 (+267749us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:14.253516 (+529336us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:14.259197 (+  5681us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:14.415249 (+156052us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:14.415645 (+   396us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:14.416021 (+   376us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:14.416087 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30963,"tablet-copy.queue_time_us":107558,"thread_start_us":149052,"threads_started":2}
I20260709 13:02:14.533624  7303 tablet_copy_client.cc:806] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:14.534482  7303 tablet_copy_client.cc:670] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:14.547058  2261 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Advancing to term 15
I20260709 13:02:14.562961  2261 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:14.581027  7298 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:14.581525  1676 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:14.591878  1530 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:14.593127  7347 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 13:02:14.576968  7303 tablet_copy_client.cc:538] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:14.633694  7312 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:14.634213  7299 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
W20260709 13:02:14.721871  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 101424us
W20260709 13:02:14.749456  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 81535.1us
I20260709 13:02:14.692343  7334 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260709 13:02:14.810114  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 64468us
I20260709 13:02:14.776233  7332 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
W20260709 13:02:14.840118  7299 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:02:14.941247  7357 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:02:14.965157  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 139920us
W20260709 13:02:14.966562  7356 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:02:15.001406  7303 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
W20260709 13:02:14.994642  7367 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:15.028956  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51211.3us
W20260709 13:02:15.033039  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 272559us
I20260709 13:02:15.155777  7299 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:15.157060  7299 tablet_bootstrap.cc:492] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
W20260709 13:02:15.183518  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 141992us
I20260709 13:02:15.249624  6889 raft_consensus.cc:1064] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
W20260709 13:02:15.257543  7304 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:15.313922  7299 ts_tablet_manager.cc:1403] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.645s	user 0.069s	sys 0.007s
I20260709 13:02:15.316931  6889 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:15.391942   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:15.412581  2252 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:15.412926  1674 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:15.432569  1534 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:15.451380  7325 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:15.457929  7309 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:15.475569  7304 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:15.477078  7304 tablet_bootstrap.cc:492] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:02:15.486245  7304 ts_tablet_manager.cc:1403] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.233s	user 0.062s	sys 0.030s
W20260709 13:02:15.484042  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 44879.8us
I20260709 13:02:15.486955  7299 raft_consensus.cc:359] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:15.487965  7299 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:02:15.560293  7299 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:15.803361  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 109469us
W20260709 13:02:15.804452  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 105074us
W20260709 13:02:15.828725  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 113800us
W20260709 13:02:15.838835  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 164821us
I20260709 13:02:15.840996  7309 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:15.866621  2252 raft_consensus.cc:1217] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:02:15.919884  7350 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:15.933207  7299 ts_tablet_manager.cc:1434] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.609s	user 0.006s	sys 0.011s
W20260709 13:02:15.933656  7299 ts_tablet_manager.cc:1467] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 619ms
W20260709 13:02:15.949986  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80738us
W20260709 13:02:15.957551  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53962.3us
W20260709 13:02:15.934006  7299 ts_tablet_manager.cc:1469] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:02:13.094235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.094390 (+   155us) service_pool.cc:224] Handling call
0709 13:02:13.154289 (+ 59899us) ts_tablet_manager.cc:934] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
0709 13:02:13.316011 (+161722us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:13.496102 (+180091us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:13.496216 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:13.543244 (+ 47028us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:13.543541 (+   297us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:13.543857 (+   316us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:13.543918 (+    61us) inbound_call.cc:177] Queueing success response
0709 13:02:13.668359 (+124441us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:02:15.324053 (+1655694us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:02:15.327557 (+  3504us) tablet_replica.cc:261] Starting instrumentation
0709 13:02:15.381665 (+ 54108us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":281,"mutex_wait_us":12111,"raft.queue_time_us":17165,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":1697,"tablet-copy.queue_time_us":59016,"tablet-download-pool.queue_time_us":112,"tablet-download-pool.run_cpu_time_us":1010,"tablet-download-pool.run_wall_time_us":30044,"thread_start_us":119741,"threads_started":2}
I20260709 13:02:15.838644  7304 raft_consensus.cc:359] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:15.977185  7304 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
W20260709 13:02:16.043124  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64646.9us
W20260709 13:02:16.051440  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52874.1us
I20260709 13:02:16.030876  1682 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.040921  7304 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:16.090960  7304 ts_tablet_manager.cc:1434] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.588s	user 0.010s	sys 0.007s
W20260709 13:02:16.091315  7304 ts_tablet_manager.cc:1467] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 588ms
W20260709 13:02:16.091614  7304 ts_tablet_manager.cc:1469] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:02:13.285711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.291494 (+  5783us) service_pool.cc:224] Handling call
0709 13:02:13.380373 (+ 88879us) ts_tablet_manager.cc:934] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
0709 13:02:13.526703 (+146330us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:13.608942 (+ 82239us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:13.609071 (+   129us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:13.718056 (+108985us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:13.718424 (+   368us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:13.718797 (+   373us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:13.718872 (+    75us) inbound_call.cc:177] Queueing success response
0709 13:02:14.240179 (+521307us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:02:15.503034 (+1262855us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:02:15.516021 (+ 12987us) tablet_replica.cc:261] Starting instrumentation
0709 13:02:15.516683 (+   662us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":42664,"mutex_wait_us":40399,"tablet-copy.queue_time_us":62689,"tablet-download-pool.queue_time_us":5792,"tablet-download-pool.run_cpu_time_us":1069,"tablet-download-pool.run_wall_time_us":72073,"thread_start_us":58370,"threads_started":2}
W20260709 13:02:16.103056  1647 consensus_peers.cc:597] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:16.185283  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-15aeeeb202e74ebd91872b6a150c5ddc received from {username='slave'} at 127.0.0.1:49526
I20260709 13:02:16.185958  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-15aeeeb202e74ebd91872b6a150c5ddc on tablet 15aeeeb202e74ebd91872b6a150c5ddc with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:16.190806  1525 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.229041  2256 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.233322  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-6a63db4a447849f8a1a34a53cd5ccefa received from {username='slave'} at 127.0.0.1:33564
I20260709 13:02:16.233850  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-6a63db4a447849f8a1a34a53cd5ccefa on tablet 6a63db4a447849f8a1a34a53cd5ccefa with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:16.247352  1431 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 10 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:16.282953  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 133306us
I20260709 13:02:16.342376  7303 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=3 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:16.343562  7303 tablet_bootstrap.cc:492] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:02:16.349951  7350 raft_consensus.cc:1064] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:02:16.353485  7303 ts_tablet_manager.cc:1403] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 1.352s	user 0.061s	sys 0.006s
I20260709 13:02:16.353396  7350 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.364948  7303 raft_consensus.cc:359] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:16.365883  7303 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:02:16.382844  7303 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:16.390059  7303 ts_tablet_manager.cc:1434] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:02:16.391788  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-460ae43de4d04023a24854ca2a19da88 received from {username='slave'} at 127.0.0.1:49526
I20260709 13:02:16.392292  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-460ae43de4d04023a24854ca2a19da88 on tablet 460ae43de4d04023a24854ca2a19da88 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:16.421959  2256 raft_consensus.cc:1217] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEARNER]: Deduplicated request from leader. Original: 12.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 13:02:16.462293  2252 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:16.464237  1533 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:16.464998  7392 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:16.466199  1677 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:16.473640  7402 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:16.479993  7330 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:16.506735  1600 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.514703  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:16.515574  1603 raft_consensus.cc:606] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:16.608522  1680 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:16.610358  2256 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:16.616501  7321 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:16.634315  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
mode: GRACEFUL
new_leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:45008
I20260709 13:02:16.635076  1527 raft_consensus.cc:606] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Received request to transfer leadership to TS b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:16.642166   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:16.644248   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:16.644661  7350 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:02:16.680394  2256 raft_consensus.cc:1217] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:02:16.690707  7323 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:16.705688  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67117.8us
I20260709 13:02:16.699568  1527 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.751686  7402 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.757360  2257 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.769336  1426 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.774672  2252 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.782021  1681 raft_consensus.cc:2955] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.781780  1680 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.802510  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:16.814371  7282 raft_consensus.cc:993] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:16.814955  7282 raft_consensus.cc:1081] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:16.816655  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42552
I20260709 13:02:16.817229  1677 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.817584  1677 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.830925  1677 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.836489  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:16.837169  1533 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:16.837466  1533 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:16.838346  1533 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.839879  1533 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.862969  1432 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:16.913410  1677 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:16.915876  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:16.924592  2257 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.936534  1533 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:16.938058  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:16.938942  7411 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:16.939457  7411 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:16.940349  7411 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.943768  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37990
I20260709 13:02:16.952072  2257 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:16.858625  1600 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:16.988214  2257 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:16.990073  1527 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:16.991349  7402 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:16.996593  7323 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:16.988255  7414 tablet_replica.cc:333] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:02:17.007797  7321 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.024771  1527 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.032495  7411 raft_consensus.cc:1064] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:02:17.033524  2252 raft_consensus.cc:2955] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.037017  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15aeeeb202e74ebd91872b6a150c5ddc with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:17.036213  7411 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:17.050487  7170 raft_consensus.cc:993] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: : Instructing follower b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:17.051081  7170 raft_consensus.cc:1081] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Signalling peer b88b12b461734b3aa6a3da4f5c22c79b to start an election
I20260709 13:02:17.054112  1680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
 from {username='slave'} at 127.0.0.1:42562
I20260709 13:02:17.054647  1680 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:17.054996  1680 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.038515  1424 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 13 to 14, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.065464  7414 raft_consensus.cc:2243] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:17.066529  7414 raft_consensus.cc:2272] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:17.071035  7414 ts_tablet_manager.cc:1916] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:17.072577  1680 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:17.076778  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:17.077406  1533 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.091517  1533 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:17.095567  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:17.096298  1603 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:17.096818  1603 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:17.097620  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:17.097668  1603 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:17.098914  1603 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.098927  7395 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:17.102658  1431 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.100662  7395 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:17.108264  7395 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:17.111191  1603 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:17.096418  1680 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:17.120695  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aeeeb202e74ebd91872b6a150c5ddc with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:17.158440  1603 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:17.159919  7395 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:17.166591  7414 ts_tablet_manager.cc:1929] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:02:17.167954  7414 log.cc:1199] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/8322d0fcf8904d3f8e1b6f9d1f2db7ba
I20260709 13:02:17.170539  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 8322d0fcf8904d3f8e1b6f9d1f2db7ba (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:17.171954  2260 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:17.199847  1527 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:17.201923  7399 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:17.206749  7417 tablet_replica.cc:333] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:02:17.208020  7417 raft_consensus.cc:2243] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:17.204870  1424 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 13, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.220455  7395 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:17.241469  7402 raft_consensus.cc:1064] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:02:17.254606  7417 raft_consensus.cc:2272] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:17.256214  7402 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:17.367660  7417 ts_tablet_manager.cc:1916] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:17.371323  1527 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:17.378931  7411 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.383379  1533 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:17.397979  1680 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:17.402233  1601 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.428208  7401 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:17.439088  7321 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:17.440613  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 64528.2us
I20260709 13:02:17.443625  7339 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:17.444216  2260 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:17.452893  2260 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:17.488461  7395 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:17.473598  7323 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:02:17.498405  1529 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.497448  1424 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 11 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.515862  2258 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } attrs { replace: true } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.535840  1682 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:17.608989  1601 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:02:17.613481  2256 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:02:17.618764  7198 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:02:17.652896  7198 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Committing config change with OpId 12.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.657956  1601 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Committing config change with OpId 12.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:17.677129  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44915.4us
I20260709 13:02:17.689949   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.713173  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a63db4a447849f8a1a34a53cd5ccefa with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:17.712838  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79161.7us
I20260709 13:02:17.686654  7399 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:02:17.769670  1601 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:17.792418  2256 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.794628  1424 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.829247  2257 raft_consensus.cc:2955] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Committing config change with OpId 12.13: config changed from index 12 to 13, VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.862017  7402 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.825392  7432 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:02:17.855989  7417 ts_tablet_manager.cc:1929] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:02:17.882745  7417 log.cc:1199] T 15aeeeb202e74ebd91872b6a150c5ddc P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/15aeeeb202e74ebd91872b6a150c5ddc
I20260709 13:02:17.885350  1674 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:17.900393  1523 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a63db4a447849f8a1a34a53cd5ccefa with delete_type TABLET_DATA_TOMBSTONED (TS b8ff9782cd95483c905cd1d906f41aaf not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37990
I20260709 13:02:17.921509  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 15aeeeb202e74ebd91872b6a150c5ddc (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:17.958036  1533 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:17.962188  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 140928us
W20260709 13:02:17.974363  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 239384us
I20260709 13:02:17.987802  1431 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 10 to 11, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:18.012291  1529 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:18.036267  7444 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:18.067673  1603 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:18.157992  2260 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:18.165073  7402 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:18.177347  1528 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:18.181275  7446 tablet_replica.cc:333] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:02:18.181157  7401 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:18.182477  7446 raft_consensus.cc:2243] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.183336  7446 raft_consensus.cc:2272] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.190810  7446 ts_tablet_manager.cc:1916] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.191461  7401 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:18.200824  1528 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:18.225651  2260 raft_consensus.cc:2955] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:18.270984  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 460ae43de4d04023a24854ca2a19da88 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.275323  1432 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 11 to 12, VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) evicted. New cstate: current_term: 14 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:18.305728  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 460ae43de4d04023a24854ca2a19da88 with delete_type TABLET_DATA_TOMBSTONED (TS b88b12b461734b3aa6a3da4f5c22c79b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:18.306722  7417 tablet_replica.cc:333] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:02:18.307756  7417 raft_consensus.cc:2243] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.308619  7417 raft_consensus.cc:2272] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.319311  7417 ts_tablet_manager.cc:1916] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.345340  7417 ts_tablet_manager.cc:1929] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:02:18.346021  7417 log.cc:1199] T 460ae43de4d04023a24854ca2a19da88 P b88b12b461734b3aa6a3da4f5c22c79b: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-2-root/wals/460ae43de4d04023a24854ca2a19da88
I20260709 13:02:18.349210  1418 catalog_manager.cc:5028] TS b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): tablet 460ae43de4d04023a24854ca2a19da88 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:18.365012  7446 ts_tablet_manager.cc:1929] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.12
I20260709 13:02:18.365531  7446 log.cc:1199] T 6a63db4a447849f8a1a34a53cd5ccefa P b8ff9782cd95483c905cd1d906f41aaf: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-0-root/wals/6a63db4a447849f8a1a34a53cd5ccefa
I20260709 13:02:18.368090  1418 catalog_manager.cc:5028] TS b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): tablet 6a63db4a447849f8a1a34a53cd5ccefa (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
I20260709 13:02:19.282187   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:19.575043  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66989.7us
I20260709 13:02:19.577507  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:19.578269  1682 raft_consensus.cc:606] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:19.619278  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:19.620010  1680 raft_consensus.cc:606] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Received request to transfer leadership to TS 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:19.633832   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:19.636129   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:19.679870  7453 raft_consensus.cc:993] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:19.680552  7453 raft_consensus.cc:1081] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Signalling peer 9b6586a864a94c019cae2d8e2987a7af to start an election
I20260709 13:02:19.685045  2260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f99da1afef0249c084ef81484859e823"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
 from {username='slave'} at 127.0.0.1:48924
I20260709 13:02:19.685757  2260 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:19.686117  2260 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.700605  2260 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:19.715286  2260 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:19.716545  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:19.718454  1682 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:19.718824  1682 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:19.719691  1682 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:19.721036  1682 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.814697  1682 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:19.817335  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:19.818050  1529 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.826020  1529 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
W20260709 13:02:19.885282  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58053.9us
W20260709 13:02:19.893306  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62469.7us
I20260709 13:02:19.887357  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:19.899366  7400 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:19.901254  7400 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:19.903421  7400 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:19.917826  1528 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:19.934754  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55017.5us
I20260709 13:02:19.954483  1682 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:19.959728  1603 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:19.967866  7457 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:02:19.974061  7435 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:19.977494  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80689.8us
I20260709 13:02:19.990233  7198 raft_consensus.cc:993] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:19.998663  7198 raft_consensus.cc:1081] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:20.009330  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:44446
W20260709 13:02:20.034268  1498 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2832a231368f4f5dbf9972f28f64f60e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.039939  1603 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.040680  1603 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.044158  1432 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:20.045871  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47088.1us
I20260709 13:02:20.064812  1680 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 13:02:20.767956  7470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.000s	sys 0.004s
W20260709 13:02:21.025741  7470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.000s	sys 0.004s
I20260709 13:02:21.058522   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:21.254763  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800034a60 after lost signal to thread 434
W20260709 13:02:21.256261  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800129200 after lost signal to thread 1466
W20260709 13:02:21.256764  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08001bda60 after lost signal to thread 1480
W20260709 13:02:21.298700   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f840 after lost signal to thread 1600
W20260709 13:02:21.299368   436 kernel_stack_watchdog.cc:198] Thread 1600 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 267ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:02:21.739157  7474 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:21.865356  7474 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:21.868548  7474 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:21.871598  7474 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.027812  7474 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.031184  7474 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.040067  7474 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.061348  7474 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:22.062083  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 1.96935e+06us
I20260709 13:02:22.090744  7474 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.093720  7474 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.095667  7474 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.123113  7474 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.152954  7453 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.169900  7453 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.531543  7453 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:22.300128   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fba0 after lost signal to thread 2226
W20260709 13:02:22.532423   436 kernel_stack_watchdog.cc:198] Thread 2226 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 212ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:02:22.485431  7475 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.562183  7475 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.564845  7475 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:22.492040  7411 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.600732  7481 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.601603  7411 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.601778  7481 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:21.941082  7451 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.604228  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.604602  7481 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.604974  2260 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:22.605703  7411 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.604820  7451 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:22.491262  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 403908us
I20260709 13:02:22.566919  7479 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.567713  7477 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.570405  7476 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.610577  7479 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.610720  7477 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.611014  7476 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.606271  7400 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.586038  7483 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.589489  7478 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.598821  7465 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.599335  7468 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.642346  7477 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.609906  7451 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:22.619447  1603 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 2.576s	user 0.021s	sys 0.019s
I20260709 13:02:22.612198  7400 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.643049  7451 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.643814  7477 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.643636  7451 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.644542  7400 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.626103  7475 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.645247  7475 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:22.619096  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 2.53308e+06us
I20260709 13:02:22.610687  7481 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:22.627444  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.597s	user 0.011s	sys 0.024s
I20260709 13:02:22.640923  7465 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.653399  7475 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.627596  7474 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.633249  7411 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.654897  7465 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.641968  7468 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:22.655565  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.625s	user 0.012s	sys 0.024s
I20260709 13:02:22.626586  7476 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.654764  7474 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.656445  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 2895) took 2629 ms. Trace:
I20260709 13:02:22.657555  7468 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.656924  1600 rpcz_store.cc:276] 0709 13:02:20.026702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.027878 (+  1176us) service_pool.cc:224] Handling call
0709 13:02:20.028387 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.028754 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.028784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.029774 (+   990us) log.cc:844] Serialized 506 byte log entry
0709 13:02:22.656033 (+2626259us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:22.656072 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.656136 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.656178 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:22.656189 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.656369 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2625860,"threads_started":1,"wal-append.queue_time_us":721707,"wal-append.run_cpu_time_us":2376,"wal-append.run_wall_time_us":1005338}
I20260709 13:02:22.658001  7478 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.659605  7474 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.647439  1603 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.656085  7481 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.648041  7483 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.670392  1603 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.681898  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44446 (request call id 3217) took 2670 ms. Trace:
I20260709 13:02:22.652716  7484 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.683883  7484 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.686082  7484 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.686528  7490 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.682636  1603 rpcz_store.cc:276] 0709 13:02:20.000239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.000383 (+   144us) service_pool.cc:224] Handling call
0709 13:02:22.670941 (+2670558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.652549  7451 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.660853  7474 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.681594  7489 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.655115  7411 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.688851  7478 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.648191  7477 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.700166  7400 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.705796  7486 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.706332  7481 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.706692  7489 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.700889  7490 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.717137  7450 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.731356  7496 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.731979  7496 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.733170  7481 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.733736  7481 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.734189  7496 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.735751  7481 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.736248  7481 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.736756  7481 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.737905  7496 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.738447  7496 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.738792  7481 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.701402  7474 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.741348  7450 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.742381  7474 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.742563  7493 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.742920  7474 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.743149  7493 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.743643  7450 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.743494  7474 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.715655  7482 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.744673  7482 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.745728  7493 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.746039  7489 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.746518  7480 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.746461  7493 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.746812  7482 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.747539  7485 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.747155  7493 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.722740  7400 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.748102  7485 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.748935  7465 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.749475  7465 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.750124  7400 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.745801  7490 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.717665  7475 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.727969  7492 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.740271  7499 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.755287  7492 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.755805  7499 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.757828  7492 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.758293  7499 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.760396  7496 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.744192  7450 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.746646  7489 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.773175  7450 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.773646  7493 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.773319  7489 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.774273  7452 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.752327  7480 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.782912  7494 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.783583  7494 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.785498  7474 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.721951  7486 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.786226  7498 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.777297  7489 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.786818  7498 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.787427  7485 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.788210  7501 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.774811  7452 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.789377  7489 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.789964  7489 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.790750  7499 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.791066  7452 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.791677  7452 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.777616  7465 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.753791  7453 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.779000  7411 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.780454  7483 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.792920  7483 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.793416  7483 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.792165  7452 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.788856  7501 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.792603  7411 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.762844  7475 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.791285  7499 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.785599  7494 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.777158  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.796618  7411 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.815521  7465 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.815590  7485 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.819332  7499 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.819098  7485 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.816383  7481 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.790658  7401 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.816905  7488 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.762519  7490 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.788169  7480 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.825654  7465 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.820187  7475 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.818480  7489 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.825527  7484 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.843564  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.825726  7496 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.855499  7496 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.856642  7411 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.857715  7496 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.852195  2257 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:22.832959  7488 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.852427  7400 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.829830  7481 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.854427  7452 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.829273  7501 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.810235  7453 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.941823  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:22.942173  7453 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.852787  7490 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.943950  7486 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.863806  7484 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.946345  7484 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.865507  7491 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.947221  7475 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.947106  7491 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:22.947851  7504 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:22.947999  7475 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.948452  7504 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.949420  7491 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:22.831627  7401 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.920403  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.920655  7500 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.903095  7495 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.921286  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.922271  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.922547  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:22.926414  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:22.926870  7474 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:22.859732  7459 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.866313  7493 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.927114  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:22.950700  7504 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.014340  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.056180  1608 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:23.004667  7411 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.057626  7411 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.957700  7457 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:22.932181  7483 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.933672  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:23.169520  2256 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.934485  7506 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.170154  7506 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:22.935626  7487 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.172621  7487 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.937677  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.174763  1600 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:23.175906  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.176591  1600 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:23.177564  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.177876  2256 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:23.178746  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:22.940068  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.179400  1600 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:02:23.181959  1603 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:23.184235  1600 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:23.179402  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.187906  7487 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.188653  7506 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.059940  7411 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:22.964706  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 223) took 2929 ms. Trace:
I20260709 13:02:23.189689  1432 rpcz_store.cc:276] 0709 13:02:20.035093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.036490 (+  1397us) service_pool.cc:224] Handling call
0709 13:02:22.964630 (+2928140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:20.078179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:20.078751 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:20.078782 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:02:20.078798 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:20.079125 (+   327us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:20.079195 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:20.079227 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:20.079416 (+   189us) tablet.cc:701] Row locks acquired
0709 13:02:20.079438 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:20.097532 (+ 18094us) write_op.cc:270] Start()
0709 13:02:20.097675 (+   143us) write_op.cc:276] Timestamp: P: 1783602140079543 usec, L: 0
0709 13:02:20.097698 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:20.100804 (+  3106us) log.cc:844] Serialized 536 byte log entry
0709 13:02:21.309700 (+1208896us) op_driver.cc:464] REPLICATION: finished
0709 13:02:21.465367 (+155667us) write_op.cc:301] APPLY: starting
0709 13:02:21.465457 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:21.466709 (+  1252us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:21.466821 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:21.467537 (+   716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:21.467761 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:21.467807 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:21.468035 (+   228us) log.cc:844] Serialized 25 byte log entry
0709 13:02:21.745598 (+277563us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.745698 (+   100us) write_op.cc:454] Released schema lock
0709 13:02:21.745742 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:21.753743 (+  8001us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.753779 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":155336,"apply.run_cpu_time_us":3662,"apply.run_wall_time_us":288335,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":30635,"prepare.run_cpu_time_us":7403,"prepare.run_wall_time_us":954842,"raft.queue_time_us":304532,"raft.run_cpu_time_us":1554,"raft.run_wall_time_us":159703,"replication_time_us":1211831,"thread_start_us":1423367,"threads_started":4,"wal-append.queue_time_us":901641,"wal-append.run_cpu_time_us":8765,"wal-append.run_wall_time_us":1466329}]]}
I20260709 13:02:22.931005  7400 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.195732  7400 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.196801  7506 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.197443  7506 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:22.978920  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2864) took 2919 ms. Trace:
I20260709 13:02:22.990875  7198 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:22.958632  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.202390  7506 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.055188  7336 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:22.951408  7401 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.007728  7488 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.046039  7465 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.961849  7463 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.204128  7463 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.206476  7463 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.069371  7450 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:22.969456  7478 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.208377  7478 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.208647  7487 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.209339  7487 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.211035  7478 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.211349  7487 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.140798  7509 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.212034  7509 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.212443  7487 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.212939  7487 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.142359  7507 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.213817  7507 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.214269  7509 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.141368  7474 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.214630  7478 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.215219  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.215919  2255 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:23.143211  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.216135  7507 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.142910  7477 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.217409  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.143433  7512 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:23.145015  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080034e780 after lost signal to thread 1558
I20260709 13:02:23.134130  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.134475  7493 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.146423  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.134526  2252 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:22.968684  7476 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.134707  7457 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.134866  1674 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:23.150082  7485 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.136137  7500 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.137579  7513 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.215193  7478 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.222973  7513 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.152103  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.152848  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.137593  7481 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.154560  7479 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.154752  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.155812  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.157537  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.156747  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.159174  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.225569  1606 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:23.160730  7498 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.137874  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.161720  1647 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:23.226480  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 64847.6us
I20260709 13:02:23.157356  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.226998  7479 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.163766  7480 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.164633  7452 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.227449  7479 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.227766  7452 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.228217  7479 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.229844  7452 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.164767  7453 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.230070  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.138015  7495 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.230741  1682 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:23.162575  7444 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.220017  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.232192  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.232743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.138074  7515 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.234310  7515 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.234786  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.235929  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.165488  7504 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.236507  7515 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.131206  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.236687  7504 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.237135  2260 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:23.131994  7490 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.231763  7444 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.238423  7500 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.238700  7504 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.055092  7459 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.145344  7475 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.239128  7480 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.239975  7444 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.219137  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.223361  7516 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.227111  7484 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.224119  2257 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:02:23.244748  7516 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.245251  7515 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.245703  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.245850  7515 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.246932  7516 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.236819  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.247583  7516 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.247658  1674 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:23.248363  7198 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.218086  7512 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.249323  7480 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.227463  1605 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:23.250211  7478 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.202924  2253 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:23.220700  7493 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:23.219322  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7c40 after lost signal to thread 1633
I20260709 13:02:23.251994  7513 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:23.252389  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080035b880 after lost signal to thread 1707
I20260709 13:02:23.219240  7474 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.232146  7495 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:23.253672  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800117560 after lost signal to thread 2285
I20260709 13:02:23.241863  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.231709  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.254228  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:23.254211  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.242765  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.247980  7515 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.255419  1683 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:23.220039  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.256464  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.257083  1683 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:23.257208  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.219213  7487 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.232945  1677 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:23.230433  7453 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.243777  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.259016  1682 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:23.260246  7453 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.220686  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.220172  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.262161  2255 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:23.244833  7484 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.254958  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.247002  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.264657  7484 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.241750  7457 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.250651  7512 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.248117  7516 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.265623  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.266460  7500 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.266852  7500 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.267354  7500 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.268049  7516 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.241238  7459 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.202222  1680 rpcz_store.cc:276] 0709 13:02:20.059597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.064159 (+  4562us) service_pool.cc:224] Handling call
0709 13:02:20.064481 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.064690 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:20.092237 (+ 27547us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.968349 (+2876112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.968410 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:22.968465 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.978629 (+ 10164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.978807 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":39915,"threads_started":1,"wal-append.queue_time_us":276131}
I20260709 13:02:23.271512  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.258387  1683 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:23.275189  7198 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.276254  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.255707  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.277709  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:32970 (request call id 0) took 3362 ms. Trace:
I20260709 13:02:23.278965  7479 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.278229  7336 rpcz_store.cc:276] 0709 13:02:19.914878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.915028 (+   150us) service_pool.cc:224] Handling call
0709 13:02:19.923298 (+  8270us) log.cc:844] Serialized 506 byte log entry
0709 13:02:20.033927 (+110629us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b54004f0220. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa6dbe 00007f7e63ab1930 00007f7e63ab18d8 00007f7e63ab1858 00007f7e63ab1813 00007f7e63ab0a9c 00007f7e6999c626 00007f7e69996dd8 00007f7e63aed7cb 00007f7e63af02c0
0709 13:02:23.277616 (+3243689us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":465,"mutex_wait_us":246,"raft.queue_time_us":968,"raft.run_cpu_time_us":1855,"raft.run_wall_time_us":6209,"spinlock_wait_cycles":10206720,"thread_start_us":27630,"threads_started":1,"wal-append.queue_time_us":28038,"wal-append.run_cpu_time_us":4411,"wal-append.run_wall_time_us":1082986}
I20260709 13:02:23.280757  7498 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:23.281160  7498 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.281574  7498 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.281869  7479 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.188539  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.286022  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.288007  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.280126  1682 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:23.289695  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.290802  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.157435  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.294381  7506 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.295135  7459 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.294931  7506 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.295488  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.296083  1606 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:23.295534  7459 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.297228  7459 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.297269  7506 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.299108  7498 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.300107  7514 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.300540  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.336280  7514 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.336975  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.338136  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.338505  7514 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.339377  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.339727  2252 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:23.342406  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.343430  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:23.295624  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 138274us
I20260709 13:02:23.301219  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.302285  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.292861  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.303509  2254 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:23.346385  1600 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:23.304265  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.304301  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.306661  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.307293  7519 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.347574  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.307857  7517 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.348277  7517 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.349479  7480 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.349895  7480 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.349987  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.310084  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.309268  7506 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.351836  7453 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:23.310420  7336 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.347925  7519 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.352643  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.352736  7336 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.354378  7519 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.351989  7506 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.355139  7336 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.310760  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.311748  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.356443  1531 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:23.356536  7506 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.357071  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.357672  1533 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:23.352250  7453 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.358500  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.358740  7498 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.311992  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.357334  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.313218  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.360597  1527 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:23.360670  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.361567  7401 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.313537  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.362023  7401 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:23.362516  1530 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:23.313875  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.362947  7401 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.363477  7198 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:23.364600  7452 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:23.364967  7452 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:23.358536  7453 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.312258  1432 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 13, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.314567  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.315042  1532 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:23.312760  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.367061  1529 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:23.366690  1526 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:23.316710  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.316473  7459 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.317965  7512 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:23.318560  7516 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.319145  7457 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.319707  7484 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.320290  7509 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.325328  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.326363  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.329752  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.330523  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.330729  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.331816  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.333663  7500 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.334494  7476 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:23.335505  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.347766  7479 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.308718  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.350405  7480 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.350607  7517 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.359608  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.364595  1573 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.365696  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.373340  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.613858  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.408856  7509 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.406438  7457 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.616170  1528 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:23.617290  7509 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.618043  7459 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.365731  7452 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:23.533074   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f740 after lost signal to thread 2226
I20260709 13:02:23.619910  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.621208  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.621829  7500 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.622299  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.622496  7479 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.623042  7479 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.623427  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.623970  7198 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.621124  2260 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:23.624701  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 259054us
I20260709 13:02:23.619189  7452 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.625375  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.624347  7198 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.625983  7198 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.626194  7444 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:23.626631  7444 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.626991  7444 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:23.436236  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.372905  7516 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.430219  7484 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.633003  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.633073  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:23.667050  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 299686us
I20260709 13:02:23.666344  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.668233  7198 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:23.669744  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 305192us
I20260709 13:02:23.670476  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.674149  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:23.672626  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.676452  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:23.680491  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.675832  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.673822  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.681945  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.682206  1682 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:23.679883  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.618043  7457 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.686811  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.671379  7516 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.690315  7198 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:23.689795  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.691162  7411 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.692405  7321 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:23.691882  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.692021  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.699321  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.699323  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:23.665248  7453 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.371827  7512 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.696245  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.704340  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.688896  7498 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.677364  7488 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.673516  7401 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.696571  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.701290  7493 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.700074  1682 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:02:23.677987  7500 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.703954  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.639207  7444 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.726017  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.703872  7321 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.699239  7411 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.702266  7481 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.731693  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.707623  7474 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.734829  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:23.746522  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.747538  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.748591  1674 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:23.736492  7484 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.730756  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.727695  7500 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.753552  7500 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.753681  7512 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.744222  7411 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.754385  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.738826  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.708293  7485 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.756364  7485 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.756896  7485 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.753917  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.759186  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:23.733053  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.708667  7498 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.708045  7401 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.713227  7493 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.772780  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.761164  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.730419  7321 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.768446  7479 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.777053  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:23.740149  7481 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.757829  7474 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.772614  7401 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.775602  7493 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.788204  7444 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.777421  7487 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:02:23.790413  7487 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:23.790753  7487 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:23.777848  7515 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.762252  7453 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.765585  7516 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:02:23.797082  7516 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:23.797485  7516 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:23.798323  7516 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.798782  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:23.799625  7515 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.799769  7516 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.800096  7515 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.800307  1424 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 17 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 18 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.764994  7498 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.784250  7509 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:23.799805  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.791116  7500 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.782685  7481 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.783689  7474 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.791657  7487 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.824167  7321 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.824885  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.825148  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.825948  1678 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:23.810351  7515 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.810717  7509 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.827245  1679 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:23.828037  7509 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.831784  7476 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:23.832968  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 129081us
I20260709 13:02:23.812966  7478 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:23.834169  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 144439us
I20260709 13:02:23.835821  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.837620  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.838433  7488 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.838527  7527 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:23.839079  7527 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.839435  7527 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.839485  7321 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.841426  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.842435  7488 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.844003  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:23.843899  7517 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:23.845608  7517 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:23.845513  7524 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.846092  7517 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:23.846704  7476 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.849427  7485 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.856398  7524 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:23.856462  7515 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.891321  7524 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.893095  7515 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.857358  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:23.894227  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.895367  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:23.896129  7198 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.896528  7198 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:23.896890  7198 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.861701  7500 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.863441  7481 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.869292  7479 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.877511  7509 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.878628  7401 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.879305  7487 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.906001  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.889765  7493 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.899567  1681 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:23.900209  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.901012  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.901784  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.903160  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.904902  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.905611  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.902890  7504 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.913578  7198 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.914656  7485 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.914399  7411 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.916018  7198 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.891294  7517 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.917029  7517 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.911366  1675 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:23.910470  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 76790.9us
I20260709 13:02:23.920161  7509 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.902726  7476 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.922958  7481 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.923553  7481 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:23.925993  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.926906  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.927963  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.929782  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.894497  7480 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.933157  1678 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:23.934159  1681 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:23.934183  7480 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.938060  7487 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:23.939313  7509 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:23.939702  7509 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:23.940478  7509 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.941412  7509 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.941967  7474 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.934918  7401 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.932251  1675 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:02:23.950073  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 264473us
I20260709 13:02:23.949717  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:23.953734  7498 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.954262  7487 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:23.955269  7487 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:23.951265  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.951122  7524 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:23.956830  7493 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:23.961637  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 101887us
I20260709 13:02:23.963124  2227 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.963869  2255 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:23.965521  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.966779  7515 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.968562  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.969413  7515 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.969937  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.970557  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.971043  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.972220  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.972604  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.973069  7515 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.973722  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.973943  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.972108  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.974599  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.976354  7515 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.976737  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.977523  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.977926  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.977031  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.978559  1683 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:23.978901  1680 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:23.972554  7500 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.980023  1533 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:23.958251  7474 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:23.978650  7411 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:23.981621  1528 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:23.982784  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.983801  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:23.984748  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:23.985199  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.985680  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.986752  1676 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:23.987074  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.987648  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.987980  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.988235  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:23.988605  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.986335  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.984648  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:23.980162  7500 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:23.990224  7500 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.992762  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:23.997766  7527 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:23.998375  7524 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:23.999296  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.000679  7498 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.000737  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.004662  7487 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.007045  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.009862  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.012228  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.012485  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.013082  1603 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:24.015286  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.017002  7529 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.017079  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.017527  7529 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.017722  1601 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.017932  7529 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.018473  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.019073  1528 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:24.021251  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.021510  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.022197  1528 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:24.022605  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.023340  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.022904  7493 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:24.023831  7533 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.024495  7533 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.023404  1525 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:24.025125  7533 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.025231  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.026974  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.027268  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.028391  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.028609  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.028719  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.029109  1532 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:24.022230  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.030795  7401 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.031402  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.032061  1528 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:24.033080  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.033845  7321 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.034518  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.035571  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.036810  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.037108  7530 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:24.037495  7530 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:24.037590  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.038319  1528 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:24.039837  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.040460  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.041045  1529 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:24.042582  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.043126  1529 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:24.043867  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.038419  7530 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.045730  7530 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.046023  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.047075  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.047644  1603 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.048628  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.050239  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.050856  1529 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:24.052273  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.043326  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:24.054333  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.054507  1603 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:24.086364  7533 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.056226  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.056489  7527 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:24.059239  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50415.7us
I20260709 13:02:24.091022  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.070945  1674 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:24.095475  1649 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:24.096225  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 172426us
I20260709 13:02:24.098796  7509 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.070884  7500 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.099872  7524 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:24.077385  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:24.100296  7524 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:24.100991  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.101887  7493 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:24.101321  7524 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.103332  7524 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.092492  7534 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:24.104033  7401 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:24.102296  7493 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:24.105329  7493 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.104962  7529 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.105512  7474 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:24.107561  7474 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:24.108644  7474 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.109959  7474 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.081399  1681 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:24.113794  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:24.114795  7500 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.115621  1603 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.115993  7534 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.116452  7534 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:24.116851  7534 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.092595  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:24.118068  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:24.118956  7533 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.125828  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:24.125463  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:24.126789  7198 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:24.127133  7198 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:24.127493  7198 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.127193  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:24.128098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.127621  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.128463  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.129858  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.130995  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.131875  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.132185  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.133558  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.135613  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.136567  7321 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.137377  7321 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.138005   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:24.139325  7498 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:24.140578  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.130848  7527 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.125000  7411 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.130813  7485 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.143173  7485 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:24.143523  7485 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.137435  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.134413  1528 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:24.107862  7529 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.163240  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.164167  1528 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:24.166716  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.124934  7500 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.169890  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:24.171769  1601 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:02:24.172518  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:24.174830  2255 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.175243  7198 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:24.168848  7500 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:24.226480  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.268936  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.170789  7411 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:24.278512  2258 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.177253  7480 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.177696  2252 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.271265  1532 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:24.201694  7476 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:24.270658  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 94860.1us
I20260709 13:02:24.278726  2253 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:24.286679  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.282112  7198 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:24.287698  1528 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:24.288503  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:24.281750  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.280380  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.571s (SENT)
I20260709 13:02:24.292503  7480 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:24.296478  1601 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.280714  7500 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.298933  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.314196  7480 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.301512  1674 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:24.283411  7534 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.283361  7476 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:24.304886  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.319180  2253 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:24.316910  2257 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:24.317584  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.320562  1528 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:24.321205  7475 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:24.322408  7504 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:24.322772  7504 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:24.323974  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.324465  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.325639  2256 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:24.319183  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.323637  7504 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.326766  7485 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.327340  7504 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:24.333710  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 206563us
I20260709 13:02:24.294504  7198 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:02:24.341549  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.342041  2252 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.342811  1528 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:24.341590  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.345610  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.353960  1674 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:24.357761  2256 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.372406  1600 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:24.356633  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.342363  7444 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:24.378185  7198 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:24.378361  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.381385  7493 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:24.382745  1606 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:24.384423  7444 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:24.385391  7444 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.386821  7444 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.389308  2252 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.394308  7533 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.394843  7533 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.395221  7533 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.404034  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 331) took 1096 ms. Trace:
I20260709 13:02:24.408212  7533 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.356829  7481 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.409435  7481 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.409650  7527 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.410871  7533 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.404517  1432 rpcz_store.cc:276] 0709 13:02:23.307475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.307625 (+   150us) service_pool.cc:224] Handling call
0709 13:02:24.403961 (+1096336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:23.697050 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:23.784693 (+ 87643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:23.784729 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:23.784749 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:23.785094 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:23.785156 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:23.785189 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:23.785365 (+   176us) tablet.cc:701] Row locks acquired
0709 13:02:23.785381 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:23.785518 (+   137us) write_op.cc:270] Start()
0709 13:02:23.785622 (+   104us) write_op.cc:276] Timestamp: P: 1783602143785474 usec, L: 0
0709 13:02:23.785645 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:23.786294 (+   649us) log.cc:844] Serialized 599 byte log entry
0709 13:02:24.104372 (+318078us) op_driver.cc:464] REPLICATION: finished
0709 13:02:24.202573 (+ 98201us) write_op.cc:301] APPLY: starting
0709 13:02:24.278227 (+ 75654us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:24.315759 (+ 37532us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:24.315860 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:24.316822 (+   962us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:24.339745 (+ 22923us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:24.343148 (+  3403us) write_op.cc:312] APPLY: finished
0709 13:02:24.372777 (+ 29629us) log.cc:844] Serialized 25 byte log entry
0709 13:02:24.400400 (+ 27623us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.400492 (+    92us) write_op.cc:454] Released schema lock
0709 13:02:24.400538 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:24.401205 (+   667us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.401236 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":68817,"apply.run_cpu_time_us":10469,"apply.run_wall_time_us":225708,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":276668,"prepare.run_cpu_time_us":8821,"prepare.run_wall_time_us":128962,"raft.queue_time_us":257134,"raft.run_cpu_time_us":4737,"raft.run_wall_time_us":50793,"replication_time_us":298544,"spinlock_wait_cycles":1792,"thread_start_us":447264,"threads_started":4,"wal-append.queue_time_us":31894}]]}
I20260709 13:02:24.372926  7528 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:24.416685  7528 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.417141  7528 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.384012  7493 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.421597  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:24.422278  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65739.1us
I20260709 13:02:24.424243  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:24.426008  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.431484  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.429935  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.437764  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.395171  7534 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:24.457924  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.423828  7481 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.459514  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:24.468262  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.389257  7506 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:02:24.450143  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.423807  7476 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.455909  2256 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:24.456485  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:24.479827  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48436us
I20260709 13:02:24.493714  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:24.495045  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:24.480516  7527 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.465873  7401 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:02:24.496766  7534 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.497251  7401 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:24.497573  7534 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:24.497821  7401 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:24.498974  7401 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.496532  7527 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:24.500828  7527 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.501070  7532 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:24.501590  7321 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:24.502161  7530 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:24.502745  7321 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:24.503131  7321 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:24.488732  7493 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:24.429524  7538 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:24.504482  7474 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:24.438395  7529 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:02:24.504925  7474 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:24.505786  7474 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.507161  7506 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:24.507601  7506 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:24.507792  7401 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.508386  7506 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:24.509687  7506 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.507462  7321 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.511802  7321 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.500823  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.513404  7500 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.517635  7527 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.518179  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.519543  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.520411  7538 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:24.520955  7538 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.522112  1528 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:24.527871  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.529143  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:24.529397  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.530757  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.531947  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.533042  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:24.534147  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84087.2us
I20260709 13:02:24.537669  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.538875  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.539810  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.469146  1532 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:24.541292  1526 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:24.542739  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.542953  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:24.548549  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 268194us
I20260709 13:02:24.554102  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.554332  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.554867  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.519954  7527 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:24.568681  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.569562  1432 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.570783  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.572193  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.573581  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.572252  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:24.597450  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.599064  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:24.596477  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 315321us
I20260709 13:02:24.464911  7504 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.136s
I20260709 13:02:24.609684  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.633095  1525 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:24.631815  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.634093  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.569480  7487 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.610459  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.608865  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.612674  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.636101  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.637236  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.617735  1608 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.638702  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.639865  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.617878  7500 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:24.642591  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.619052  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.620741  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.620836  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.616993  7538 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.622385  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.623004  1683 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:24.623227  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.623842  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.625415  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.625723  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.626812  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.627451  1602 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.628490  7485 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:24.629280  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.590912  7529 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:24.631035  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:24.646238  1647 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5293a667c8bb4fdbb1fa97aaeba1cfc1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.685698  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.585300  7515 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.647881  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.689265  1529 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:24.689790  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.690073  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.650015  1525 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:24.650465  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.690728  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.652623  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.654805  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.691282  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.656030  1533 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:24.659567  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.660696  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.661041  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.663394  2259 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.670943  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.569121  7509 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.568838  7475 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:24.703147  1603 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:24.656025  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:24.679714  1527 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:24.630199  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.591506  7516 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.706569  1675 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:24.585737  7457 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.681015  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.680490  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:24.684383  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:24.584892  7517 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.647436  1608 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:24.686889  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.695494  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.690930  1607 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:24.694156  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:24.696530  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:24.712153  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 337316us
I20260709 13:02:24.705989  7478 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.715082  1674 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:24.722434  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.723362  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 222196us
I20260709 13:02:24.697654  7529 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:24.733639  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:24.738423  1605 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.758153  1600 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.770452  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.771459  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.772746  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.777931  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.779102  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.780786  1607 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:24.784509  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.788785  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:24.791247  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.794195  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.769253  7527 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.793198  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.809000  1683 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:24.811554  1683 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:24.780932  7457 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:24.813257  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 89189.7us
I20260709 13:02:24.783866  7485 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.780463  7517 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:24.833108  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.818845  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:24.784034  7506 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.811470  7478 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.814360  7487 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.796543  7509 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.847860  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.796389  7540 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.832501  7527 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:24.858847  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65724us
I20260709 13:02:24.860414  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:24.815683  7528 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.873848  7538 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:24.854665  7529 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.881033  1531 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:24.874047  7481 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:24.846719  7515 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:02:24.862253  7517 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.868844  7540 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:24.958537  1677 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
W20260709 13:02:24.959949  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 121367us
I20260709 13:02:25.004271  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:25.009476  1530 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:25.046535  1534 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:24.956466  7401 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.051328  7401 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:25.049301  7551 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:02:25.054520  7557 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:25.055789  7401 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.056869  7401 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.058015  7481 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.060825  7506 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:25.061591  7506 consensus_queue.cc:1243] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:25.064935  7528 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.066370  7474 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:24.962540  7546 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.103s	user 0.004s	sys 0.003s
I20260709 13:02:25.046172  7558 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.068650  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:25.069911  7533 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:25.070163  7556 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:25.075899  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 226261us
W20260709 13:02:25.076704  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 408926us
W20260709 13:02:25.085808  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.088671  1600 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:25.097708  7401 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:25.070462  7533 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:25.098441  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.105465  7532 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:02:25.110266  7533 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.115837  2253 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:25.120700  7555 ts_tablet_manager.cc:933] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:25.071110  7556 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:25.123380  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 270960us
I20260709 13:02:25.123610  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.135859  2254 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.145834  7532 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:25.146467  7532 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:25.147369  7532 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.148557  7321 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:25.148940  7321 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:25.149682  7321 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:25.151206  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 332573us
I20260709 13:02:25.153359  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.151983  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.154641  1500 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:25.159494  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.126801  7530 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:25.170112  7530 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:25.171028  7530 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.171974  7530 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.157292  7527 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.154793  7504 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:02:25.155022  7457 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.165256  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.166543  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53808273f23f45848ad55ddef1799643"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:25.164362  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.167549  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:25.167549  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:25.160897  7563 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.181782  1600 raft_consensus.cc:606] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.182685  1600 raft_consensus.cc:614] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:25.167692  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:25.102730  7558 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:02:25.186647  1605 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:25.187907  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.192512  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.163473  7538 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.187104  7532 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.220242  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:25.221321  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:25.221973  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:25.219832  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.193375  7564 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:25.222703  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:25.226751  7198 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.232676  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.234233  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.195060  7561 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:25.236811  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:25.237607  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:25.238168  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.194722  7554 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.240103  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:25.248620  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.248550  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:25.250211  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:25.250726  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.222692  7529 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.217180  7457 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.227083  7564 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.258751  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.245836  7452 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:25.258430  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.254109  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.260147  7478 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.253016  7544 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.276753  7475 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:25.277158  7475 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.255792  7480 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.277964  7475 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.246336  7487 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.260393  7509 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:02:25.258071  7516 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:25.252048  7561 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:25.285897  7561 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.252452  7517 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:25.287081  7517 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:25.287487  7517 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.261683  7564 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.280437  7509 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:25.290205  7509 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:25.268380  7321 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.269459  7562 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.270758  7515 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.271478  7411 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:25.253186  7553 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:25.222611  7567 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:02:25.306277  1424 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 12 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:25.315928   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:25.295586  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.317917   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:25.325767  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.327672  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.331462  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.332206  7198 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.330859  1431 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 21, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.337695  1431 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 19, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 19 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.341158  2259 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:25.333892  7452 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.345458  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:25.347575  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.348264  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.349431  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.350373  7560 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.235670  7556 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.352035  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.355077  1607 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:25.359939  7198 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.311956  7553 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:25.362213  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.361176  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:25.347862  7500 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:25.384636  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 219548us
I20260709 13:02:25.331949  7411 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:25.310364  7487 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:25.387212  7198 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:25.389828  7198 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.387797  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:25.313325  7549 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:02:25.386410  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.382010  7452 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:02:25.331724  7563 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:02:25.361586  7533 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.359073  7528 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.396284  7198 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:25.398030  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 140627us
I20260709 13:02:25.403574  7475 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.400504  7444 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:25.392094  7500 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:25.410162  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.410943  7576 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:25.388646  7538 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:25.439555  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.421994  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.385998  7553 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:25.428194  7401 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:25.362725  7509 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.426760  7556 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.445585  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.455125  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.458935  1533 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:25.455893  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.460074  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.456480  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.460809  1531 raft_consensus.cc:2376] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20. Re-sending same reply.
I20260709 13:02:25.456738  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.462049  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.456988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.457613  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.463449  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.463639  1529 raft_consensus.cc:2376] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16. Re-sending same reply.
I20260709 13:02:25.457893  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.465327  1525 raft_consensus.cc:2376] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12. Re-sending same reply.
I20260709 13:02:25.464501  7321 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:25.466063  7321 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.466406  7321 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.457640  1527 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:25.439796  7574 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.481410  7500 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.481904  7517 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.454198  7567 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:25.485373  7567 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.485754  7567 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:25.486518  7567 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.487664  7567 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.449335  7493 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.439287  7555 tablet_copy_client.cc:323] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:02:25.455600  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:25.508656  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45275.3us
I20260709 13:02:25.509871  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.514784  1607 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:25.517304  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:25.523137  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:25.524111  1534 raft_consensus.cc:2376] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14. Re-sending same reply.
I20260709 13:02:25.526603  7401 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.527331  7401 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.528184  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.483927  7517 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:25.534315  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 183408us
I20260709 13:02:25.541918  7321 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.545441  7321 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.547312  2258 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:25.549113  2255 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.515565  7493 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.454185  7549 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.560142  7401 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:25.454523  7506 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:02:25.593379  2254 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.515128  7532 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:25.592383  2259 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:25.548648  7574 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:25.546926  7566 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:25.451787  7573 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:02:25.533126  7516 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:02:25.623199  7564 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.626124  7515 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:25.626621  7515 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:25.628969  7572 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:25.629431  7572 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:25.630231  7572 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.632133  7553 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.633097  7572 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.605020  7574 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.636003  7574 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.627501  7515 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:25.637856  7515 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:25.638288  7544 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.612540  7566 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.641525  7564 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.683714  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 332) took 1260 ms. Trace:
W20260709 13:02:25.690163  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.690616  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.694335  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 435486us
I20260709 13:02:25.696902  1531 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:25.684787  1432 rpcz_store.cc:276] 0709 13:02:24.423556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.424385 (+   829us) service_pool.cc:224] Handling call
0709 13:02:24.476758 (+ 52373us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:25.683419 (+1206661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:24.857157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:24.922596 (+ 65439us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:24.922632 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:24.922650 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:24.960240 (+ 37590us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:25.045783 (+ 85543us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:25.047324 (+  1541us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:25.066895 (+ 19571us) tablet.cc:701] Row locks acquired
0709 13:02:25.066914 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:25.067065 (+   151us) write_op.cc:270] Start()
0709 13:02:25.067170 (+   105us) write_op.cc:276] Timestamp: P: 1783602145067024 usec, L: 0
0709 13:02:25.067189 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:25.163632 (+ 96443us) log.cc:844] Serialized 541 byte log entry
0709 13:02:25.381535 (+217903us) op_driver.cc:464] REPLICATION: finished
0709 13:02:25.620373 (+238838us) write_op.cc:301] APPLY: starting
0709 13:02:25.620451 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:25.621659 (+  1208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:25.621751 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:25.622605 (+   854us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:25.622783 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:25.622823 (+    40us) write_op.cc:312] APPLY: finished
0709 13:02:25.622994 (+   171us) log.cc:844] Serialized 25 byte log entry
0709 13:02:25.623157 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.623232 (+    75us) write_op.cc:454] Released schema lock
0709 13:02:25.623274 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:25.623628 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.623657 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3770,"reported_tablets":2,"spinlock_wait_cycles":54509952,"child_traces":[["op",{"apply.queue_time_us":232958,"apply.run_cpu_time_us":3273,"apply.run_wall_time_us":3273,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":263749,"prepare.run_cpu_time_us":9439,"prepare.run_wall_time_us":327562,"replication_time_us":285237,"thread_start_us":353405,"threads_started":2}]]}
W20260709 13:02:25.713032  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 173924us
W20260709 13:02:25.714226  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.717656  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 189458us
I20260709 13:02:25.719607  1609 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:25.724282  1608 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:25.728906  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 344197us
W20260709 13:02:25.741243  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.741968  7567 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.750118  1602 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:25.752738  7566 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:25.740870  7563 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.762482  7563 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.765820  7474 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.599972  7444 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.743212  7567 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.785501  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.787438  7549 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:25.788066  7549 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.788596  7549 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:25.789325  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.796931  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:25.798254  1608 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:25.799830  7563 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.816886  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:25.818614  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.739766  7524 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:25.832188  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.832850  1602 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.833415  7564 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:25.835130  7564 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.835628  7564 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:25.840549  7567 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.841351  7567 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.842257  7552 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:25.842476  7567 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.796945  2227 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:25.844058  7552 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.844660  7552 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:25.845492  7554 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.009s
W20260709 13:02:25.845724  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49160.4us
I20260709 13:02:25.846110  7552 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.848584  7198 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.848945  7524 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:25.850262  7578 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.400s	user 0.002s	sys 0.003s
I20260709 13:02:25.850660  7552 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:25.851320  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66163.5us
I20260709 13:02:25.847553  7560 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:25.857434  1543 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 2832a231368f4f5dbf9972f28f64f60e from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:02:25.768428  7444 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:25.849776  7198 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.835870  7509 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.858129  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:25.840595  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:25.873879  7564 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.878868  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:25.880462  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.880708  7524 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:25.881220  1528 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.845844  7561 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:25.858459  1543 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 2832a231368f4f5dbf9972f28f64f60e from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-2832a231368f4f5dbf9972f28f64f60e
I20260709 13:02:25.882887  7583 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:25.883432  7559 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:25.883677  7583 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.884663  7480 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:25.885103  7583 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.886816  7587 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:25.888769  7587 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.889685  7567 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.885620  7480 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:25.891040  7480 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:25.889477  7587 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.893199  7559 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:25.894143  1677 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:25.898013  7517 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.895974  7566 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:25.905421  1609 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.905395  7554 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.907932  7553 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:25.928910  7559 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:25.913561  7401 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:25.914444  7564 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.938199  7585 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:25.939831  7585 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:25.944871  1603 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:25.922528  7561 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:25.955754  7561 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.956063  7587 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.957959  7587 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.922984  7198 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:25.929821  7517 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:25.961941  7517 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.963512  7517 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.902288  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:25.910622  7565 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:25.964955  2259 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:25.965160  7565 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:25.965716  7565 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:25.966363  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:25.967797  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:25.920150  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62259.4us
W20260709 13:02:25.932768  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54240.1us
I20260709 13:02:25.936002  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:25.928956  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:25.921845  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:25.926882  7480 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:25.926216  7481 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:25.942942  1604 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:25.971808  7481 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.974406  7401 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:25.975013  7401 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.976534  1674 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:25.978245  7582 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:25.979049  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:25.979880  7540 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:25.980428  7540 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:25.980762  2258 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:25.981798  7540 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:25.983367  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:25.984675  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:25.984913  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:25.983271  7540 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:25.993458  7596 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:02:25.996668  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:25.999363  1607 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:26.000973  1533 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:25.972877  7480 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.005601  7480 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:25.954054  7585 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.014361  7585 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.016664  7574 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.018204  1605 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.996084  1604 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.019061  7198 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:02:26.024019  7401 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.028822  7479 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:26.029594  7479 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.030761  7479 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.015873  7585 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.038225  7198 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:26.045948  7198 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.046968  7198 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.048770  7481 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:26.051266  7475 consensus_meta.cc:287] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.618s	user 0.002s	sys 0.014s
I20260709 13:02:26.051607  7476 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:26.053169  7476 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:26.053606  7476 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.051672  7554 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:26.054725  7476 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.051294  1648 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.011879  7549 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.062667  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:26.047616  7574 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.037774  1543 tablet_copy_source_session.cc:215] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:26.073280  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:26.059724  1432 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:26.067481  7475 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.077490  7527 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.078207  7527 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.078768  1601 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:26.067902  7476 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.086645  7401 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:26.087327  7515 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.077800  7529 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.087497  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.087081  7401 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.087560  1675 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:26.093379  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.099418  7198 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.093056  2258 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:02:26.100119  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.104868  7401 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.093621  7475 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:26.093555  7529 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.106598  7475 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:26.106993  7475 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.112666  7582 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:26.110366  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:26.124143  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:26.130188  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:26.130228  7487 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.130722  7506 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.130152  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:26.128427  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:26.130590  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:26.087978  7481 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:02:26.141353  7475 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.098392  7527 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.229012  7574 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.247913  7574 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.234182  7401 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.236665  7529 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.091118  7560 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:02:26.240586  7600 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.006s
I20260709 13:02:26.241103  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:26.241811  1681 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:26.242714  7509 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.246992  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.261010  1528 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:26.247506  1431 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 12 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 13 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.231879  7475 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:26.263032  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50446.5us
I20260709 13:02:26.104765  7583 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:02:26.263888  1534 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:26.265509  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:26.269330  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.262032  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 210997us
I20260709 13:02:26.265288  1531 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
W20260709 13:02:26.267410  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 114634us
I20260709 13:02:26.274326  7401 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.256037  7515 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.284200  7583 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:26.284732  7583 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:26.288286  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.291286  7444 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.292114  7444 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.293085  7574 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.294562  7444 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.295281  7444 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:26.296489  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.305861  1431 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.316758  1431 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.311678  7401 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.311856  7597 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.212s	user 0.000s	sys 0.007s
W20260709 13:02:26.306257  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.319100  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:26.319628  7574 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.283313  7559 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.320655  7401 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.319350  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.322928  7559 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:26.296195  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 262977us
I20260709 13:02:26.324630  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.320250  7574 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.326177  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:26.307754  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:26.333570  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46886.9us
I20260709 13:02:26.292084  7605 ts_tablet_manager.cc:933] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:26.337656  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65616.8us
I20260709 13:02:26.339977  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:26.340842  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.347681  1606 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:26.350999  7500 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:02:26.295944  7444 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.330417  7587 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.297868  7509 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.348333  7559 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.365500  7572 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:26.367364  7552 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.007s
I20260709 13:02:26.367436  7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2832a231368f4f5dbf9972f28f64f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.368482  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:26.368942  7481 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.371255  7553 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.371443  7583 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.376943  7401 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:26.373831  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49340us
I20260709 13:02:26.365195  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:26.381951   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.381632  7587 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.382916  7565 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.383654  7549 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:26.384186  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58079.2us
W20260709 13:02:26.388221  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.343374  7594 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 13:02:26.413278  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48164.2us
I20260709 13:02:26.405880  1679 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:26.417986  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:26.419487  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 91584.4us
I20260709 13:02:26.428690  7411 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.429188  7411 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.429682  7411 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.431810  1606 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:26.433478  7583 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.435609  7515 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.436259  7515 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.438913  7515 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.439999  7480 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:26.440894  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.441098  7480 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:26.441411  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.441978  7572 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.442641  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:26.442823  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:26.449892  2258 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:26.453006  1609 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:26.442503  7480 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.419282  7527 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:26.458541  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.422732  7553 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:26.458246  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:26.440442  7481 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.456784  7566 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.003s
I20260709 13:02:26.466459  1601 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:26.453945  7560 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:26.477494  1600 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:26.479058  7452 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.462778  7529 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:26.461647  7527 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.481396  7198 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:26.486815  2253 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:26.479859  7452 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.490020  7553 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.491537  7452 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.491967  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.493497  7480 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.490513  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.473448  7487 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:26.498126  7198 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:26.503589  7198 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.470855  7560 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.494270  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:26.507126  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:26.518604  7481 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.519968  7444 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.523725  7198 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.525941  2252 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:26.483526  7529 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.533607  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.496888  7527 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.543393  7198 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.534335  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.539474  1601 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:02:26.541527  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73084.2us
I20260709 13:02:26.523146  7560 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.542582  7452 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:26.550814  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.551280  7480 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.555155  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.557067  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.530987  7487 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:26.557408  1606 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:26.513733  7585 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:02:26.546164  7529 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.554548  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.567667  7401 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.579334  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:26.574043  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:26.585212  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.590061  7485 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:26.590669  1606 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:26.591315  2258 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:26.594986  7411 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.603072  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.599733  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:26.602361  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:26.565789  7452 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:26.611359  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 144483us
I20260709 13:02:26.602763  7574 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.613511  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:26.613935  7411 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.614850  7487 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.615736  7509 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.614166  1674 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:26.622182  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:26.597468  1609 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:26.637733  1601 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.598778  7585 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:26.637109  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 124407us
I20260709 13:02:26.646512  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:26.647238  1674 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:26.647471  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:26.648372  1683 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:02:26.650336  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60538.1us
I20260709 13:02:26.651098  7534 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.613971  7582 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:26.611750  7549 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.621883  7559 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.656104  1608 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:26.656522  1534 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:26.655983  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 72866.1us
I20260709 13:02:26.637499  7564 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.690476  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:26.617439  7476 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.630920  7587 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.716984  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:26.718652  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.652416  7585 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.720981  7566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53064 (request call id 2) took 2613 ms. Trace:
I20260709 13:02:26.721089  7585 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.651958  7565 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:26.722790  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.656873  7582 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:26.692473  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64673.4us
I20260709 13:02:26.701234  7534 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.720098  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.720736  7401 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.721441  7566 rpcz_store.cc:276] 0709 13:02:24.077549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.079477 (+  1928us) service_pool.cc:224] Handling call
0709 13:02:24.114073 (+ 34596us) log.cc:844] Serialized 506 byte log entry
0709 13:02:24.377956 (+263883us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b18002e5700. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:02:24.385884 (+  7928us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b540015bba0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aaa142 00007f7e63a8aeaa 00007f7e63a91d53 00007f7e63a91cd9 00007f7e63a91c69 00007f7e63a91c31 00007f7e63a90dfd 000000000038f354 000000000038f199 00007f7e60a44475
0709 13:02:26.685412 (+2299528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5569,"raft.queue_time_us":13773,"raft.run_cpu_time_us":4009,"raft.run_wall_time_us":76521,"spinlock_wait_cycles":25984640,"thread_start_us":218491,"threads_started":1,"wal-append.queue_time_us":493554,"wal-append.run_cpu_time_us":2145,"wal-append.run_wall_time_us":1003161}
W20260709 13:02:26.738747  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.738849  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.740957  1601 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:26.743312  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.720587  7572 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:26.744113  2253 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:26.744269  7198 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:26.745282  1600 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.692993  7564 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.723430  7582 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:26.742962  7531 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:26.653652  7605 tablet_copy_client.cc:323] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:41753
I20260709 13:02:26.758618  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:26.761438  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.732915  7587 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:26.776407  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:26.764616  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67362.2us
I20260709 13:02:26.693333  7549 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.755175  7572 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:26.784300  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.786345  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:26.779642  7401 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.760152  7564 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.800474  7624 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.801182  7624 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.750098  7561 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:02:26.793700  1606 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:26.793799  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.744602  7481 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:02:26.777627  7587 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.810482  2255 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:26.811801  7198 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:26.812276  7198 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.794787  7572 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.817036  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:26.823467  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 69309us
I20260709 13:02:26.765446  7452 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.811683  7587 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.811473  7566 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.816253  7475 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.833709  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:26.812573  7515 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:26.847333  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 127336us
I20260709 13:02:26.851954  7549 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.852661  7614 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.853210  7614 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.854907  7625 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:02:26.860479  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.848114  7553 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.868026  7198 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:26.878841  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45277.3us
I20260709 13:02:26.879321  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:26.879509  1534 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:26.879643  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:26.860697  7515 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.869606  7553 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.894402  7509 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.895912  7487 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.896477  7559 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:26.885726  7475 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:26.899211  7609 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.245s	user 0.000s	sys 0.004s
I20260709 13:02:26.904564  7620 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:26.905575  7515 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:26.908428  7628 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.909432  7617 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:02:26.909919  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.913841  7553 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.883351  7517 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.886021  7506 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.897151  7527 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.916966  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.972838  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.920960  7564 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.929042  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 45180.4us
W20260709 13:02:26.935089  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.835120  7566 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:26.947214  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.966813  7198 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.949396  7572 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:26.916298  7565 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.931479  7475 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:26.967072  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.942428  7515 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:26.987243  7566 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:26.953204  7506 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:26.993893  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:26.995486  7560 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.993561  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:26.974154  7481 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.013025  1606 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:27.014066  2259 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
W20260709 13:02:27.028213  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 273600us
I20260709 13:02:26.952193  7509 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.002496  7621 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.942690  7487 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.035022  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.038555  1677 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:26.969655  7517 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.007274  7515 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.041967  2252 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:27.019773  7506 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.042654  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:26.951735  7620 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:26.966924  7628 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:27.054816  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45081.9us
I20260709 13:02:27.060209  1534 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:02:27.061195  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59524.8us
I20260709 13:02:27.032665  7624 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.050930  7515 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.075956  7549 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.086540  1527 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:27.086581  7634 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.087489  7634 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.045226  7565 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.047290  7481 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.042799  7621 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:27.104457  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72286.7us
I20260709 13:02:27.112262  1603 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
W20260709 13:02:27.116814  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 107569us
I20260709 13:02:27.120326  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.122752  2259 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.131902  1530 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:27.122720  7623 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:02:27.083573  7475 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.139014  1600 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:27.143033  7198 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:27.145772  7626 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:02:27.146333  7639 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.146929  7639 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.149250  7639 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.150221  7565 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.152649  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.153477  1525 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.153954  7564 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:27.157032  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.157618  7516 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.158281  7516 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.161175  7628 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.161796  7628 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.162346  7628 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:27.166975  7636 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:27.171444  7621 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.173184  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.173906  1532 raft_consensus.cc:2376] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13. Re-sending same reply.
W20260709 13:02:27.175397  7583 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
I20260709 13:02:27.177311  7634 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:27.183368  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46963.1us
I20260709 13:02:27.182008  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.189967  1606 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
W20260709 13:02:27.190763  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.189216  7614 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.196763  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.200266  2253 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.141842  7572 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.173179  7487 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.214138  7481 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.214721  7620 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:27.240027  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.252113  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.253705  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 225) took 1123 ms. Trace:
I20260709 13:02:27.254199  7487 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.254590  7487 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.217420  7516 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.203027  7476 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:27.203008  7560 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.221797  7585 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.222337  7517 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.254974  7487 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.226181  7509 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.237641  7634 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:27.242867  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 360) took 1233 ms. Trace:
I20260709 13:02:27.244482  7631 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:27.245941  1525 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:27.246451  7620 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:27.246740  7633 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.209s	user 0.003s	sys 0.001s
I20260709 13:02:27.227885  7506 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.249516  7534 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.292163  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.291918  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.291821  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.295342  1609 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:27.283664  1432 rpcz_store.cc:276] 0709 13:02:26.009012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.009175 (+   163us) service_pool.cc:224] Handling call
0709 13:02:27.242800 (+1233625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:26.339683 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:26.367998 (+ 28315us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:26.368071 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:02:26.368090 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:26.368561 (+   471us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:26.368644 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:26.368676 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:26.368983 (+   307us) tablet.cc:701] Row locks acquired
0709 13:02:26.369035 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:02:26.369284 (+   249us) write_op.cc:270] Start()
0709 13:02:26.369454 (+   170us) write_op.cc:276] Timestamp: P: 1783602146369182 usec, L: 0
0709 13:02:26.369482 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:02:26.370223 (+   741us) log.cc:844] Serialized 541 byte log entry
0709 13:02:26.694479 (+324256us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.088581 (+394102us) write_op.cc:301] APPLY: starting
0709 13:02:27.091642 (+  3061us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:27.169231 (+ 77589us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:27.169341 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.170175 (+   834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.170363 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:27.170403 (+    40us) write_op.cc:312] APPLY: finished
0709 13:02:27.170598 (+   195us) log.cc:844] Serialized 25 byte log entry
0709 13:02:27.170786 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.170867 (+    81us) write_op.cc:454] Released schema lock
0709 13:02:27.170908 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:27.171319 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.171348 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":338627,"apply.run_cpu_time_us":3848,"apply.run_wall_time_us":94567,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":17608,"prepare.run_cpu_time_us":3305,"prepare.run_wall_time_us":35473,"replication_time_us":282842,"thread_start_us":250547,"threads_started":1}]]}
I20260709 13:02:27.209077  7644 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.256022  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 46954.4us
I20260709 13:02:27.247895  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:27.220448  7628 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.263334  2253 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:27.223562  7527 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:27.274715  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.292763  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.227998  7582 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.254046  1431 rpcz_store.cc:276] 0709 13:02:26.130545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.242474 (+111929us) service_pool.cc:224] Handling call
0709 13:02:27.253643 (+1011169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:26.370735 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:26.385000 (+ 14265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:26.385036 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:26.385054 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:26.385608 (+   554us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:26.385663 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:26.385689 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:26.386006 (+   317us) tablet.cc:701] Row locks acquired
0709 13:02:26.386019 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:02:26.386167 (+   148us) write_op.cc:270] Start()
0709 13:02:26.386278 (+   111us) write_op.cc:276] Timestamp: P: 1783602146386118 usec, L: 0
0709 13:02:26.386297 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:26.387014 (+   717us) log.cc:844] Serialized 1302 byte log entry
0709 13:02:27.041978 (+654964us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.171692 (+129714us) write_op.cc:301] APPLY: starting
0709 13:02:27.171755 (+    63us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:27.229927 (+ 58172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:27.230050 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.231805 (+  1755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.231973 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:02:27.232018 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:27.232246 (+   228us) log.cc:844] Serialized 41 byte log entry
0709 13:02:27.250750 (+ 18504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.250846 (+    96us) write_op.cc:454] Released schema lock
0709 13:02:27.250889 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":127426,"apply.run_cpu_time_us":5946,"apply.run_wall_time_us":110693,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12570,"num_ops":3,"prepare.queue_time_us":31221,"prepare.run_cpu_time_us":2921,"prepare.run_wall_time_us":16552,"replication_time_us":641459,"thread_start_us":42865,"threads_started":1}]]}
I20260709 13:02:27.300452  2227 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.312470  1528 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:27.313465  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.221737  7587 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.328009  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.334820  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.220286  7553 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.305914  7480 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.339892  2258 raft_consensus.cc:2368] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17.
I20260709 13:02:27.309561  7583 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.339954  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 92167.2us
I20260709 13:02:27.348584  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.349174  7614 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.349396  1602 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:27.349804  7614 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.350409  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.351019  1602 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:02:27.351758  7555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 1285) took 2795 ms. Trace:
I20260709 13:02:27.352130  7614 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.319334  7516 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:27.353212  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet 7b29577369ec4664a5f1ed7e27dd3265: Illegal state: Replica 428f0180c2cd487c8b48e91f14dff65d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:27.354215  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:27.300298  7620 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.355837  7587 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.356619  7620 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.359160  7589 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.352890  7516 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:27.361979  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 63970.5us
I20260709 13:02:27.363672  1604 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.324785  7637 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.380929  1692 tablet_copy_service.cc:140] P b88b12b461734b3aa6a3da4f5c22c79b: Received BeginTabletCopySession request for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:33564)
I20260709 13:02:27.381579  1692 tablet_copy_service.cc:161] P b88b12b461734b3aa6a3da4f5c22c79b: Beginning new tablet copy session on tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:33564: session id = 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1
I20260709 13:02:27.364037  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.385097  1681 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:27.385897  1526 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:27.386494  7621 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:27.364683  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.380951  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.362280  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.392850  1606 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:27.394584  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.394695  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.366528  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.325161  7564 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.395422  1683 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
W20260709 13:02:27.396813  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 86865.5us
I20260709 13:02:27.401826  7654 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.402395  7654 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.400934  7640 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.402788  7654 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.402822  7637 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.394927  7587 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.406121  7587 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.403461  7640 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:27.406548  7587 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.403450  7515 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.359752  7589 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.409284  7515 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:27.409545  7529 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.806s	user 0.011s	sys 0.000s
I20260709 13:02:27.410061  7529 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.352200  7555 rpcz_store.cc:276] 0709 13:02:24.598191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.634233 (+ 36042us) service_pool.cc:224] Handling call
0709 13:02:25.121320 (+487087us) ts_tablet_manager.cc:934] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:02:26.365580 (+1244260us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:26.939035 (+573455us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:26.966052 (+ 27017us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:27.219822 (+253770us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:27.220175 (+   353us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:27.297022 (+ 76847us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:27.319216 (+ 22194us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":42260,"tablet-copy.queue_time_us":392534,"thread_start_us":405109,"threads_started":2}
I20260709 13:02:27.411559  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.411805  7555 tablet_copy_client.cc:806] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:27.318436  7452 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:02:27.412580  7555 tablet_copy_client.cc:670] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:27.412222  1677 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
W20260709 13:02:27.413930  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47485.3us
I20260709 13:02:27.415007  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.319976  7559 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:02:27.418836  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 99241.7us
I20260709 13:02:27.423026  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.393961  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.423255  7640 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.428730  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.429814  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.429955  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.432922  1604 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:27.433444  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:27.325258  7634 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.437983  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.435865  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.438346  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.328472  7644 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.441772  2253 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:27.410091  7589 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.362236  7480 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.412213  7529 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.442396  1604 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.406148  7637 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.367159  7583 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.440687  7640 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.437882  7481 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:27.413456  7452 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:27.452708  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.464704  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.455788  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.449396  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:27.461948  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.442107  7517 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:27.443310  7631 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:27.464931  2255 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.475956  1604 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.445710  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.447703  7534 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.449896  7645 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:27.478385  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.490227  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.449810  7624 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.491150  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:27.492183  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.492980  1604 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.480033  1678 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:02:27.476809  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 155201us
I20260709 13:02:27.460541  7640 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.500216  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.464382  7481 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.501155  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.477329  7585 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.505340  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:27.515374  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.476969  7515 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:27.477198  7517 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.514951  1531 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:27.497067  7589 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:27.526719  7649 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.526959  7664 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.527439  7649 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.527597  7664 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.529991  7622 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:27.530479  7622 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.530854  7622 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.506413  7640 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.506429  7509 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.495949  7631 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:27.498993  7645 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.542364  7659 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:27.496176  7637 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:27.544147  7634 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.544524  7506 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.545152  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.545933  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.547205  7553 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.532632  7517 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.511655  7481 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.517856  7515 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:27.530287  7651 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.570133  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.570598  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.530023  7664 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.546877  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.533280  7572 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.509574  7534 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.572507  1531 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:27.573151  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.565620  1529 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:27.581257  1602 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:02:27.583527  7632 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.564625  7659 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.589470  1678 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:27.590101  7652 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:02:27.591928  7659 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.592856  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.594242  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.595794  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.596355  1527 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.597821  7566 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:27.598269  7566 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:27.599318  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.599123  7566 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.566149  7589 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:27.605664  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:27.557518  7624 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:27.586994  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.600589  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.587406  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.606495  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.601738  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.612002  1531 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.615237  1679 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.617350  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.618510  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:27.619187  7653 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:02:27.561734  7509 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:27.621155  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.621711  7509 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.604166  7516 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.621727  1605 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.629474  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.605007  7644 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.632450  1609 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:27.632747  7664 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.610865  7572 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.634261  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.634924  1678 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:27.636920  7589 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.618547  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.633260  7664 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.635967  7572 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.643229  1681 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:27.647552  1529 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:27.640285  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51587.4us
I20260709 13:02:27.648236  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:27.648876  1606 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.651908  1605 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:27.650125  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.654613  1676 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:27.587786  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:27.600172  7566 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.570662  7582 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.574097  7515 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.656592  1527 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.666595  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.666505  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:27.659639  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.663175  7660 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.663364  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.670706  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.671875  1605 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:27.675181  2254 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:27.675550  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.676450  1602 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.677327  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:27.678399  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.658548  7516 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.680821  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.681501  2253 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:27.685999  7664 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.665886  7587 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.687155  7645 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.669140  7644 raft_consensus.cc:2764] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:27.690322  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:27.690626  1679 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:27.692489  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.600916  7651 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.605822  7632 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:27.684293  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.695992  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.583251  7631 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.694758  7516 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.702615  7656 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.703069  7656 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:27.703419  7656 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.699085  7651 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.710333  1677 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.665679  7534 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.689517  7660 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.708719  7506 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.748224  7660 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.689265  7637 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.701910  7480 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.723168  7665 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.750516  7665 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.752969  7665 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.724921  7640 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:27.756835  7642 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.639s	user 0.004s	sys 0.003s
I20260709 13:02:27.757740  7649 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.757957  7640 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.652959  7624 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.760030  7624 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.732131  7515 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.730870  7622 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.765286  1533 raft_consensus.cc:2393] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:27.767294  7476 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:27.767863  7198 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:27.730641  7632 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.758409  1529 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:27.767827  7476 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.773101  7515 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.773272  7476 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:27.768816  7517 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.768225  7198 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:27.766569  7487 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.777951  7198 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:27.778772  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.779181  7198 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.779574  7487 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.782300  1531 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.785665  1676 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.688243  7587 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:27.788506  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 127387us
I20260709 13:02:27.788511  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.793990  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.755587  7659 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.770978  7622 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.795997  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.797653  1683 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:27.798099  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.788200  7517 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:27.797654  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 125773us
I20260709 13:02:27.802294  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.801100  2259 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:27.798657  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.808198  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.763844  7656 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.813355  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:27.815567  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.816843  1676 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:27.816918  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.817611  1606 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:27.817708  7198 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:27.818367  1531 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:27.819269  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.820199  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.823127  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.823837  1609 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:27.825232  2259 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:27.826678  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:27.829155  1608 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:27.789206  7481 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.834991  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.836074  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.836730  1681 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:27.836661  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.840456  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.842146  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.813066  7485 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:27.847968  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:27.849030  2254 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:27.849501  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.850081  1609 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.850672  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.851401  1605 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.851975  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.852579  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.845224  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.854090  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.855574  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.856058  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.856405  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.854895  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.857383  2259 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.856426  2254 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.867930  1606 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:27.856978  1530 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:27.869324  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.869968  1606 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.869889  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.871345  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:27.798681  7654 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.880749  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.881376  1608 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.882061  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.882642  2253 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.883373  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.884049  7506 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.884846  7640 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:27.865605  7649 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.886404  7649 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.886801  7649 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.887449  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.865114  7614 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:27.892999  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.898234  2252 raft_consensus.cc:2368] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:02:27.898689  2254 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.895460  1606 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:27.895844  1676 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:27.899829  1681 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:27.891579  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.881982  7624 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:27.898332  7614 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.902064  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.901283  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.908370  7622 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:27.908844  7622 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:27.909113  7481 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.902470  2256 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:27.909734  7622 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.902474  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.911191  1682 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.902652  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.913144  7583 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.918286  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.918946  1683 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:27.907819  2261 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:27.921023  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.875294  7565 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.902916  7674 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:27.926193  2254 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:27.925782  7674 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.921988  7515 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:27.904255  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:27.905375  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:27.906699  1692 tablet_copy_source_session.cc:215] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:27.906621  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58700.7us
I20260709 13:02:27.932166  1609 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:27.934026  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:27.934712  2253 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.935415  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:27.935940  2259 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:02:27.938295  7632 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.941182  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:27.887516  7656 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:27.928108  7674 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.893327  7485 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:27.946087  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.949041  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.949672  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.950531  1600 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 10: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:27.951072  7553 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.949213  7654 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.904978  7624 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.952096  7624 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.905550  7614 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.947713  1683 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:27.963943  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.965281  1604 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:27.966111  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.962031  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:02:27.973614  7640 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:27.974351  7640 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.976579  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.978060  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:27.979182  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:27.979673  1601 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.963863  7553 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:27.980623  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.981392  7553 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:27.984614  7549 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.984828  7485 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:27.986343  1601 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:27.988039  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:27.988689  1681 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:27.981418  1676 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:27.994879  1682 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:27.996194  7659 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:27.943552  7515 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:27.998523  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:27.999179  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.010035  1682 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:28.010062  1681 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.000119  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.007669  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:28.008324  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet c0c802947c11486798c253f6688083e7: Illegal state: Replica b88b12b461734b3aa6a3da4f5c22c79b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:28.011027  1683 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.012488  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.013054  1680 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:28.018848  7662 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.661s	user 0.005s	sys 0.000s
I20260709 13:02:28.020653  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.021188  1603 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.029660  7515 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:28.033496  7549 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:28.034070  7549 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.033424  1603 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:28.035418  7572 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:28.036558  7572 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:28.036911  7572 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:28.037681  7572 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:28.038264  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.038800  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.039119  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.983904  7649 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.053164  7583 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.053745  7583 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.054281  7649 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.055418  7587 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.065114  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.065828  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:28.064471  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.055974  7587 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.074702  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.075428  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.076028  7587 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.078711  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.083113  1674 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:28.083890  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.079674  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.084856  1679 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:28.086227  7624 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.086723  7583 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.080560  7640 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.075445  1605 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:28.081998  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.082103  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3047) took 1169 ms. Trace:
I20260709 13:02:28.091068  1528 rpcz_store.cc:276] 0709 13:02:26.912392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.912512 (+   120us) service_pool.cc:224] Handling call
0709 13:02:26.914402 (+  1890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.316174 (+401772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.081888 (+765714us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540042d6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:28.082028 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914990464}
I20260709 13:02:28.079720  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1607) took 1328 ms. Trace:
I20260709 13:02:28.092959  2258 rpcz_store.cc:276] 0709 13:02:26.751474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.756940 (+  5466us) service_pool.cc:224] Handling call
0709 13:02:28.079525 (+1322585us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54009f10d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:28.079649 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289257728}
I20260709 13:02:28.101810  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.102905  1604 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.105878  1608 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:02:28.104862  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:28.109289  1674 raft_consensus.cc:2368] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:02:28.110275  1681 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:28.108544  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 175614us
I20260709 13:02:28.104733  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:28.115713  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.116915  7198 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:28.121753  7549 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.122925  1647 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:28.123293  1647 leader_election.cc:403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.125742  7198 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:28.126886  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.128381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.129124  1682 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:28.130553  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.131302  1609 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.109643  7649 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.112604  7566 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.105832  7587 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.142294  1609 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:28.142812  1678 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:28.135524  7506 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:28.135769  7622 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.146327  7624 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.146782  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.148542  7665 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:02:28.159605  7622 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.160070  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.161875  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.163159  1532 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:28.162138  7622 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.150635  1604 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:02:28.153443  1680 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:28.154590  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:28.210810  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 56342.4us
I20260709 13:02:28.155300  1683 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:28.213001  7622 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:28.213678  7622 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.214846  7622 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.155473  7198 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.125803  7572 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.136686  7679 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:28.164944  7564 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:28.152822  7566 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.221280  7566 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.231148  7566 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.234102  7566 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:28.202641  7650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.019s	sys 0.012s
I20260709 13:02:28.211987  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:28.277212  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 65327.5us
I20260709 13:02:28.152604  7649 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.239719  7679 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:28.243494  7684 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:02:28.236546  7559 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
W20260709 13:02:28.252727  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.166337  7587 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:28.257104  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 143304us
W20260709 13:02:28.277011  7650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.020s	sys 0.012s
W20260709 13:02:28.282966  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 121153us
I20260709 13:02:28.285399  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:28.319656  1532 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.284343  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.280428  7516 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:28.334290  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.339721  7653 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:28.345003  7549 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.347116  7649 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.285553  7509 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.348704  7509 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.350922  7509 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.351509  7516 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.283905  7553 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:28.357554  7480 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.357157  7679 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:28.359133  1532 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:28.358327  7480 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.362241  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.369685  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:28.353804  7553 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.343863  7614 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:28.370126  7506 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.373176  7637 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:28.393464  7198 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:28.394097  7198 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.394549  7198 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:28.390837  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 276664us
I20260709 13:02:28.359684  7566 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:02:28.395568  7564 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:28.450634  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 166458us
I20260709 13:02:28.456408  7198 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.417282  7622 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.457183  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:28.407903  7637 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.482550  1601 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:28.479612  7198 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.480234  7553 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.494879  7637 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.501411  7516 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.505308  7198 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.506242  7198 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.514731  7198 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.533501  1609 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:28.534945  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.519793  7515 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:28.550797  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.551059  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.550303  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.552150  1683 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:28.552211  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.552573  1680 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:28.561152  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:28.553488  7694 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.559108  7697 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:28.563620  7697 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:28.563418  7694 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.565070  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.568367  1679 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:28.551811  7712 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:28.556169  7687 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
I20260709 13:02:28.567497  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.575449  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:28.571827  7712 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.515719  7506 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.568419  7587 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.578326  7712 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.574237  7649 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:28.615554  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.564690  7697 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.620563  7614 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:28.639626  7703 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.565038  7515 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:28.642077  7515 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:28.613292  7701 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:28.646958  7694 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.613767  7564 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:28.649186  7713 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:28.632053  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.653644  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.625360  7639 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.658761  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.658023  7509 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.657783  7649 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.658393  7694 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:28.665531  7639 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.660981  7515 raft_consensus.cc:2764] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:02:28.670818  7509 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:28.689177  7704 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:02:28.690302  1424 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 13, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.669258  7702 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:28.699334  1647 leader_election.cc:400] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17.
I20260709 13:02:28.699914  1573 leader_election.cc:400] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:02:28.700335  1573 leader_election.cc:403] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.684377  7639 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.683571  7694 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:28.703352  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.705483  1605 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.669245  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.696981  7509 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.711282  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:28.711593  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.711350  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.712548  1680 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:28.712772  2252 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:28.704844  7706 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:02:28.714111  2256 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.711283  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.714691  1607 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:28.714803  1679 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.716176  7515 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:28.716621  7515 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.717002  7515 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.722628  7506 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.723282  7506 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.725881  7506 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.726544  7649 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.700870  7702 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:28.730661  7702 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.734604  1679 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:28.742844  1605 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:28.745429  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.746743  7694 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.711597  7650 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.748335  7650 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.750829  7650 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:28.755836  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.757575  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:28.754914  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.758247  2253 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.763200  7702 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.766108  2253 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:28.769937  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:28.773214  2257 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.753454  7640 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:28.776132  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.778010  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.778685  1679 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.807335  7703 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.808113  7703 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.810582  7703 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.781196  7640 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:28.803751  7515 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.812089  7640 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:28.818315  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.819286  1674 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:28.820130  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.820931  1678 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:28.821815  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:28.823875  7698 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.334s	user 0.002s	sys 0.000s
I20260709 13:02:28.824347  7639 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.826637  7639 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.829002  7509 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.829825  7476 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:28.830304  7476 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:28.831434  7509 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.831193  7476 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:28.837616  7705 log.cc:927] Time spent T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
W20260709 13:02:28.839869  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.847922  1679 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:28.848690  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.854483  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.855270  1679 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:28.861024  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.861689  1680 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:28.861070  2257 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:28.862843  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.864578  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.866571  7515 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.866770  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.879290  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:28.879920  1534 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.883728  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.885702  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.887302  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.888563  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.889178  1604 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:28.891441  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.892416  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.893570  7694 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.894030  7694 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.894626  7694 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.895467  1677 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:28.895877  1677 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:28.896554  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.893623  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.898468  7651 raft_consensus.cc:2764] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:28.858489  7476 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:28.899411  1602 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:02:28.900966  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.902905  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.894009  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.900024  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.901734  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.906379  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.907174  1530 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:28.908820  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:28.909168  1530 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.906315  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.900130  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:28.906508  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.913296  1529 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:28.920022  7716 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.910818  7506 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:28.921325  7506 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:28.921758  1528 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:28.896675  1677 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:28.922897  1677 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.923650  7506 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:28.944752  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:28.945647  1680 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:02:28.943174  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 62443.3us
W20260709 13:02:28.944573  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 57005.2us
I20260709 13:02:28.937252  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.946590  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.946822  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:28.945132  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.946820  2258 raft_consensus.cc:2376] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15. Re-sending same reply.
I20260709 13:02:28.888139  7702 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:28.950029  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.905162  7517 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:28.959702  1608 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:28.955277  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:28.956198  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:28.958022  1602 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:28.960814  1606 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.924247  7509 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:28.964979  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:28.965538  1527 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:28.966566  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.967387  1534 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:28.951539  7634 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.971160  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.972406  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:28.976065  1677 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:02:28.976666  1677 pending_rounds.cc:85] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 13
I20260709 13:02:28.978894  1602 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:28.979626  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.955415  7631 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:28.959995  7670 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.976922  1677 pending_rounds.cc:107] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:02:28.988268  1677 raft_consensus.cc:2889] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.982583  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.989344  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:28.988431  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.986341  1608 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:28.994004  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.961788  7624 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.952555  7515 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:29.001415  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:29.005308  1606 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:29.008718  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:28.979099  7634 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.007902  1604 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:28.980834  7509 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:29.013846  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:29.015381  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.015381  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:29.003283  7637 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.014618  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:28.965003  7703 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:02:28.965049  7517 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.022230  7198 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:29.013867  7650 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:29.006624  7651 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.004781  7506 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:29.004469  7712 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:29.018430  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:29.000825  7660 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:29.020154  2258 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:29.012064  7634 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.026510  7517 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:29.009375  7527 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:29.019354  7487 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:29.011885  7649 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:02:29.032593  7198 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.035301  1677 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:29.011746  7555 tablet_copy_client.cc:538] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:29.066082  7198 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:29.022625  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:29.010617  7565 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:29.010134  7631 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.042902  2253 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:29.044085  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.038286  7702 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:29.018442  7708 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:29.074968  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52434.4us
I20260709 13:02:29.022572  7706 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:29.016968  7559 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:29.077005  2258 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:02:29.023054  7716 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:02:29.051450  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.040566  7712 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.069548  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.072808  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.073761  7517 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.078604  7198 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.047962  7679 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.083853  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.085139  7198 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.086092  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.071722  7506 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:29.089983  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.091406  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:29.045818  7660 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.087702  7527 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.075225  7565 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.079778  7564 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:29.098269  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.089238  7506 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:29.085289  7712 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.107594  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.101714  1602 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:02:29.088080  7682 raft_consensus.cc:2764] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:29.094026  7650 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.094142  7695 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:29.094937  7527 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:29.102404  7708 raft_consensus.cc:2764] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:29.108210  7644 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:02:29.093555  7534 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:29.092257  7656 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:02:29.084682  7487 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:02:29.119609  7480 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.121224  7565 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.097182  7509 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.092720  7716 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:29.125950  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.116514  7701 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.137364  7733 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.110474  7564 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.124686  7534 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.147413  7534 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.148025  7564 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.141029  7506 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.135280  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:29.137163  7540 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.112600  7695 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:29.162503  7695 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.163280  7634 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.137480  7628 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.152537  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:29.160545  7701 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.161468  7665 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.163769  7695 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.164732  7660 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:29.166647  7480 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:29.167420  7725 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:02:29.154472  7631 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:29.170552  7727 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:29.171437  7651 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:29.186302  7691 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:29.110111  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 92191.5us
I20260709 13:02:29.177457  1533 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:29.158390  7540 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:29.181499  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77556us
W20260709 13:02:29.189049  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 105249us
W20260709 13:02:29.179129  7729 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:02:29.196259  1609 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:29.196607  7198 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:29.203915  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.224937  1528 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:29.171677  7679 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.186815  7682 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.239003  7198 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.239144  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.188381  7628 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.193485  7665 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.234508  7702 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:29.244503  7706 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.224299  7480 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:29.283645  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.273342  7702 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:29.282682  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47114.5us
I20260709 13:02:29.247704  7527 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:29.324373  7198 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.277530  7682 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.342053  7517 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.280229  7583 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:02:29.344265  7650 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.348599  7682 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.328835  7198 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.349728  7198 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.351804  7198 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.235203  7691 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.301714  7487 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:02:29.259076  7716 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.328354  7736 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:29.368558  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 121937us
I20260709 13:02:29.374511  1574 leader_election.cc:400] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 13. Current term is 14.
I20260709 13:02:29.375859  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.248984  7679 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.302336  7694 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.381058  7708 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:29.379336  7736 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.390731  7634 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:29.391213  7734 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.391995  7701 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.391803  7734 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.326508  7706 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.393253  7480 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.417332  1680 raft_consensus.cc:2368] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:29.436018  7734 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.419577  7644 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.441594  7644 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.443765  7644 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.420678  7708 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:29.440898  7555 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
W20260709 13:02:29.421917  1498 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.532s (SENT) [suppressed 12 similar messages]
W20260709 13:02:29.440982  7741 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:29.473392  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.473838  1601 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:29.474342  1609 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:29.474926  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:29.470340  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145137us
I20260709 13:02:29.481479  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:29.393703  7527 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:29.568754  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 87352.9us
I20260709 13:02:29.450467  7708 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.573604  7734 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.574266  7734 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.451020  7736 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:29.589025  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 303811us
I20260709 13:02:29.591001  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.591789  1600 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:29.589996  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:29.576449  7605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.621847  2227 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:29.568166  7695 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.630141  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:29.631747  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:29.636019  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:29.576902  7702 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.576682  7691 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.590631  7660 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:29.576269  7679 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.632405  1526 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:29.577445  7750 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.646761  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:29.647373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.651908  1532 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:29.624982  7566 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:29.662089  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.624816  7480 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:29.599169  7628 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.628057  7734 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.662796  1606 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:29.624748  7634 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:29.659984  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.660281  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.660578  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:29.660674  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:29.673933  1609 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:29.674295  1529 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.660588  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:29.674408  1601 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:29.631582  7665 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:29.651504  7534 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.007s
I20260709 13:02:29.667243  1681 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:29.666666  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 244765us
I20260709 13:02:29.640829  7738 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:29.640677  7701 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:29.673996  1600 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:02:29.675747  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.784343  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.649936  7660 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.731271  1432 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 11 to 12, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 12 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:29.637993  7517 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:29.653861  7746 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.637038  7695 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.653465  7559 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.676721  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:29.696138  7694 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:29.781920  7198 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:29.768622  7476 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.001s
I20260709 13:02:29.667410  7566 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.718957  7534 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.672806  7480 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.770819  7679 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.667732  7750 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.817024  7198 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.826601  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:29.854727  1526 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:02:29.787230  7738 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:29.786398  7564 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.792443  7660 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:29.844380  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.786137  7701 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:29.813267  7583 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.868549  7583 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.871054  7583 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:29.871788  7749 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:02:29.873106  7753 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:29.873971  7480 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.867846  7701 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.875665  7534 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:29.876585  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:29.877159  2258 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:29.879097  7564 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.881592  7564 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.827600  7559 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.884080  7198 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.885255  1529 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:29.826161  7691 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:29.856258  7476 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:29.918519  2258 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:29.867399  7679 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:29.925491  7566 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:29.901378  7476 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.946326  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 269668us
W20260709 13:02:29.945672  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 115814us
I20260709 13:02:29.953393  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:29.901072  7691 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:29.962076  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.953979  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 140411us
I20260709 13:02:29.934942  7476 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.942729  7766 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:29.981637  1680 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:29.982307  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:29.970645  7649 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.970023  7566 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.981462  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:29.996654  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:29.988955  7480 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.015338  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.000685  7480 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:30.001261  7679 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.026129  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3012) took 1012 ms. Trace:
I20260709 13:02:30.026603  1604 rpcz_store.cc:276] 0709 13:02:29.014016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.014389 (+   373us) service_pool.cc:224] Handling call
0709 13:02:30.025864 (+1011475us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540029bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:30.026034 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466116864}
I20260709 13:02:30.029167  7750 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.033619  7739 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:30.034183  7739 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:29.999750  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:30.038620  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.037978  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:30.041371  1680 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:30.044413  7694 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.044870  7694 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.045238  7694 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.001319  7566 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.047257  7701 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.001955  7583 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.053108  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:29.995298  7766 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:29.981261  7760 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
W20260709 13:02:30.019157  7754 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:02:30.037000  7691 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.017514  7559 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:29.963591  7738 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.002698  7649 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.056540  2258 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:30.058609  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.125181  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.058756  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.148978  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.048940  7695 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:30.038532  7716 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.258641  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.137779  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:30.260815  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 181378us
W20260709 13:02:30.260622  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 105395us
I20260709 13:02:30.181070  1607 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:30.067317  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.266736  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:30.261166  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.268404  1530 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:30.091226  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 183724us
I20260709 13:02:30.270184  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.271627  1499 leader_election.cc:400] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:30.271950  1499 leader_election.cc:403] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.274690  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:30.274505  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 207347us
I20260709 13:02:30.037493  7768 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.282207  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.197489  7766 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:30.302632  7766 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:30.304910  7766 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:30.290195  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3014) took 1183 ms. Trace:
W20260709 13:02:30.291302  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 697978us
I20260709 13:02:30.261540  7771 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.308109  7771 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.284960  7768 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.049574  7735 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:30.307367  1608 rpcz_store.cc:276] 0709 13:02:29.107190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.107324 (+   134us) service_pool.cc:224] Handling call
0709 13:02:30.289963 (+1182639us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:30.290104 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132965632}
I20260709 13:02:30.309580  7695 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.297061  7198 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:30.260346  7716 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.310130  7695 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.310609  7716 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.313558  7506 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.274426  7553 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.259807  7649 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:30.309229  7735 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.293884  7701 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.179030  7480 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:30.315261  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:30.269793  7628 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.323733  7628 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:30.325661  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.325981  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:30.315448  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48812.4us
I20260709 13:02:30.308194  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:30.260718  7583 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:30.316078  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 56293.3us
I20260709 13:02:30.316155  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.179296  7566 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:30.329841  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.280261  7516 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:30.318142  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52763.9us
I20260709 13:02:30.313832  7771 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:30.336005  2254 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:30.312198  7695 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.336947  1602 raft_consensus.cc:2410] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:30.329360  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.334849  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.314082  7768 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.308775  7776 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:30.341332  1526 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:30.343817  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.096597  7540 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.361172  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.326565  7650 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.330147  7712 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.216s	user 0.008s	sys 0.005s
I20260709 13:02:30.268966  7660 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.330709  7555 tablet_bootstrap.cc:700] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Time spent opening tablet: real 0.196s	user 0.001s	sys 0.001s
I20260709 13:02:30.347414  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.347077  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.348340  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.349208  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.333698  7516 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.353467  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.354247  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.373090  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.355268  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.373723  1608 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:30.357148  1534 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:30.371287  1527 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:30.360474  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.357468  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.347996  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 2983) took 1158 ms. Trace:
I20260709 13:02:30.363070  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.360674  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.335506  7649 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.340260  7527 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:30.369042  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.331048  7583 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.373857  1532 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:02:30.364307  7755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.013s
I20260709 13:02:30.377501  1529 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:30.377677  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.378189  7695 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.378397  7540 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:30.378638  1573 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5293a667c8bb4fdbb1fa97aaeba1cfc1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:30.381008  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1364) took 1481 ms. Trace:
I20260709 13:02:30.389649  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:30.375340  1675 rpcz_store.cc:276] 0709 13:02:29.180531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.180690 (+   159us) service_pool.cc:224] Handling call
0709 13:02:29.181129 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.188390 (+  7261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.188425 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.194168 (+  5743us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.543552 (+349384us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:29.543621 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.543694 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.337213 (+793519us) raft_consensus.cc:1685] finished
0709 13:02:30.337235 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.337343 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14415,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31903,"thread_start_us":314518,"threads_started":1,"wal-append.queue_time_us":431104}
I20260709 13:02:30.396061  1530 rpcz_store.cc:276] 0709 13:02:28.900077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.910102 (+ 10025us) service_pool.cc:224] Handling call
0709 13:02:28.915269 (+  5167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.276747 (+1361478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.380775 (+104028us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002ccc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:30.380949 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3111423744}
I20260709 13:02:30.327946  7476 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.401520  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.374722  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:30.396025  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46585.3us
I20260709 13:02:30.404528  2260 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:30.409813  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.137771  7739 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.410609  1532 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:30.321796  7553 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:30.387998  7516 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:30.394833  7755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.004s	sys 0.013s
I20260709 13:02:30.426340  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.430662  1683 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:02:30.431547  7737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.005s
W20260709 13:02:30.431905  7737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.017s	sys 0.005s
I20260709 13:02:30.423398  7736 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:02:30.436342  7697 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.406757  7509 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:30.437170  7509 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.437662  1677 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:30.439630  7509 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.423446  7480 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:30.441105  7777 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:02:30.407397  7605 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
I20260709 13:02:30.442081  7476 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.442713  7605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48924 (request call id 1600) took 4358 ms. Trace:
I20260709 13:02:30.407748  7628 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.443135  7605 rpcz_store.cc:276] 0709 13:02:26.088143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.090823 (+  2680us) service_pool.cc:224] Handling call
0709 13:02:26.344790 (+253967us) ts_tablet_manager.cc:934] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
0709 13:02:29.279798 (+2935008us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:29.877873 (+598075us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:29.877987 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:30.441919 (+563932us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:30.442244 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:30.442542 (+   298us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:30.442611 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54989,"tablet-copy.queue_time_us":198946,"thread_start_us":238710,"threads_started":2}
I20260709 13:02:30.450888  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 226) took 2982 ms. Trace:
I20260709 13:02:30.371640  7650 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.436924  7697 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.451139  7605 tablet_copy_client.cc:806] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:30.429028  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.373353  7712 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.456995  7605 tablet_copy_client.cc:670] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:30.457674  7712 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:30.416354  1432 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 16, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:30.446334  1674 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:30.447659  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.449579  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.450438  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.451294  1431 rpcz_store.cc:276] 0709 13:02:27.443014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.443154 (+   140us) service_pool.cc:224] Handling call
0709 13:02:30.425345 (+2982191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4168,"reported_tablets":4}
I20260709 13:02:30.465909  1526 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:30.407341  7566 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.453720  7697 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.473068  7553 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:30.468783  7566 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.473866  7566 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.474928  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.475224  7768 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.475819  1682 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:30.385087  7756 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:02:30.445125  7735 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.467064  1677 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:30.453442  7650 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:30.364766  7694 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.466308  1675 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:30.472584  7787 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:30.477691  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 135096us
I20260709 13:02:30.537137  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.481293  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.436640  7660 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:30.501096  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.545783  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62908.3us
I20260709 13:02:30.510154  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.537778  2256 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.539583  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.469079  7776 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.549021  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.550045  2254 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:30.553025  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:30.553972  1529 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.552894  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.556483  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.559561  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.561453  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.561748  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.562192  2259 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.562530  2253 raft_consensus.cc:2368] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:30.565397  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.565977  1680 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:30.566262  1530 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:30.566377  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:30.569453  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 226936us
I20260709 13:02:30.576845  1529 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:30.580269  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.581646  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.545540  7706 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:30.583256  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.583659  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:30.548877  7776 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.591212  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.584857  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.592067  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.594762  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.597805  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.607158  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.553330  7614 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:02:30.596069  7776 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:30.655468  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62033.3us
I20260709 13:02:30.637490  2259 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:02:30.647465  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.642830  2256 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:30.650357  2261 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:30.665561  2258 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:30.663236  2254 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:30.625662  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.675565  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.675813  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.667227  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.678133  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.678977  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.679782  7751 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.680186  7751 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.680565  7751 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:30.631785  7791 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:02:30.651468  7583 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.684649  7583 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.684749  7737 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:30.682600  7762 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.689826  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:30.690465  2256 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:30.599010  7695 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:30.697754  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:30.594046  7736 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:30.698828  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73267.7us
I20260709 13:02:30.685400  7737 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:30.710157  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.710850  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.716365  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.716547  2254 raft_consensus.cc:2376] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15. Re-sending same reply.
I20260709 13:02:30.717561  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.717649  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.637138  7697 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.609714  7476 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.629361  7768 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.724375  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.713610  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.654536  7649 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.714792  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.726985  1604 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.715390  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.719831  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:30.720273  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.638686  7694 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.723109  2253 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.723256  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.723863  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.594616  7706 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.725628  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.712410  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.599165  7650 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:02:30.600694  7565 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:02:30.714443  7691 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.731964  7198 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:30.714612  7783 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.708760  7762 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:30.773221  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.723984  7695 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:30.729168  7665 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.742839  1529 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.743860  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.788688  2253 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:30.789716  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.649475  7516 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.747350  7198 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.715411  7566 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.720810  7697 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.721563  7737 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.749176  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:30.766757  1609 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:30.633344  7716 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:30.773643  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:30.726985  7760 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.713195  2259 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:30.708511  7559 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:30.740361  2254 raft_consensus.cc:2376] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14. Re-sending same reply.
I20260709 13:02:30.810268  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.780869  2261 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:30.781574  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:30.792294  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 193737us
I20260709 13:02:30.793504  7198 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.812000  2257 raft_consensus.cc:2368] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:30.736835  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.812695  2256 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:30.793864  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.763468  7783 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.801331  1529 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:30.803238  1602 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:30.774051  7762 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:30.804946  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55843.8us
I20260709 13:02:30.806224  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.741472  7480 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 13:02:30.783226  7665 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.808144  1609 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:30.898311  7198 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:30.878532  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:30.889418  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.920821  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:30.921366  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.922775  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.923350  2255 raft_consensus.cc:2376] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11. Re-sending same reply.
I20260709 13:02:30.914330  7516 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:30.925410  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:30.927987  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.928934  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:30.929513  1525 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:30.882369  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.838217  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.817301  2253 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:30.872423  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.845090  1604 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:30.794797  7476 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:30.933642  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 213431us
I20260709 13:02:30.933683  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.935753  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:30.933197  2254 raft_consensus.cc:2376] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17. Re-sending same reply.
W20260709 13:02:30.958418  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.959419  2253 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:30.931521  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.952032  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.924229  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.942071  1608 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.962213  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:30.803797  7697 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:30.929914  7802 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:02:30.843853  7795 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:02:30.971316  1534 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:30.950143  1498 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:30.941726  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:30.972702  1528 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.973984  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:30.984935  1531 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
W20260709 13:02:30.985249  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 43597.2us
I20260709 13:02:30.975688  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.976250  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.987044  2259 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 21: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:30.976696  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:30.987668  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.977022  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:30.988909  1680 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:30.931231  7665 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.988924  2254 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:30.856737  7786 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:30.871942  7703 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:31.000833  2254 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:30.940812  7480 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.990690  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:30.989950  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:30.934422  7783 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.996536  1674 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:30.998904  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.000036  2253 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:02:30.991171  1531 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:30.976436  7691 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:31.006256  2259 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:31.009533  2255 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:31.010030  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:30.981233  7760 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:31.005776  1676 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:30.981122  7736 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.976552  7712 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.021337  1498 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.021488  1531 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:31.019990  1679 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:30.991132  7614 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.007895  7480 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.999418  7476 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:31.034847  1533 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:30.905494  7695 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.002741  7565 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:31.030445  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.048355  1498 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.015029  7516 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.020642  7691 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:31.015189  7679 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:31.042768  7694 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.058111  7624 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:02:31.079291  7799 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:02:31.081804  7806 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:02:31.083463  7809 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.023842  7631 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:31.063246  7702 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:31.036360  7517 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:02:31.100626  7198 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.103513  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:31.106864  7750 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.107407  7691 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.024145  7800 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.027643  7736 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:31.111542  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.042539  7755 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.059358  7480 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.009536  7703 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.049559  7660 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.117892  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:31.187723  1601 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:31.188794  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 77387.7us
I20260709 13:02:31.097678  7739 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.035890  7622 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:02:31.076731  7706 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.041190  7760 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.077438  7476 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:31.057904  7649 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:02:31.160097  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:31.133124  7694 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.130771  7644 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.135849  7566 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.184803  7736 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.113511  7565 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.117101  7679 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.193460  7792 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.189039  7506 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:31.242535  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 225552us
W20260709 13:02:31.265760  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 275136us
I20260709 13:02:31.267148  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:31.265617  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.193265  7755 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:31.270350  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:31.267656  1601 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:31.272349  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:31.271636  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.220551  7622 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.278720  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:31.196655  7660 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.187225  7800 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.189265  7750 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:31.331761  1674 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.334900  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:31.338367  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.263347  2226 connection.cc:256] RPC call timeout handler was delayed by -1.1236024440000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:02:31.274809  7583 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.224325  7737 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.342655  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:31.344026  1675 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.273412  7631 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:31.349776  1674 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:31.345458  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 297199us
I20260709 13:02:31.278097  7644 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:31.276799  7540 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.351279  1498 leader_election.cc:400] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15.
I20260709 13:02:31.327939  7624 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:31.353972  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 164320us
I20260709 13:02:31.360213  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:31.367129  7534 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.366786  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:31.272264  7506 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:31.376231  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.378471  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:31.268060  7792 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.361969  7756 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:31.390338  7756 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:31.390750  7756 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:31.391606  7750 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.352845  7644 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:31.393870  7792 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.393553  7644 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.395195  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:31.396277  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.396591  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:31.392539  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:31.279678  7755 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:31.401710  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 127029us
I20260709 13:02:31.363253  7624 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:31.350176  7738 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:02:31.410949  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.407334  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.370530  7823 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.417254  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.384076  7534 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.384898  7622 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:31.418279  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:31.402878  7810 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:02:31.394850  7644 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.434363  7830 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:31.371349  7540 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:31.436988  7814 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:31.437640  7679 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.438434  7679 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.441967  7622 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:31.443003  7622 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.391775  7756 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.445490  1527 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.446467  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:31.450428  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.436677  7631 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:31.449190  1601 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:31.458686  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.463923  2255 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:31.469856  7624 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.471058  7665 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.496135  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:31.498528  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:31.506939  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:31.507510  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.507716  1608 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.365064  7476 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:31.510854  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136709us
I20260709 13:02:31.471534  7624 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:31.515321  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58435.7us
I20260709 13:02:31.519120  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.528110  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.529614  1677 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:02:31.553576  1677 pending_rounds.cc:85] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 12
I20260709 13:02:31.553941  1677 pending_rounds.cc:107] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:02:31.554340  1677 raft_consensus.cc:2889] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:31.554581  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 106361us
I20260709 13:02:31.561084  1608 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:31.560696  1677 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:02:31.546250  7751 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.831s	user 0.005s	sys 0.006s
I20260709 13:02:31.523006  7756 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.540095  7506 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.532089  7760 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.648676  7694 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.650727  7836 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:31.651502  7836 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:31.522325  7703 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.537673  7565 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.544219  7737 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.531030  7540 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.575508  1677 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.528396  7534 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 13:02:31.647274  7665 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.531809  7800 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.647009  7751 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:31.695544  1531 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:31.566956  7517 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.696995  7834 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:31.658784  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.650966  7838 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.566582  7823 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:31.651686  7776 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.940s	user 0.010s	sys 0.001s
I20260709 13:02:31.565522  7768 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:31.699885  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 253476us
W20260709 13:02:31.705971  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 207511us
W20260709 13:02:31.710134  1498 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:31.711525  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.558390  7824 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 13:02:31.712860  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:31.702950  7697 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.705s	user 0.002s	sys 0.009s
W20260709 13:02:31.734457  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 2891) took 2093 ms (client timeout 1761 ms). Trace:
W20260709 13:02:31.735539  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 223832us
W20260709 13:02:31.734975  1533 rpcz_store.cc:269] 0709 13:02:29.634295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.634489 (+   194us) service_pool.cc:224] Handling call
0709 13:02:31.727424 (+2092935us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000b5ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:31.727556 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663245056}
W20260709 13:02:31.735602  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 303648us
I20260709 13:02:31.737309  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:31.708498  7834 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:31.716733  7823 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:31.759785  7811 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:02:31.652580  7836 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:31.743925  7783 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.001s
I20260709 13:02:31.720417  7787 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:02:31.710043  7768 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.709149  7776 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.728013  7697 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.739576  7838 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.768247  7553 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.797374  1528 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:31.777511  7480 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:02:31.800504  1680 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.799451  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:31.774783  7783 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:31.803882  7739 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.008s
I20260709 13:02:31.823256  1682 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.802809  7742 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.819073  7631 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:02:31.824687  2252 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:31.829708  7820 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.830404  7820 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.817451  7850 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.834609  7850 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:31.817282  7800 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:02:31.842299  7762 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.000s
W20260709 13:02:31.827112  7691 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
W20260709 13:02:31.856921  7837 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:31.857795  7697 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.858841  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1342) took 1136 ms. Trace:
I20260709 13:02:31.859249  2261 rpcz_store.cc:276] 0709 13:02:30.722652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.001066 (+278414us) service_pool.cc:224] Handling call
0709 13:02:31.023786 (+ 22720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.242607 (+218821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.258977 (+ 16370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.273372 (+ 14395us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.684287 (+410915us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:31.795173 (+110886us) log.cc:844] Serialized 14 byte log entry
0709 13:02:31.802385 (+  7212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.802615 (+   230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.858614 (+ 55999us) raft_consensus.cc:1685] finished
0709 13:02:31.858635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.858781 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102934,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2436,"raft.queue_time_us":71815,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":13303,"thread_start_us":599437,"threads_started":3,"wal-append.queue_time_us":395839}
I20260709 13:02:31.804492  7480 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:31.838112  7651 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.837405  7553 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:31.903385  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:31.904232  2253 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:31.869298  1681 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.819953  7823 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.871578  7651 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.877646  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:31.844843  7850 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.885773  7783 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.888846  7768 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.865077  7706 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:31.801127  7834 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:31.894941  7736 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.000s
I20260709 13:02:31.912765  7553 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.919313  7750 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:31.885231  7712 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.002s
I20260709 13:02:31.842911  7762 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.920913  7480 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:31.909261  7794 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:31.909804  7776 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.923781  7762 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:31.923269  7834 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.922178  7712 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.926265  1674 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.926627  7553 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.925014  7794 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:31.929100  7794 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:31.929530  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:31.929872  7794 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.930639  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1323) took 1393 ms. Trace:
I20260709 13:02:31.930990  2252 rpcz_store.cc:276] 0709 13:02:30.537309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.537428 (+   119us) service_pool.cc:224] Handling call
0709 13:02:31.930469 (+1393041us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:31.930588 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2920189184}
I20260709 13:02:31.931949  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3029) took 1327 ms. Trace:
I20260709 13:02:31.910173  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:31.928718  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.933290  2254 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:31.911114  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:31.910578  7820 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:31.932329  1603 rpcz_store.cc:276] 0709 13:02:30.604686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.604879 (+   193us) service_pool.cc:224] Handling call
0709 13:02:30.605161 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.779191 (+174030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.779225 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.779272 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:30.779314 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.931710 (+1152396us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54004385d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:31.931749 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.931872 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399719296}
I20260709 13:02:31.861563  7691 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.923393  1529 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.930270  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:31.899343  7583 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.002s
I20260709 13:02:31.928608  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:31.893666  7534 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:31.932837  1526 raft_consensus.cc:2376] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14. Re-sending same reply.
I20260709 13:02:31.948967  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:31.916769  7706 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:31.931067  7794 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.957217  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:31.955171  1528 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:31.960170  1680 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:31.961369  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:31.961719  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:31.935420  7553 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.934803  7776 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:31.949265  7565 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:31.948956  7750 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.973810  1680 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:31.979017  1676 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.953534  7583 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.919519  7736 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.981729  1680 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 13
I20260709 13:02:31.984748  1680 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:31.985073  1680 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:31.985102  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.954800  7534 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:31.994179  7534 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.995587  7534 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.981184  7553 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.975807  7702 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:31.996764  7706 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:31.998129  7553 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:32.005478  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:32.006757  1677 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:31.973083  7735 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:32.006106  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3036) took 1212 ms. Trace:
W20260709 13:02:32.011337  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.998205  7706 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.996881  7702 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:31.999028  7716 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.010339  1605 rpcz_store.cc:276] 0709 13:02:30.793260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.919870 (+1126610us) service_pool.cc:224] Handling call
0709 13:02:31.920150 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.920385 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:31.920771 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.005529 (+ 84758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.005586 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:32.005637 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.005909 (+   272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.006042 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2542,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2100,"thread_start_us":84389,"threads_started":1}
W20260709 13:02:32.028285  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.986232  7565 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:31.982990  7776 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:32.038677  7736 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.040648  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:32.043743  7691 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.017458  7735 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.058350  7735 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.060461  1534 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:32.061056  7565 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.066718  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:32.068686  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:32.069393  2252 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:32.072680  7702 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.074118  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3040) took 1051 ms. Trace:
I20260709 13:02:32.074502  1609 rpcz_store.cc:276] 0709 13:02:31.023242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.230947 (+207705us) service_pool.cc:224] Handling call
0709 13:02:31.231308 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.271566 (+ 40258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.271594 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:31.271647 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:31.271678 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.073867 (+802189us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540034b2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.073914 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.074044 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92134144}
I20260709 13:02:32.079715  7739 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:32.080402  7739 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.081115  7776 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:32.081758  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.083319  7739 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:32.083897  7739 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.068858  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2907) took 1085 ms. Trace:
I20260709 13:02:32.085417  1531 rpcz_store.cc:276] 0709 13:02:30.983563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.050686 (+ 67123us) service_pool.cc:224] Handling call
0709 13:02:31.051072 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.696028 (+644956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.068585 (+372557us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002cc754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.068795 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481502080}
I20260709 13:02:32.086508  7850 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.086725  7820 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:32.088069  7820 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:32.088485  7820 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:32.089354  7820 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.090621  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:32.091702  7850 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.091957  7739 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.093874  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.094885  1532 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:32.096029  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:32.096962  7739 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:32.090626  7820 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.098647  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:32.098253  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:32.099496  2252 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 21: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:32.097980  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:32.104651  7735 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:32.105379  7735 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:32.098542  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:32.107710  7735 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:32.108202  7739 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.109098  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:32.110296  7739 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.109143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.111673  1683 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:32.114362  7792 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:32.115229  7540 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:32.117094  7793 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:32.117328  7817 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:32.117805  7817 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:32.118698  7817 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.119796  7817 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.123497  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1470) took 1413 ms. Trace:
I20260709 13:02:32.123391  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:32.125725  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.126920  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:32.123909  2257 rpcz_store.cc:276] 0709 13:02:30.709722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.921425 (+1211703us) service_pool.cc:224] Handling call
0709 13:02:31.921753 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.922121 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.922148 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.922611 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.008192 (+ 85581us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:32.008231 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.008295 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.123284 (+114989us) raft_consensus.cc:1685] finished
0709 13:02:32.123304 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.123439 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1683,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":85233,"threads_started":1,"wal-append.queue_time_us":110986}
W20260709 13:02:32.149286  7818 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.806s	user 0.005s	sys 0.005s
I20260709 13:02:32.132825  7793 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:32.154028  7793 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.155421  7793 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.156746  7755 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.157138  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1356) took 1396 ms. Trace:
I20260709 13:02:32.157534  2254 rpcz_store.cc:276] 0709 13:02:30.790561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.006336 (+215775us) service_pool.cc:224] Handling call
0709 13:02:31.932970 (+926634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.933646 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.156915 (+223269us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54004079d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:32.157056 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130387328}
I20260709 13:02:32.132900  7756 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.175176  7751 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:32.178158  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 92976.6us
I20260709 13:02:32.131929  7739 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.178934  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:32.179901  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 100408us
I20260709 13:02:32.180461  2260 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:32.184194  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.185139  1606 raft_consensus.cc:2410] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:32.185822  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:32.187378  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:32.184568  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:32.178383  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.183259  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:32.197096  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.200672  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.206712  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.208460  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.232404  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.234246  1526 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:02:32.240052  7786 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.009s	sys 0.018s
I20260709 13:02:32.203729  7736 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.200451  7742 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:02:32.255800  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.248520  7605 tablet_copy_client.cc:538] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:32.200635  7735 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:32.202682  7850 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:02:32.241772  7834 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:32.277235  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:32.277216  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.269042  7786 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.009s	sys 0.018s
I20260709 13:02:32.252978  7534 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:02:32.284559  7517 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.344977  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67850.3us
I20260709 13:02:32.349857  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2900) took 1374 ms. Trace:
I20260709 13:02:32.350629  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3024) took 1364 ms. Trace:
I20260709 13:02:32.351155  1675 rpcz_store.cc:276] 0709 13:02:30.986369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.986483 (+   114us) service_pool.cc:224] Handling call
0709 13:02:30.986763 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.353353 (+366590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.350334 (+996981us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003575d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.350546 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819213056}
I20260709 13:02:32.277864  7736 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:32.350327  1527 rpcz_store.cc:276] 0709 13:02:30.974992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.975824 (+   832us) service_pool.cc:224] Handling call
0709 13:02:31.445328 (+469504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.445930 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.349543 (+903613us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54001abb50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:32.349769 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069890816}
I20260709 13:02:32.308784  7735 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:32.271986  7756 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:02:32.275511  7738 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:02:32.332727  7786 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:32.375350  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:32.371516  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 137985us
I20260709 13:02:32.383394  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:32.370129  7832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.017s	sys 0.038s
I20260709 13:02:32.348392  7840 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.336625  7739 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:02:32.374265  7735 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.370823  7841 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:32.354444  7706 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:32.395126  7553 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:32.397492  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3039) took 1419 ms. Trace:
I20260709 13:02:32.371372  7736 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.371004  7834 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:32.394470  7832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.017s	sys 0.039s
I20260709 13:02:32.391803  1573 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:32.388800  7805 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:32.416704  7805 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.418946  7805 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.396800  7534 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:32.420239  7534 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:32.397054  7794 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:32.421240  7534 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.424098  7534 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.426517  7651 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:32.434020  7794 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:32.434435  7794 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:32.434775  7794 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.435105  7555 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=3 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:32.435586  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.436252  1680 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:32.437016  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3028) took 1449 ms. Trace:
I20260709 13:02:32.437377  1682 rpcz_store.cc:276] 0709 13:02:30.987567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.987705 (+   138us) service_pool.cc:224] Handling call
0709 13:02:30.991910 (+  4205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.825210 (+833300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.436786 (+611576us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54003296d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.436959 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909960064}
I20260709 13:02:32.438786  1682 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:32.354790  7517 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:32.437315  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.440641  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:32.442032  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50301.8us
I20260709 13:02:32.440593  1600 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:32.442224  1680 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:32.442813  1573 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:32.451515  1600 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:32.452462  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.406468  1602 rpcz_store.cc:276] 0709 13:02:30.978584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.978777 (+   193us) service_pool.cc:224] Handling call
0709 13:02:30.979049 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.979261 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:32.140355 (+1161094us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b18004d5fc0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf
0709 13:02:32.140515 (+   160us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.397162 (+256647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.397214 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:32.397261 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.397324 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.397439 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19777,"prepare.queue_time_us":93621,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3398,"raft.queue_time_us":26132,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":26745,"spinlock_wait_cycles":9929088,"thread_start_us":417058,"threads_started":3,"wal-append.queue_time_us":213232}
I20260709 13:02:32.456053  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.405656  7841 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:32.407720  7706 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:32.460440  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.436170  7555 tablet_bootstrap.cc:492] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
W20260709 13:02:32.458770  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.414328  7756 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:32.459199  1602 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:32.459197  1675 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:32.465197  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.462941  1424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 334) took 5658 ms. Trace:
I20260709 13:02:32.476876  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.474234  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.451264  7805 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.483774  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.486405  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.476625  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:32.489853  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:32.492977  1679 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:32.492919  1602 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:32.494342  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.441857  7834 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.496920  1529 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:32.497233  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 224529us
I20260709 13:02:32.500928  7555 ts_tablet_manager.cc:1403] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 3.060s	user 0.081s	sys 0.023s
I20260709 13:02:32.502310  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.463375  7756 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:32.503836  1526 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.505496  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:32.506476  1530 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:32.508910  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:32.483448  7771 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:32.515137  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.484581  7476 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.513094  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.510335  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:32.525274  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.526248  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:32.526515  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:32.527076  1533 raft_consensus.cc:2410] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:32.526055  1528 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:32.527076  2254 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:32.504506  7809 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:32.471150  1424 rpcz_store.cc:276] 0709 13:02:26.800160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.800360 (+   200us) service_pool.cc:224] Handling call
0709 13:02:27.169345 (+368985us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9b090 00007f7e63b39f3a 00007f7e698f01cc 00007f7e699ee37e 00007f7e67eaf2a4 00007f7e67eaf232 00007f7e67eaf161 00007f7e67eaf0dc 00007f7e67eae392 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.458111 (+5288766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:29.991996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.033165 (+ 41169us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.033202 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:30.033219 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:30.033566 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.033653 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.033688 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:30.033879 (+   191us) tablet.cc:701] Row locks acquired
0709 13:02:30.033898 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:30.034044 (+   146us) write_op.cc:270] Start()
0709 13:02:30.034163 (+   119us) write_op.cc:276] Timestamp: P: 1783602150033998 usec, L: 0
0709 13:02:30.034183 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.034913 (+   730us) log.cc:844] Serialized 536 byte log entry
0709 13:02:30.675670 (+640757us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.076467 (+400797us) write_op.cc:301] APPLY: starting
0709 13:02:31.113757 (+ 37290us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.383907 (+270150us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.392437 (+  8530us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.393316 (+   879us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.393522 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:31.393565 (+    43us) write_op.cc:312] APPLY: finished
0709 13:02:31.393742 (+   177us) log.cc:844] Serialized 25 byte log entry
0709 13:02:31.393921 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.393995 (+    74us) write_op.cc:454] Released schema lock
0709 13:02:31.394034 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:31.394475 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.394502 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1466902,"reported_tablets":1,"spinlock_wait_cycles":495789952,"child_traces":[["op",{"apply.queue_time_us":371569,"apply.run_cpu_time_us":5466,"apply.run_wall_time_us":323254,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":183253,"prepare.run_cpu_time_us":9433,"prepare.run_wall_time_us":173675,"raft.queue_time_us":554969,"raft.run_cpu_time_us":83952,"raft.run_wall_time_us":328301,"replication_time_us":641332,"thread_start_us":498686,"threads_started":4,"wal-append.queue_time_us":248701}]]}
I20260709 13:02:32.535387  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.462767  7786 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.536526  2261 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:32.536860  1606 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:32.537362  2258 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:32.510376  7716 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:32.514185  7706 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:32.515848  7553 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:32.543617  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:32.545902  7873 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
W20260709 13:02:32.546123  7862 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:02:32.546677  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.537854  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.539341  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.556713  7834 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:32.558452  7756 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.559454  7824 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:32.560279  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1149) took 1023 ms. Trace:
I20260709 13:02:32.563130  7739 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:32.534279  7476 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.541330  7794 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.527930  7751 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.593099  1677 rpcz_store.cc:276] 0709 13:02:31.536634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.726462 (+189828us) service_pool.cc:224] Handling call
0709 13:02:31.726787 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.008550 (+281763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.559990 (+551440us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002242d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:32.560205 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643430144}
I20260709 13:02:32.530786  7771 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:32.582160  7716 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:32.617985  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 113027us
W20260709 13:02:32.606774  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 103402us
I20260709 13:02:32.683049  1603 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:02:32.690136  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.690896  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.602011  7706 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.514613  7841 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:32.693377  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:32.756147  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62853us
W20260709 13:02:32.682938  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53749.1us
I20260709 13:02:32.764048  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:32.609433  7614 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:32.608493  7742 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.160s
W20260709 13:02:32.788259  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 246867us
W20260709 13:02:32.910040  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.910672  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.911049  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.892693  7809 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:32.916850  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 145397us
W20260709 13:02:32.918654  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.923987  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.924925  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:32.927421  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:32.928174  1604 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:32.774371  7614 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:32.773746  7876 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:33.015542  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.293814  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:32.986618  7739 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:33.030360  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:33.079849  7716 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:33.270833  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1142) took 1865 ms. Trace:
I20260709 13:02:33.272801  1608 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:02:32.943289  7660 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:33.058928  7823 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.057276  7751 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.232880  7605 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
W20260709 13:02:33.239679  7735 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.829s	user 0.011s	sys 0.000s
W20260709 13:02:33.185392  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1360) took 1799 ms (client timeout 1990 ms). Trace:
I20260709 13:02:32.932524  7517 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:33.259923  7809 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.416108  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:33.439849  1526 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.932s	user 0.008s	sys 0.000s
I20260709 13:02:33.444633  1526 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:33.305704  1533 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:33.269769  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:33.252381  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:33.301373  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.307847  1608 pending_rounds.cc:85] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 8
W20260709 13:02:33.199981  1534 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.031s	sys 0.053s
W20260709 13:02:33.459496  1534 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.040s	sys 0.064s
I20260709 13:02:33.458968  1608 pending_rounds.cc:107] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 14.9
W20260709 13:02:33.307516  2260 rpcz_store.cc:269] 0709 13:02:31.386701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.386843 (+   142us) service_pool.cc:224] Handling call
0709 13:02:33.185155 (+1798312us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54004c4854. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:33.185319 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583168256}
I20260709 13:02:33.460680  1608 raft_consensus.cc:2889] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.944636  7883 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:33.370927  7751 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.304908  1676 rpcz_store.cc:276] 0709 13:02:31.410136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.493045 (+ 82909us) service_pool.cc:224] Handling call
0709 13:02:31.493411 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.983848 (+490437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.268653 (+1284805us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54003ab954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:33.270750 (+  2097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116337024}
I20260709 13:02:33.327095  7805 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:33.595592  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:33.251120  7750 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:33.458237  7864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.149s	sys 0.303s
W20260709 13:02:33.645481  7864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.154s	sys 0.306s
I20260709 13:02:33.511059  7583 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:33.646695  7897 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 13:02:33.646842  7583 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:33.653153  7882 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.403s	user 0.000s	sys 0.000s
W20260709 13:02:33.654415  7881 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.891s	user 0.000s	sys 0.001s
I20260709 13:02:33.306700  7891 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:33.680887  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.001s	sys 0.008s
W20260709 13:02:33.681469  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.001s	sys 0.008s
I20260709 13:02:33.684989  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:33.686368  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.004s	sys 0.005s
W20260709 13:02:33.686792  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.005s
I20260709 13:02:32.059917   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:33.302376  7876 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:33.516917  7880 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.461143  7793 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:33.733577  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:33.724151  1525 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:33.467073  7817 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:33.737689  2258 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:33.636174  7794 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:33.582841  7787 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:33.306383  7823 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.407934  7735 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.466612  7691 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.265s
I20260709 13:02:33.300266  7614 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.762270  7691 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:33.762496  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3100) took 1290 ms. Trace:
I20260709 13:02:33.762876  7691 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:33.763809  7614 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.763114  1527 rpcz_store.cc:276] 0709 13:02:32.472245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.474632 (+  2387us) service_pool.cc:224] Handling call
0709 13:02:32.491115 (+ 16483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.495688 (+  4573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.495753 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.504783 (+  9030us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.767636 (+262853us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:32.767681 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.767757 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.762144 (+994387us) raft_consensus.cc:1685] finished
0709 13:02:33.762175 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.762436 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4174,"raft.queue_time_us":4745,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8053,"thread_start_us":217778,"threads_started":1,"wal-append.queue_time_us":930562}
I20260709 13:02:33.769750  7555 raft_consensus.cc:359] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:33.770895  7555 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:02:33.772575  7691 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:33.773303  7691 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.773841  7691 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.776500  7691 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:33.636829  7805 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:33.795878  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.729568  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.004s	sys 0.018s
W20260709 13:02:33.799779  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.019s
I20260709 13:02:33.303706  7739 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.747685  7660 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:33.809170  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3029) took 2807 ms. Trace:
I20260709 13:02:33.671949  7750 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:33.809706  1681 rpcz_store.cc:276] 0709 13:02:30.988011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.988135 (+   124us) service_pool.cc:224] Handling call
0709 13:02:30.988440 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.905377 (+916937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.794821 (+1889444us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540024a4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:33.795038 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025232768}
I20260709 13:02:33.752763  7566 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:33.771652  7555 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:33.752425  7817 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.780251  7794 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:33.722281  7891 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.883900  7476 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:33.739032  7880 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.894945  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:33.899288  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:33.900089  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:33.913393  1608 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 9.
I20260709 13:02:33.801151  7771 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:33.747480  7793 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.751817  7540 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
W20260709 13:02:34.000562  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.025s	sys 0.029s
I20260709 13:02:33.779532  7787 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:34.005097  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.013s	sys 0.042s
I20260709 13:02:33.893627  7566 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:33.885655  7660 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:33.939410  7476 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:34.013049  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.013s	sys 0.042s
W20260709 13:02:34.009128  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.025s	sys 0.030s
I20260709 13:02:33.905122  7794 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.026422  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.032047  1608 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
W20260709 13:02:34.006625  7736 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.558s	user 0.013s	sys 0.000s
I20260709 13:02:34.005666  7883 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:34.037744  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.011538  7895 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.006974  7900 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.050488  1647 leader_election.cc:336] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.734s (SENT)
I20260709 13:02:34.057335  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3034) took 1622 ms. Trace:
I20260709 13:02:34.050671  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.052402  1678 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:34.052866  7905 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.053553  7899 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.053735  7894 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.045451  7540 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:34.021642  7901 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.057770  1683 rpcz_store.cc:276] 0709 13:02:32.434606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.440483 (+  5877us) service_pool.cc:224] Handling call
0709 13:02:32.440739 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.450096 (+  9357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.450132 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.450759 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.765566 (+314807us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:32.765611 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.765676 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.057103 (+1291427us) raft_consensus.cc:1685] finished
0709 13:02:34.057126 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.057270 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7906,"raft.queue_time_us":8053,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6812,"thread_start_us":277590,"threads_started":1,"wal-append.queue_time_us":1437692}
W20260709 13:02:34.065131  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.031574  7893 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.060128  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.053427  7904 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.120167  1647 connection.cc:256] RPC call timeout handler was delayed by -1.7696902220000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 13:02:34.121713  1527 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:02:34.125536  1647 connection.cc:256] RPC call timeout handler was delayed by -1.7617251610000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:02:34.063668  7506 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.055187  7786 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:34.045171  7691 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.055469  7883 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.121251  7864 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.036212  7476 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.063868  7906 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:34.122417  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.135848  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75813.9us
I20260709 13:02:34.067212  7583 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.129053  7876 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.046561  7736 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.128516  7893 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.117131  7894 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.168248  7891 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.168659  7736 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.119722  7751 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.167236  7876 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.146479  7903 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.121876  1526 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:34.128238  7890 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.169891  7566 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.135243  7904 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:34.171586  7870 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.660s	user 0.004s	sys 0.018s
I20260709 13:02:34.171859  7904 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.126636  7901 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:34.165153  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.169417  7876 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.146097  7506 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.088888  7899 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.154306  7691 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.060765  7895 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.075153  7905 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.165879  7864 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.146770  7540 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.063472  7900 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.163383  7898 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.168871  7893 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.160578  7771 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.173132  7904 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:02:34.199055  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1278) took 1666 ms. Trace:
I20260709 13:02:34.244292  1603 rpcz_store.cc:276] 0709 13:02:32.535896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.546400 (+ 10504us) service_pool.cc:224] Handling call
0709 13:02:34.198810 (+1652410us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b54003b88d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:34.198982 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223872256}
I20260709 13:02:34.163429  7735 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.149858  7786 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.249018  7786 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:34.169472  7903 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.252638  7903 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:34.253123  7910 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:34.172523  7907 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:34.178558  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.169046  7894 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.184641  7739 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.256732  7915 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.209060  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.189472  7805 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.183385  7583 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.257522  7915 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.258116  7583 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.259953  7915 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.223227  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3017) took 2294 ms. Trace:
W20260709 13:02:34.247730  7902 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:34.260455  7583 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.193246  7908 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.257416  7697 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:34.256863  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78400.3us
I20260709 13:02:34.222643  7750 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.192512  7891 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:02:34.264838  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 105118us
I20260709 13:02:34.172411  7906 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.271561  7735 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:34.169818  7890 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:34.275579  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.261799  7895 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.238688  7885 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.271044  1674 rpcz_store.cc:276] 0709 13:02:31.928429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.148750 (+220321us) service_pool.cc:224] Handling call
0709 13:02:32.149056 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.149282 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:32.341686 (+192404us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.222644 (+1880958us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800442240. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:02:34.222774 (+   130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.222836 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:34.222899 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.222979 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.223149 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16975,"prepare.queue_time_us":260887,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":90522,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6423,"spinlock_wait_cycles":4944640,"thread_start_us":439571,"threads_started":3,"wal-append.queue_time_us":222823,"wal-append.run_cpu_time_us":1234,"wal-append.run_wall_time_us":1017801}
I20260709 13:02:34.273355  7660 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.296411  1605 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:34.296465  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.285262  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:34.273326  1647 connection.cc:256] RPC call timeout handler was delayed by -1.5139641879999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:02:34.214848  7540 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.282990  7794 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.308470  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.309518  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:02:34.277300  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.283550  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.017s
I20260709 13:02:34.288465  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.288096  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:34.310547  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.018s
I20260709 13:02:34.289460  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.311554  1604 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:34.267993  7817 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.270526  7787 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:34.300462  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3780641879999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:02:34.297451  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:34.314919  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3267839290000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 13:02:34.276480  7771 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:34.315265  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1494839290000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:02:34.317165  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.321606  1607 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:34.290639  7614 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.240259  7898 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.265911  7907 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.283244  7908 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.372882  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1272) took 1915 ms. Trace:
I20260709 13:02:34.398159  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.323083  1608 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:34.539996  1601 rpcz_store.cc:276] 0709 13:02:32.457115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.457239 (+   124us) service_pool.cc:224] Handling call
0709 13:02:32.457523 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.526776 (+ 69253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.526809 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.526864 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:32.526904 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.372626 (+1845722us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54003c6754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:34.372677 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.372817 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158788352}
I20260709 13:02:34.289206  7735 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:34.365206  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58758.5us
I20260709 13:02:34.547856  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:34.544759  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 146711us
W20260709 13:02:34.423871  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 106005us
I20260709 13:02:34.316434  7660 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.308427  7697 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:34.553900  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 264637us
I20260709 13:02:34.294245  7476 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.484405  7650 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:34.507340  7506 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.366276  7911 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.680131  7911 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.553675  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:34.685425  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 131833us
I20260709 13:02:34.686465  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1370) took 2157 ms. Trace:
I20260709 13:02:34.686913  2257 rpcz_store.cc:276] 0709 13:02:32.528709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.528950 (+   241us) service_pool.cc:224] Handling call
0709 13:02:34.686216 (+2157266us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400959b28. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68ad5ebc 00007f7e68b0b08c 00007f7e68af593b 00007f7e68af53d2 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c
0709 13:02:34.686401 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041402624}
I20260709 13:02:34.434257  7809 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.687840  7809 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.689445  7922 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:34.690421  7809 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.447394  7756 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:34.511583  7706 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.746s	user 0.013s	sys 0.000s
I20260709 13:02:34.697036  1602 raft_consensus.cc:2410] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:34.687467  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:34.507901  7565 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.699661  7565 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.566967  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.702041  7565 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.702669  7706 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:34.702378  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 135499us
I20260709 13:02:34.705193  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.706548  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.703663  7891 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:34.708818  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 361) took 7246 ms. Trace:
I20260709 13:02:34.710171  7891 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.710729  7891 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.712781  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:34.713063  7850 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.712858  7891 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.550510  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:34.714682  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 164235us
I20260709 13:02:34.366456  7912 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.715587  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.508098  7924 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.686473  7911 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.716579  7924 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.449941  7880 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.435171  7876 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.716800  7932 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:34.723634  7932 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.717566  7583 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.725420  7583 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.723527  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.706843  7682 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:34.726029  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.366063  7913 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.726840  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:34.726972  7913 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.315552  7885 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.507579  7926 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:34.505657  7923 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.725803  7583 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.728811  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1484) took 1045 ms. Trace:
I20260709 13:02:34.719031  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.728008  7926 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.729770  7926 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:34.509750  7793 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.570108  7660 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.566882  7914 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.596478  7540 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.597220  7900 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.598073  7905 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.599224  7906 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.569519  7679 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:34.549409  7631 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:34.715785  7912 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.539158  7890 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.570914  7691 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.617334  7786 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.573046  7650 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:34.627246  7834 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.746116  7834 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.746410  7650 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.747437  7650 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:34.568168  7697 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.386754  7794 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.189s
I20260709 13:02:34.630059  7903 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.641752  7908 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.443866  7566 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.147s
I20260709 13:02:34.365772  7771 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.649463  7864 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.548616  7614 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.651583  7735 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:34.653146  7921 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.005s
I20260709 13:02:34.658845  7898 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.665347  7907 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.669795  7824 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:34.671075  7823 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.676715  7875 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:34.677587  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1652) took 3132 ms. Trace:
I20260709 13:02:34.687276  7886 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:34.703593  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.717213  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.726461  1608 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:34.727092  7476 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:34.775190  7898 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.728403  7923 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.775668  7898 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.777238  7923 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.549577  7812 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.373046  7899 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.730834  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.777771  7898 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.778225  1607 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:34.770489  7824 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:34.732201  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.692005  7922 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.779191  7824 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.779582  7922 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.780442  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:34.781183  7919 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.720252  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.780195  7824 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.781592  7922 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.783687  7786 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.729188  2260 rpcz_store.cc:276] 0709 13:02:33.683745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.683851 (+   106us) service_pool.cc:224] Handling call
0709 13:02:33.684116 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.004328 (+320212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.004364 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.004413 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:34.004450 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.728585 (+724135us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400515254. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:34.728628 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.728753 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735794560}
I20260709 13:02:34.732784  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:34.374370  7916 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.376966  7925 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:34.709249  1432 rpcz_store.cc:276] 0709 13:02:27.462718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.462889 (+   171us) service_pool.cc:224] Handling call
0709 13:02:34.708745 (+7245856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.533722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.644596 (+110874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.644645 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:02:30.644660 (+    15us) tablet.cc:662] Decoding operations
0709 13:02:30.645138 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.645187 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.645215 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:30.645551 (+   336us) tablet.cc:701] Row locks acquired
0709 13:02:30.645565 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:02:30.645722 (+   157us) write_op.cc:270] Start()
0709 13:02:30.645836 (+   114us) write_op.cc:276] Timestamp: P: 1783602150645667 usec, L: 0
0709 13:02:30.645858 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.646536 (+   678us) log.cc:844] Serialized 929 byte log entry
0709 13:02:30.843709 (+197173us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.326817 (+483108us) write_op.cc:301] APPLY: starting
0709 13:02:31.332818 (+  6001us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.533507 (+200689us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.533614 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.534971 (+  1357us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.535179 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:02:31.535234 (+    55us) write_op.cc:312] APPLY: finished
0709 13:02:31.535432 (+   198us) log.cc:844] Serialized 33 byte log entry
0709 13:02:31.535657 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.535787 (+   130us) write_op.cc:454] Released schema lock
0709 13:02:31.535831 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:31.573430 (+ 37599us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.576810 (+  3380us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2421165,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":426311,"apply.run_cpu_time_us":6204,"apply.run_wall_time_us":285069,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12507,"num_ops":2,"prepare.queue_time_us":7126,"prepare.run_cpu_time_us":3147,"prepare.run_wall_time_us":164105,"replication_time_us":197686,"thread_start_us":171452,"threads_started":1}]]}
I20260709 13:02:34.733867  7914 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.708938  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:34.738348  7932 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.380281  7901 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.738197  7924 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.743656  7912 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.743994  7555 ts_tablet_manager.cc:1434] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 2.230s	user 0.030s	sys 0.018s
I20260709 13:02:34.744341  1426 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.774050  7762 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.749369  2258 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:34.749344  2252 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:34.715816  7891 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.754431  7913 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.761354  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.785115  7916 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.787251  7756 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.769110  7771 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.769657  7614 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:34.770138  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.770412  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.764902  7691 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:34.771467  2255 rpcz_store.cc:276] 0709 13:02:31.545271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.545436 (+   165us) service_pool.cc:224] Handling call
0709 13:02:31.545758 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.559992 (+ 14234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.560024 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.565367 (+  5343us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.166195 (+600828us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b18004b07c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:02:32.271069 (+104874us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:32.332077 (+ 61008us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.668875 (+2336798us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b18004b07c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:02:34.675935 (+  7060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.677249 (+  1314us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.677320 (+    71us) raft_consensus.cc:1685] finished
0709 13:02:34.677332 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.677502 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3285,"prepare.queue_time_us":57118,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":54146,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":25688,"spinlock_wait_cycles":29869696,"thread_start_us":111533,"threads_started":2,"wal-append.queue_time_us":726153,"wal-append.run_cpu_time_us":2429,"wal-append.run_wall_time_us":1041145}
I20260709 13:02:34.774576  7834 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.781517  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:34.771430  1499 connection.cc:256] RPC call timeout handler was delayed by -1.1019924209999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:02:34.760284  7755 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:34.765165  7911 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:34.790444  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 76778.8us
W20260709 13:02:34.791950  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 83119.6us
I20260709 13:02:34.794456  1426 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 13 to 14, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.809726  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:34.745379  7660 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:34.796084  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.813608  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.796635  7932 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:34.793418  7918 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:34.781677  7919 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.751515  7697 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.800952  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.841876  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.801422  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:34.801528  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:34.765475  7809 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:34.788592  7735 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:34.788403  7898 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:34.805394  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 92702.2us
I20260709 13:02:34.789788  7875 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:34.807895  1499 connection.cc:256] RPC call timeout handler was delayed by -1.0033762559999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:02:34.811398  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:34.815678  7903 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:34.817430  7900 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:34.862761  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.818472  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3111) took 2319 ms. Trace:
I20260709 13:02:34.804183  7924 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.801981  7762 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.821856  7916 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:34.815218  7755 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:34.822552  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1132) took 3545 ms. Trace:
I20260709 13:02:34.823135  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:34.822149  7935 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:34.825109  7899 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.799352  7925 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.800405  7540 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.829320  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:34.894606  2261 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.829739  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.857820  7800 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.831717  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.832644  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.898589  2256 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:34.833243  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.833413  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:34.863229  7864 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:34.834265  7913 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:34.810227  1426 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 11, term changed from 16 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to <none>, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 17 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:34.868935  7924 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.919936  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.937479  1527 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:02:34.797071  7555 ts_tablet_manager.cc:1467] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 2291ms
I20260709 13:02:34.940161  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.845304  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.806733  7691 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:34.957137  1530 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:34.849725  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:34.860811  1499 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:34.848850  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47970.1us
I20260709 13:02:34.826812  7771 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:02:34.863289  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.827189  7932 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:34.960501  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 99761.1us
I20260709 13:02:34.863420  1534 rpcz_store.cc:276] 0709 13:02:32.498865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.499255 (+   390us) service_pool.cc:224] Handling call
0709 13:02:32.517209 (+ 17954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.587685 (+ 70476us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:33.459908 (+872223us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.181764 (+721856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.181867 (+   103us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:34.181918 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.818249 (+636331us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b540042c7d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:34.818293 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.818397 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1224983,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":255308,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":16112,"spinlock_wait_cycles":161340672,"thread_start_us":1579337,"threads_started":3,"wal-append.queue_time_us":693673}
W20260709 13:02:34.869859  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 58539.5us
I20260709 13:02:34.871078  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:34.875300  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.962210  1532 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:34.877281  7919 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.805974  7756 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.869172  7920 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:02:34.862094  7583 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:34.878779  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 308139us
I20260709 13:02:34.825902  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2920) took 1639 ms. Trace:
I20260709 13:02:34.873657  1678 rpcz_store.cc:276] 0709 13:02:31.277435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.277572 (+   137us) service_pool.cc:224] Handling call
0709 13:02:31.335937 (+ 58365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.059361 (+2723424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.822170 (+762809us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54003570d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:34.822483 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6246660480}
I20260709 13:02:34.902895  7864 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.829970  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:34.798695  7891 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.899981  2260 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:34.901283  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.899093  2259 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:34.985013  2256 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:34.834970  1526 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 9.
I20260709 13:02:34.862746  7900 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:34.871373  7903 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.868758  7850 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.996280  7850 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:34.998486  7850 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.980383  7762 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:34.937191  1426 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 15 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.893110  7899 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:34.842816  1605 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:34.871452  7706 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:34.962666  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:34.959177  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 109518us
W20260709 13:02:34.963521  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.522s (SENT) [suppressed 20 similar messages]
I20260709 13:02:34.963959  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:34.964211  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:34.964481  7843 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:34.965968  7933 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:02:34.959632  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:34.967350  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:34.972859  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:35.045490  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 85954.7us
I20260709 13:02:34.973663  1682 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:02:35.047827  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 80555.5us
I20260709 13:02:34.974457  1676 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:34.973603  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.048974  1679 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:34.978331  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.049235  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.050141  1532 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:34.895654  2253 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:34.982905  1525 rpcz_store.cc:276] 0709 13:02:33.186472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.186812 (+   340us) service_pool.cc:224] Handling call
0709 13:02:33.200674 (+ 13862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.734754 (+534080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.825689 (+1090935us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54000b5ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:34.825849 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197773056}
I20260709 13:02:34.984599  2254 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.985916  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.052981  1683 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:35.053732  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:34.901068  7736 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:34.987370  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:34.968149  7924 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.966832  7932 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:34.990832  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:34.991046  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.089447  1678 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:35.089864  1683 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:34.964197  7936 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.903237  7800 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.089077  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:35.047835  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.063542  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:34.899212  7540 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.089830  2259 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.090307  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.097527  1677 raft_consensus.cc:2410] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:34.968806  7682 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:35.054467  1534 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:35.094395  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:34.988893  7864 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.103353  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.111109  1679 raft_consensus.cc:2410] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 13:02:35.105955  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51343.3us
I20260709 13:02:35.107430  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:35.045100  7899 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.986622  7891 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:35.112710  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 64811.2us
I20260709 13:02:35.115589  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:35.055871  7794 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:35.120005  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:35.124800  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:34.992044  7914 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.056427  7903 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:35.128832  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:35.131860  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.124982  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.095278  7936 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:35.133832  1676 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:35.097693  7876 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:35.137149  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.137862  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.056107  7906 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:02:35.138967  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.138513  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.140401  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.138587  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.055670  7706 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.147584  1601 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:35.145231  1605 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:35.119278  7823 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:35.058786  7631 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:02:35.148995  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.146888  1609 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:35.150708  1676 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:35.123451  7565 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.142076  1607 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:35.088563  7736 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.141736  7876 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.156729  7565 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.134189  7517 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.161043  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.165879  1676 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:35.147790  7762 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:35.139725  7903 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:35.119122  7919 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:35.145037  7651 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:35.141942  7936 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.151387  7850 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.120985  7682 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.000953  7900 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.153594  7834 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.185920  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.059149  7691 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.157089  7823 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:35.203943  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.168915  7517 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.164201  7876 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.163460  7565 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.206657  1682 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:02:35.206269  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 81556.9us
I20260709 13:02:35.211795  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.180652  7651 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:35.213234  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.184595  7843 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:35.183250  7903 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.185392  7850 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:35.217092  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.219808  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.223465  1679 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:35.187295  7762 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:35.215992  7843 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.207597  7823 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:35.207854  7517 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.214735  7900 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:35.229023  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90877.7us
I20260709 13:02:35.231436  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.231952  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.207509  7751 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:35.233052  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.191228  7794 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:02:35.182318  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 135400us
W20260709 13:02:34.940434  7555 ts_tablet_manager.cc:1469] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:02:24.598191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.634233 (+ 36042us) service_pool.cc:224] Handling call
0709 13:02:25.121320 (+487087us) ts_tablet_manager.cc:934] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:02:26.365580 (+1244260us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:26.939035 (+573455us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:26.966052 (+ 27017us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:27.219822 (+253770us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:27.220175 (+   353us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:27.297022 (+ 76847us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:27.319216 (+ 22194us) inbound_call.cc:177] Queueing success response
0709 13:02:29.440416 (+2121200us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:02:32.514082 (+3073666us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:02:32.590330 (+ 76248us) tablet_replica.cc:261] Starting instrumentation
0709 13:02:32.988208 (+397878us) tablet_replica.cc:280] Starting consensus
0709 13:02:34.722880 (+1734672us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18003b9ce0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b26d71 00007f7e67523b2e
Metrics: {"dns_us":42260,"mutex_wait_us":49220,"raft.queue_time_us":230690,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":24491,"spinlock_wait_cycles":8641280,"tablet-copy.queue_time_us":392534,"tablet-download-pool.queue_time_us":216,"tablet-download-pool.run_cpu_time_us":1860,"tablet-download-pool.run_wall_time_us":1579964,"thread_start_us":665602,"threads_started":3}
I20260709 13:02:35.242565  7751 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.239285  7651 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.245272  2260 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:35.245461  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.248379  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:35.248943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.225241  7691 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.225018  7850 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.250425  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.250504  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.206000  7834 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.220275  7755 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.252748  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.233232  7843 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.266410  1676 raft_consensus.cc:2393] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:35.266443  2259 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:35.269840  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.270534  2259 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:35.268950  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.256292  2261 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.272038  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:35.272552  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.252950  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.272990  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.273676  2259 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:35.273801  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:35.274175  2259 pending_rounds.cc:85] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 13
I20260709 13:02:35.275296  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.234315  7824 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:35.275853  2259 pending_rounds.cc:107] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:35.277069  2259 raft_consensus.cc:2889] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.279055  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:35.279892  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.253516  7583 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.282233  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.281150  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:35.289729  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.288816  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.290522  2254 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.272948  7756 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.274917  7651 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.294996  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:35.296288  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.297459  7834 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.281028  7800 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.297834  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.298527  1679 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:35.299410  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.299561  7925 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.299980  1679 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:35.301753  1679 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:35.305260  7901 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.296567  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.305711  1601 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:02:35.320397  1601 pending_rounds.cc:85] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 10
I20260709 13:02:35.320513  1678 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:35.321504  7751 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.282948  7885 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.282243  7824 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.282366  7911 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:35.306124  7942 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:02:35.306780  7939 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:02:35.330561  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.306349  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.307060  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.307761  7736 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.331952  1603 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.330617  7682 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.329375  7911 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.338225  7911 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.338836  1601 pending_rounds.cc:107] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:02:35.339143  1601 raft_consensus.cc:2889] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.343490  7843 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:35.345920  7918 consensus_meta.cc:287] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:02:35.347483  7936 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:35.349239  7650 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.004s
W20260709 13:02:35.352866  7937 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:02:35.284017  7946 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 13:02:35.276722  7566 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:35.356922  2261 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:02:35.361212  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1482) took 2816 ms (client timeout 1841 ms). Trace:
W20260709 13:02:35.431676  2252 rpcz_store.cc:269] 0709 13:02:32.539771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.543292 (+  3521us) service_pool.cc:224] Handling call
0709 13:02:35.355957 (+2812665us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54007378d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:35.356084 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4987168640}
I20260709 13:02:35.357654  7679 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:35.362883  7800 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:35.365211  7841 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:35.366297  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.367888  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.371009  7565 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.373730  7899 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.443493  7891 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.448450  1680 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:35.364149  1603 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:35.451766  7891 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.355120  7762 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.464694  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1277) took 2941 ms. Trace:
I20260709 13:02:35.465274  1600 rpcz_store.cc:276] 0709 13:02:32.523420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.523569 (+   149us) service_pool.cc:224] Handling call
0709 13:02:32.523960 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.524386 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.524418 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.714221 (+2189803us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b180043d020. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a
0709 13:02:34.820887 (+106666us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b2c00001158. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:02:34.821463 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.899526 (+ 78063us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:34.899563 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.899648 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.464298 (+564650us) raft_consensus.cc:1685] finished
0709 13:02:35.464346 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.464558 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3089,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":17998,"spinlock_wait_cycles":22589056,"thread_start_us":77704,"threads_started":1,"wal-append.queue_time_us":288183}
I20260709 13:02:35.485633  7875 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.493053  7540 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.498631  2253 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:35.502163  7824 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:35.398962  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3382) took 2189 ms (client timeout 1788 ms). Trace:
I20260709 13:02:35.408888  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.410826  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:35.509022  1602 rpcz_store.cc:269] 0709 13:02:33.187590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.187727 (+   137us) service_pool.cc:224] Handling call
0709 13:02:35.376913 (+2189186us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001bc6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:35.377056 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3206516096}
I20260709 13:02:35.419507  2259 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:35.421521  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.376996  7706 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.428470  2257 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:35.405042  7901 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:35.433403  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.436223  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.517169  2260 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:35.406328  7918 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:35.439821  1683 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:35.444414  7565 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.445204  7899 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.445785  7936 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.436936  7566 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:35.374333  7926 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
W20260709 13:02:35.395175  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 431632us
I20260709 13:02:35.511051  1675 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:35.513590  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.434595  7679 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:35.412757  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:35.475929  7864 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:35.532184  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 251106us
W20260709 13:02:35.537335  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.575002  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.468096  7517 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:35.523510  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 228585us
I20260709 13:02:35.535895  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:35.572822  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.581933  1526 raft_consensus.cc:2410] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:02:35.575796  1533 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:35.577204  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.584532  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 48715us
W20260709 13:02:35.590188  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 177498us
I20260709 13:02:35.591079  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:35.593758  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 478188us
I20260709 13:02:35.533351  7843 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:35.567409  7735 consensus_meta.cc:287] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.004s
I20260709 13:02:35.596865  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.597667  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:35.598098  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.598552  1533 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:35.619493  1534 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:35.600687  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:35.603839  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.608404  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.618712  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.620404  1601 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:35.621246  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.622012  1601 raft_consensus.cc:2410] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:35.609721  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.611083  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.623696  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:35.589669  7697 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.006s
I20260709 13:02:35.612360  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.628948  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.614876  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.609390  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.649775  1607 raft_consensus.cc:2410] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:35.587893  7786 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:35.651391  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.557374  7809 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:35.617820  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:35.584218  7605 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:35.599916  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.585848  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.666630  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.667330  1607 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:35.625308  1525 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:35.576725  7936 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.626632  1609 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:35.626636  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:35.649269  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.669735  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.671176  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.671878  2252 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:35.670262  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.672766  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.673527  1609 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.673591  2252 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:35.673951  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.632740  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.629977  1528 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:35.653146  1605 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:35.622139  7901 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:35.677479  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.675277  1604 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:35.670212  1530 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.679594  1674 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:02:35.670358  1532 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:35.622288  7583 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:35.597512  7614 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.657965  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.615279  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:35.649224  1543 tablet_copy_service.cc:342] P b8ff9782cd95483c905cd1d906f41aaf: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2832a231368f4f5dbf9972f28f64f60e received from {username='slave'} at 127.0.0.1:56406
W20260709 13:02:35.689941  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63395.8us
I20260709 13:02:35.651284  7875 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:35.690088  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74891.6us
I20260709 13:02:35.691322  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:35.621556  7949 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:35.694620  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.629091  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.695380  2260 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:35.695683  1602 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:35.698326  1543 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2832a231368f4f5dbf9972f28f64f60e on tablet 2832a231368f4f5dbf9972f28f64f60e with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:35.698688  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:35.694366  7924 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:02:35.701642  7924 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.703833  7924 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.705119  7864 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.702925  7850 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.662190  7809 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:35.594878  7540 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:02:35.684192  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:35.684185  7812 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.906s	user 0.007s	sys 0.004s
I20260709 13:02:35.685609  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.687287  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.688373  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.688930  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.594635  7909 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:02:35.538025  7926 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.668828  2261 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:35.693005  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.728281  1532 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:35.693356  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.729394  1604 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:35.688894  7771 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:35.594779  7716 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:35.682444  7908 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:35.695467  2258 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:35.709182  1528 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.679764  1527 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
W20260709 13:02:35.711849  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 126078us
I20260709 13:02:35.737908  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.714025  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:35.622640  7946 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:35.714876  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.698539  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:35.720599  2253 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:35.679953  7817 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:35.723495  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.660560  7762 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:35.651151  7697 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.693005  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.691458  7901 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.731071  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.731931  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.692937  7735 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:35.734306  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.755537  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.739352  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:35.738596  2257 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:35.741799  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.757090  1674 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.720986  7809 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:35.745565  7932 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.008s
I20260709 13:02:35.742908  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:35.733219  7771 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:35.748623  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 139323us
I20260709 13:02:35.670574  7679 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.750540  7817 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.724095  7951 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.728547  7812 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:35.759647  7876 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:02:35.770536  1530 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:35.754055  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:35.754643  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 56172.4us
I20260709 13:02:35.720705  7948 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.691488  7614 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.739413  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.755837  1533 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.795985  1681 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:35.796756  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.745177  7751 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:35.681954  7936 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.762283  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.744323  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:35.713673  7949 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.764053  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.752738  1608 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:35.768924  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.802865  2255 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:35.803990  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.773491  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.765195  7771 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:35.775524  7956 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:35.776376  7901 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.777643  7953 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:35.777998  7697 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.778918  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:35.834275  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55433.8us
I20260709 13:02:35.835749  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:35.781002  7876 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.836611  7899 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:35.837134  7899 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.837478  7899 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:35.838079  7876 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.782400  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.839629  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.840718  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.841488  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.842638  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:35.785841  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.843662  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.844691  1601 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:35.787132  7888 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.788619  7679 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:35.800844  7912 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:35.789710  7517 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:35.852460  7888 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:35.789278  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.758523  7908 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:35.856813  1531 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:35.857255  7908 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.857770  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.758692  7824 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:35.772611  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:35.794368  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:35.797528  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.861060  1602 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:35.861032  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 88489.8us
W20260709 13:02:35.790452  7903 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.005s
I20260709 13:02:35.799124  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.799201  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:35.799316  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 86878.8us
I20260709 13:02:35.863857  1573 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:35.750296  7946 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.773823  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.798337  7751 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:35.866091  7903 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:35.806238  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.808691  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.768790  7951 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.811754  7614 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.812232  7566 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:35.810762  7936 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.813302  7850 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:35.795225  7900 consensus_queue.cc:1175] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 19 status { last_received { term: 18 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:35.792207  7948 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:35.817830  7949 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:35.796556  7957 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:02:35.829492  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65511us
I20260709 13:02:35.833380  7812 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:35.785851  7926 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:35.841619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.844158  1605 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.845779  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:35.846927  2227 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:35.764688  7932 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:35.774125  7817 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:35.853223  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:35.854336  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:35.829516  7755 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.832481  7953 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.858812  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.859236  1606 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:35.863467  1525 raft_consensus.cc:2376] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17. Re-sending same reply.
I20260709 13:02:35.865796  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:35.868909  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:35.843812  7809 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:35.937527  2260 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEARNER]: Advancing to term 19
I20260709 13:02:35.852715  7651 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.074170  7651 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.074641  7651 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.894974  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:35.896020  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:35.860543  7824 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:35.868623  7876 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.077322  7876 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.077775  7876 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.079945  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.080714  7909 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.081065  7909 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:36.081441  7909 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:36.081207  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 235474us
I20260709 13:02:36.083765  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.084514  1675 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:36.084681  2261 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.085326  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.075847  7953 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:36.081471  7716 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.089417  7909 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.091960  7909 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.076500  2256 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:35.870780  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3403) took 1069 ms. Trace:
I20260709 13:02:35.871421  1600 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:35.876556  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.072978  7812 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.071799  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 208007us
W20260709 13:02:36.095566  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.894369  1534 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:02:36.096297  7951 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.095638  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:36.098071  7824 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:36.073521  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.098949  7792 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:36.099076  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 252230us
I20260709 13:02:36.100103  7792 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:36.101343  7756 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.101696  7756 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:36.102063  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:36.095311  7812 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.095930  1530 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:36.103829  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.105042  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.102567  7756 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.105969  7756 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.075563  7948 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:35.940881  7966 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:02:36.076238  7755 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.096781  1608 rpcz_store.cc:276] 0709 13:02:34.801038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.801193 (+   155us) service_pool.cc:224] Handling call
0709 13:02:35.870542 (+1069349us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54004376d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:35.870713 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085758336}
I20260709 13:02:36.098457  2254 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 13: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:36.112319  1532 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:35.895872  7823 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.000s
I20260709 13:02:36.088207  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.117714  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:36.071079  7959 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:02:36.115082  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.118399  1608 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.119138  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:36.119508  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:36.121893  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:36.113981  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 219086us
I20260709 13:02:36.097749  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:35.877012  7841 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:36.157133  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:36.143378  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:36.128619  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:36.159598  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.159801  2256 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:36.127395  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:35.877810  7751 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.111804  7755 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.132957  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:36.160352  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.162945  2261 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:36.164075  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:36.169627  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.172154  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.122743  7926 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:36.149952  7566 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:36.173682  7961 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:02:36.175665  7886 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:36.175976  7961 consensus_queue.cc:1243] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:02:36.176744  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 293709us
I20260709 13:02:36.164059  1602 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:36.113976  7792 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.160792  7903 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.167542  7841 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:36.124047  7823 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.171680  7885 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:36.153229  7909 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:02:36.174316  7962 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.177743  7566 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.176565  7735 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.182000  7891 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:36.182579  7946 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.185341  7926 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:36.175239  7953 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.199878  7962 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:36.211395  7932 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.213374  7823 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.214105  7809 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.203075  7891 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.213541  7824 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.214694  7875 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:36.126864  1525 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:36.178642  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.316108  7891 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.325115  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.324976  7899 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.326392  1609 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.222901  7926 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.333323  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.334988  7864 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:36.335707  7864 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.337145  7864 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.341297  7787 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:36.341930  7787 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:36.344635  7875 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:36.278543  1533 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:36.281718  7566 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:36.281785  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 157498us
W20260709 13:02:36.293462  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 115436us
I20260709 13:02:36.294106  7824 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.294912  7841 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.188562  7583 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.201534  7951 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.224184  7953 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.209313  7962 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:36.287851  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.733s (SENT)
I20260709 13:02:36.377911  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.379263  7951 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.379925  1602 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:36.385116  1605 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.385730  7909 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:36.374287  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.369737  7899 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.387382  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.387948  7953 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.389856  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3059) took 1101 ms. Trace:
I20260709 13:02:36.390415  1676 rpcz_store.cc:276] 0709 13:02:35.287851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.288082 (+   231us) service_pool.cc:224] Handling call
0709 13:02:35.291860 (+  3778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.570907 (+279047us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:35.681262 (+110355us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.764662 (+ 83400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.764733 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:35.764790 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.389308 (+624518us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540032a5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:36.389368 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.389624 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13491,"prepare.queue_time_us":134262,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":13610,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8501,"spinlock_wait_cycles":673808128,"thread_start_us":139522,"threads_started":2,"wal-append.queue_time_us":94081}
W20260709 13:02:36.379230  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 91633.5us
I20260709 13:02:36.390013  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.368415  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.373978  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.376959  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.343854  7787 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.376955  7583 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.372959  7605 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.397271  7909 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:36.388131  1605 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.416249  1674 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:36.424858  7787 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.416776  1529 raft_consensus.cc:2368] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:36.417212  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.429673  7953 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.430510  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:36.431037  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49616.8us
I20260709 13:02:36.431716  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.431893  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.433205  7946 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:36.434340  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.435173  7843 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:36.452869  7843 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:36.454228  7843 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.455969  7843 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.436630  7823 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.434916  7946 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.442668  7651 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.456799  7823 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.458850  7823 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.458896  7651 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.459992  2255 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:36.460726  7909 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:36.461274  7909 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.350288  7875 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.462373  7875 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:36.465335  7946 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.462391  7909 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.467799  7909 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.469437  7886 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.446166  7876 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.470304  7886 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.471028  7912 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.471489  7912 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:36.472090  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 95299.1us
I20260709 13:02:36.472437  7876 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.473462  7651 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.473853  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.476564  7949 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:36.477299  7949 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.478726  7817 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.479759  7949 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.476444  7651 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.446736  7953 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.414124  7583 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.450316  7948 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.483204  7948 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.483999  7888 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.484381  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3023) took 1521 ms. Trace:
I20260709 13:02:36.484763  1607 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:36.485141  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.476118  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.491576  1609 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:36.457263  7605 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
W20260709 13:02:36.494256  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70052.2us
I20260709 13:02:36.493520  1602 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:36.496624  1605 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:36.491482  1681 rpcz_store.cc:276] 0709 13:02:34.962885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.963758 (+   873us) service_pool.cc:224] Handling call
0709 13:02:34.964026 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.796478 (+832452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.483908 (+687430us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:36.484207 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912458496}
W20260709 13:02:36.505930  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 71764.3us
I20260709 13:02:36.508462  7953 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.533748  1649 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.537475  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.468245  7751 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:36.547523  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.547688  7771 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.008s
I20260709 13:02:36.548134  7771 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.549118  7751 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.550483  7771 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:36.551566  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75573.4us
I20260709 13:02:36.540678  7875 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.552564  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.553397  7817 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.554281  7817 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.555274  1601 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:36.559796  1674 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:36.507687  7566 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:36.569775  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73747.5us
I20260709 13:02:36.570394  1609 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:36.554281  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.572444  7771 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:36.575508  7883 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:36.580919  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.541779  7953 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.546670  7886 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.593621  1601 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:36.583788  7953 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.600989  7809 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.601222  7961 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.602124  7961 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.608032  7809 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.608253  1608 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:36.609285  7875 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.610694  7605 ts_tablet_manager.cc:1403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 3.530s	user 0.054s	sys 0.026s
I20260709 13:02:36.601158  1675 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.613358  1605 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:02:36.626101  7976 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.277s	user 0.005s	sys 0.005s
W20260709 13:02:36.626801  7963 log.cc:927] Time spent T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.112s	user 0.006s	sys 0.003s
I20260709 13:02:36.602304  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:36.619253  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 187845us
I20260709 13:02:36.611423  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1284) took 1015 ms. Trace:
I20260709 13:02:36.615792  7886 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:02:36.612092  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3384) took 3202 ms (client timeout 1817 ms). Trace:
I20260709 13:02:36.594900  7771 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.633507  1602 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:36.637401  1676 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.639587  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.601033  7716 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.651137  7716 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.652992  7771 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.653501  7716 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.654250  1607 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:36.655496  7679 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.014s
I20260709 13:02:36.656378  1603 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:36.658783  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1285) took 1062 ms. Trace:
I20260709 13:02:36.611114  7809 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.659946  7809 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:36.634039  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.635931  7883 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.661180  7885 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:36.662052  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.662583  7883 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:36.663059  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43911.8us
I20260709 13:02:36.663204  7883 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.641865  7886 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:36.635073  1606 rpcz_store.cc:269] 0709 13:02:33.409727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.415636 (+  5909us) service_pool.cc:224] Handling call
0709 13:02:36.611653 (+3196017us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54003c4e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:36.611859 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5616156544}
I20260709 13:02:36.647157  7961 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:36.633404  1600 rpcz_store.cc:276] 0709 13:02:35.595587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.595720 (+   133us) service_pool.cc:224] Handling call
0709 13:02:35.870959 (+275239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.115502 (+244543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.610960 (+495458us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54004376d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:36.611167 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632065408}
I20260709 13:02:36.649909  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.659140  1603 rpcz_store.cc:276] 0709 13:02:35.596472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.596596 (+   124us) service_pool.cc:224] Handling call
0709 13:02:36.658542 (+1061946us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400026f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:36.658695 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386061696}
I20260709 13:02:36.664765  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.611939  7566 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.676343  7605 raft_consensus.cc:359] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:36.662949  1601 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:36.677493  7605 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:02:36.677969  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.678733  1608 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:36.678438  7605 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:36.679828  1608 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.680023  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.683034  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.683612  1601 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:36.672013  1600 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.660110  7903 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:36.667304  7886 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.684798  7903 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.685719  7886 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.685997  7903 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:36.687244  7886 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.673162  1606 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:02:36.689706  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.690374  1674 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:02:36.690832  1683 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:36.691521  1678 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:36.693540  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.693862  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.694344  1609 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:36.695087  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.695813  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.696591  1677 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:36.695849  1683 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:36.697343  1678 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.695096  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.697904  7850 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:36.696662  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 142530us
I20260709 13:02:36.699123  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:36.673202  1602 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:36.701954  7850 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.684383  7812 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:36.702180  7980 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:36.702761  7735 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:36.702970  1680 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.703243  7735 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.703727  7735 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:36.703940  7812 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.704797  7850 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.704598  7962 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.706734  7962 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.709271  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:36.710739  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.712232  7908 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.712630  7908 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:36.713006  7908 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.713714  7735 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.716171  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:36.717660  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 80889.7us
I20260709 13:02:36.718984  7936 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:36.719421  7583 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.593884  7912 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.720095  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.724742  7787 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:36.725136  7787 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:36.725167  7936 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.724028  7812 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.726708  7787 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.733803  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:36.734141  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.729980  7912 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.724673  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:36.735726  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.735862  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.728199  7787 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.737947  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:36.739611  7885 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:36.741158  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.741405  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:36.742492  7540 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.742944  7962 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:36.743623  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:36.743839  7962 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.744225  7972 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.742906  7540 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.745105  7540 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:36.745203  7973 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.004s
W20260709 13:02:36.745697  7973 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.004s	sys 0.004s
I20260709 13:02:36.746026  1682 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:36.740090  7885 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:36.744706  7925 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:36.747213  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62893.6us
W20260709 13:02:36.745344  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 220849us
W20260709 13:02:36.673295  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 512882us
I20260709 13:02:36.744740  7972 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:36.761480  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.751055  7925 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.754403  7936 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:36.768537  1680 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.768857  1676 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:36.770287  7679 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:36.771256  7679 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:36.773280  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.773917  1679 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.774076  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:36.775589  7926 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:36.775926  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.775621  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.780714  7926 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:36.781240  7926 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:36.781718  7912 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.782171  7912 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.764011  7972 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.784572  1678 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.788527  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:36.788681  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:36.789456  1683 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.792973  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:36.793147  2259 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 11
I20260709 13:02:36.769006  7925 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.793129  2261 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:36.797453  1674 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:36.797757  7841 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.797513  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.784925  7912 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.803515  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.804891  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:36.806195  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:36.806749  7936 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.807147  7614 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:36.793988  2259 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:02:36.808388  2259 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.807821  7614 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:36.809733  7614 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.793843  2258 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.744953  7962 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.807402  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:36.783242  7583 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.827636  7975 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.808092  7885 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.823163  7936 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:36.829507  7885 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.829885  1675 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.831328  7908 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.832392  1683 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:36.833292  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.834182  1675 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:36.829726  7936 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.823936  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:36.847419  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.784264  7735 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.852921  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.776976  7953 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.865756  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:36.782339  7926 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.783910  7679 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.872606  1648 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.875872  1674 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:36.877099  7908 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:36.852531  7885 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.879349  7885 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.880618  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.881250  7885 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.839756  7841 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.862638  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:36.872694  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 69320.5us
I20260709 13:02:36.896984  1608 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:36.888487  1680 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:36.885861  1681 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:36.894757  7926 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.897702  2253 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:36.899986  1609 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:36.901432  1682 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:36.885671  7605 ts_tablet_manager.cc:1434] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.258s	user 0.009s	sys 0.002s
I20260709 13:02:36.854941  7614 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:36.909122  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58089us
I20260709 13:02:36.911010  7843 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.905361  7583 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.918720  1532 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:36.918385  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.918164  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.916472  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:36.932526  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.928843  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:36.935912  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.938651  1679 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:36.916808  7614 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:36.923497  7843 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:36.942454  7843 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.942880  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1504) took 1151 ms. Trace:
I20260709 13:02:36.943097  7583 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.944516  7735 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.947249  7925 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.948418  7841 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:36.949025  7841 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:36.949648  7925 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.950575  7755 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.950012  7841 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.951026  7755 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:36.951478  7755 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.905671  7771 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:36.952430  7614 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.952989  2252 rpcz_store.cc:276] 0709 13:02:35.773781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.776473 (+  2692us) service_pool.cc:224] Handling call
0709 13:02:35.776813 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:35.777207 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.777234 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:35.836268 (+ 59034us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b48000cc0d8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:02:36.627016 (+790748us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:02:36.627952 (+   936us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.761365 (+133413us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:36.761398 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.778007 (+ 16609us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.920475 (+142468us) raft_consensus.cc:1685] finished
0709 13:02:36.920502 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.925254 (+  4752us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":374,"raft.run_cpu_time_us":2148,"raft.run_wall_time_us":58898,"spinlock_wait_cycles":75964928,"thread_start_us":124107,"threads_started":1,"wal-append.queue_time_us":228101}
I20260709 13:02:36.957525  7953 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:36.958882  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.959309  7787 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:36.959699  1680 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:36.964512  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46465us
W20260709 13:02:36.965342  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50081.6us
I20260709 13:02:36.966017  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:36.967233  1679 raft_consensus.cc:2410] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
W20260709 13:02:36.968617  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.968336  2258 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:36.972719  7751 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:02:36.983232  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:36.984158  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65874.1us
I20260709 13:02:36.986032  7912 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:36.988622  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.980767  7948 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:02:36.970600  7946 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:36.989846  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:36.990790  7972 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:36.991673  7953 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.992082  7953 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:36.992511  7953 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.934610  7850 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:36.989310  7946 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.045099  7998 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.048739  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:37.049675  2252 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:37.050179  7972 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:37.051267  1682 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.055249  7614 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.072526  7912 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.078231  7850 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.080704  1680 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.970774  7949 consensus_queue.cc:1059] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:02:37.081043  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:37.101223  1674 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.081780  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:37.092700  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.093909  7540 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.094372  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:37.097750  7903 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:37.080763  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:37.004130  7787 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:02:37.099284  7946 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:37.083029  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.106118  1678 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:37.107012  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:37.107822  7762 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:37.113858  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 153464us
I20260709 13:02:37.117697  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.116926  1675 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:37.122893  1608 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.124228  2258 raft_consensus.cc:2410] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:02:37.139343  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 156275us
I20260709 13:02:37.147063  1605 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:37.122834  7762 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.139376  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:37.115983  7735 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:37.139451  7993 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:02:37.119513  7843 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.137624  7948 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:37.146230  7887 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:37.163134  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:37.159642  7787 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:02:37.162497  7948 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.161911  7887 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.165210  7946 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.147564  7936 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.157137  7812 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:02:37.158481  7908 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:02:37.182149  7787 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:37.181612  7762 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.184742  7998 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:37.185990  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:37.188369  7771 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:37.200273  1605 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:37.164721  7735 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.202011  7998 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:37.209149  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52611.2us
W20260709 13:02:37.209667  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77101.7us
I20260709 13:02:37.189455  7972 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.189810  7887 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:37.213613  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66972.8us
W20260709 13:02:37.216799  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.208292  7614 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.184581  7996 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:02:37.200985  7787 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:37.224794  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.222848  7995 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:37.227299  7540 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.221040  7885 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.229043  7843 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.229480  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.238555  1681 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:37.208843  7771 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.214521  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:37.219331  7949 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:37.249065  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:37.239682  7850 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:37.224680  7975 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:37.242936  7540 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:37.272557  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 58109.5us
I20260709 13:02:37.273254  7850 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.280768  7762 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.248811  7949 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:37.281617  7972 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:37.282168  7755 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.282637  8006 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:37.283464  7975 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.255594  7885 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.287235  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:37.252643  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:37.232741  7909 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:37.308382  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.295226  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:37.295615  7843 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:37.297603  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.300951  2260 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.297839  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.303306  1606 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:37.305902  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:37.306142  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.249127  7812 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:02:37.297857  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.305356  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:37.293998  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78270us
I20260709 13:02:37.301604  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:37.312075  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58345.8us
W20260709 13:02:37.313359  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69120.7us
I20260709 13:02:37.314769  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.314996  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.315555  7614 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.317857  7912 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:37.336573  7912 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.337137  1529 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:37.337304  7735 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:37.337935  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50788.5us
I20260709 13:02:37.319393  8006 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:37.338768  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:37.318967  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.336565  1531 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:37.299860  7949 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.295892  7864 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:37.344499  7864 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.320066  7843 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.353242  2258 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:37.330935  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:37.331307  1604 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:37.331580  1605 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 9: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:37.332756  2252 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.333107  7975 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.335579  7925 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:37.369311  7735 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:37.294824  7996 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:02:37.369910  7735 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.370549  7735 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:37.372496  2260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01534d11942740ccb67a981fcde65180"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:02:37.318636  7999 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.340341  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.336220  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:37.336604  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.323064  1607 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:37.328325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.322542  7936 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.395989  1603 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.357841  7953 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:37.396596  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65758.3us
I20260709 13:02:37.359349  7887 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.318658  7771 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.360392  1606 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:37.361558  7850 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.320513  7972 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.305703  7679 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:02:37.364511  7787 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.368882  7843 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.339344  8006 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.337584  7912 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.376037  7996 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:37.369894  7925 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.378768  7735 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:37.381281  8009 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:37.353156  2255 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.382508  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.385185  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:37.441891  1603 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:37.385440  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:37.442996  1605 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:37.355710  7614 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:02:37.387171  7755 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.387413  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.388387  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.388942  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.352787  7864 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:37.392347  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 58370.5us
I20260709 13:02:37.394604  2252 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:37.399420  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.400183  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.400631  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.401676  8012 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:37.397581  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79491.9us
I20260709 13:02:37.391993  7812 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:37.520678  2253 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:37.513088  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67891.2us
I20260709 13:02:37.521358  2259 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:37.410390  8018 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:37.414321  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 112876us
I20260709 13:02:37.416808  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.417029  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.525691  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:37.417982  7679 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:37.418514  7999 consensus_queue.cc:1243] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:37.306685  7998 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:37.420060  7953 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.420584  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.421222  7751 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:37.421659  7912 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.403121  7908 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:37.423473  7972 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:37.427371  1608 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.430424  2260 raft_consensus.cc:606] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:37.547113  2260 raft_consensus.cc:614] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.437538  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.438462  7925 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:37.438413  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.440850  1601 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:37.417047  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.445487  1649 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:37.427914  7996 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:37.410426  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 74306.1us
I20260709 13:02:37.522240  1531 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.523800  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:37.531337  2257 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.525662  1530 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:37.532114  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.556393  1529 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:37.556931  2261 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:37.557904  2258 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:37.534533  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.521315  7812 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.540282  1600 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.540568  7751 consensus_queue.cc:1243] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:37.570739  1532 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:37.540913  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.545424  7946 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:37.527305  7679 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:37.547936  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.531770  7850 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:37.539057  1607 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:37.540940  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 158515us
I20260709 13:02:37.599725  1525 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:37.564018  2253 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:37.575922  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.592890  7885 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:37.594898  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.559020  7996 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.596720  2256 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:37.597030  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:37.604244  2258 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:37.555421  1606 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:37.619668  1529 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.534523  7614 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:02:37.626019  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.628150  1533 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.628630  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.630746  1530 raft_consensus.cc:2368] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:37.574698  7946 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.625131  8009 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.633946  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.618607  7850 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.629910  7735 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.638876  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:37.639528  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70611.3us
W20260709 13:02:37.640084  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.641645  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.643431  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.573892  7999 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:02:37.631683  7540 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.680806  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.648483  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.682296  1533 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:37.658016  8012 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:02:37.645076  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.659549  7998 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:37.661083  8009 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.662408  7972 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.668350  8015 raft_consensus.cc:2764] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:37.645969  8006 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:37.669059  7812 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.670365  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.638535  7925 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.672871  8021 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:02:37.676645  7946 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.640129  7850 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.678247  7949 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.692870  2255 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:37.695017  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:37.695235  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.696600  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:37.699615  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54619.2us
I20260709 13:02:37.698276  7962 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:37.694447  7540 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.707978  2257 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:37.712224  7755 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:37.714362  7972 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.715485  7864 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:37.716737  8017 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:37.675840  7843 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.758152  7843 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.759092  7771 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.724731  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.761307  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.725020  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.762915  1527 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.765409  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.766327  1528 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.768926  7755 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.771504  7755 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.754208  7953 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:37.703853  1531 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:37.697105  7614 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.706744  7925 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.748431  7908 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.680717  7903 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:37.751726  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.648964  8016 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:02:37.755512  1530 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.814921  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.747802  7962 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.758368  8027 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.815955  1531 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:37.816732  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63449.6us
I20260709 13:02:37.902026  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.902151  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:37.902323  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.903106  1531 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:37.903330  1533 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:37.903618  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:37.657475  7679 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:37.904397  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 245110us
I20260709 13:02:37.904898  7679 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.905159  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:37.907842  7762 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:37.908288  7762 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.908555  7953 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:37.909209  7762 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.754316  8017 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:37.874544  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 181627us
I20260709 13:02:37.882712  7962 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.886415  7949 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.888455  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:37.931339  1528 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:37.889552  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.892937  7908 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.896493  8023 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:37.897655  7925 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:37.898440  7948 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.903923  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.955349  1531 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:37.915513  1532 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:37.915846  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:37.915969  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 361175us
I20260709 13:02:37.953303  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:37.957949  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:37.959127  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:37.922174  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 383460us
I20260709 13:02:37.960805  1531 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:37.960855  7885 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:37.962421  7885 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.962750  7885 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.964759  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:37.965076  8024 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:02:37.966331  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62823.4us
I20260709 13:02:37.967207  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:37.968454  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.902156  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:37.971309  7885 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.921820  7540 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.972443  8013 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.973449  7885 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.973533  8025 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:37.968158  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:37.975507  7998 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:37.976003  7998 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:37.977118  7972 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:37.977697  7962 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.977888  7998 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.978381  7887 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:37.937866  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 494171us
I20260709 13:02:37.909152  7953 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:37.947081  1600 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:02:37.980815  7948 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.935199  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:37.874267  7886 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:37.981894  7886 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.935460  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.982743  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:37.983177  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:37.983907  1682 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 10: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:37.984066  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:37.984905  1678 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:37.981825  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:37.985107  7953 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.987103  1426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 342) took 9938 ms. Trace:
I20260709 13:02:37.921765  8018 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.992298  1432 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.993278  1600 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.993567  8017 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.817785  7614 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.994513  1432 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 16, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:37.982774  7886 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:37.996635  7614 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:37.997496  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:37.976006  8023 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.960211  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:37.960994  7762 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.001505  8017 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:38.003924  7583 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.004523  7583 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.005482  7903 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.006062  7903 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:37.999253  8023 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.006904  7583 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.007606  7583 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:37.957141  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:38.009315  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63415.7us
W20260709 13:02:38.011364  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.014968  1526 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
W20260709 13:02:38.019457  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59309us
I20260709 13:02:38.020447  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:37.934916  7787 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.008133  7903 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.027235  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.028716  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.012053  1432 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:37.996765  7886 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.033432  1531 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:38.066211  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.019218  7614 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:38.018775  7540 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:38.097189  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.099238  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.099720  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.103161  8030 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.103768  8030 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.103197  1682 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:38.073647  7614 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.106382  7614 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.107317  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.083192  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.110073  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.111512  7540 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:38.112094  7540 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.113438  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.114012  1679 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:38.114199  7540 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.080891  8008 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.100206  1683 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:38.101877  1532 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:38.086196  1432 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 15 to 16, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:38.041308  7771 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:02:38.137818  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 67291.3us
W20260709 13:02:38.138566  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 201752us
I20260709 13:02:38.146000  1604 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:38.148300  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.148729  1679 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:38.149180  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:38.150285  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 275812us
I20260709 13:02:38.025444  7972 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:02:38.149833  1600 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
W20260709 13:02:38.137428  7996 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.009s
I20260709 13:02:38.152467  1605 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:38.106151  8030 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.159438  1432 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:38.169755  7946 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.180608  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:38.181838  7540 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:38.182281  7540 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:38.172374  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.183255  1601 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:38.173420  7771 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:37.987524  1426 rpcz_store.cc:276] 0709 13:02:28.048436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.051085 (+  2649us) service_pool.cc:224] Handling call
0709 13:02:37.986873 (+9935788us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.399243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.403086 (+  3843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.403119 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:02:35.403136 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:35.403778 (+   642us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.403855 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.403880 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:35.404446 (+   566us) tablet.cc:701] Row locks acquired
0709 13:02:35.404465 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:35.404601 (+   136us) write_op.cc:270] Start()
0709 13:02:35.404738 (+   137us) write_op.cc:276] Timestamp: P: 1783602155404557 usec, L: 0
0709 13:02:35.404763 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.468616 (+ 63853us) log.cc:844] Serialized 1711 byte log entry
0709 13:02:36.223894 (+755278us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.644927 (+421033us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e67567ef0
0709 13:02:36.860535 (+215608us) write_op.cc:301] APPLY: starting
0709 13:02:36.860843 (+   308us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.985398 (+124555us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.985448 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.004030 (+ 18582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.043417 (+ 39387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:02:37.043473 (+    56us) write_op.cc:312] APPLY: finished
0709 13:02:37.043952 (+   479us) log.cc:844] Serialized 49 byte log entry
0709 13:02:37.044237 (+   285us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.044472 (+   235us) write_op.cc:454] Released schema lock
0709 13:02:37.044559 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.045264 (+   705us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.045293 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":732033,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":624572,"apply.run_cpu_time_us":10553,"apply.run_wall_time_us":184719,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20887,"num_ops":4,"prepare.queue_time_us":276516,"prepare.run_cpu_time_us":73277,"prepare.run_wall_time_us":285160,"raft.queue_time_us":33292,"raft.run_cpu_time_us":8160,"raft.run_wall_time_us":523186,"replication_time_us":818981,"spinlock_wait_cycles":267111168,"thread_start_us":853598,"threads_started":4,"wal-append.queue_time_us":265834,"wal-append.run_cpu_time_us":29462,"wal-append.run_wall_time_us":2357908}]]}
I20260709 13:02:38.174819  7812 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:38.179025  7885 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.180179  7912 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.185401  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:38.199579  7583 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:38.183279  7540 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.228416  1607 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:38.152745  8008 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:38.257874  1432 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 13:02:38.259631  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.571s (SENT)
I20260709 13:02:38.256482  2227 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:38.255623  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70287.3us
I20260709 13:02:38.197784  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:38.234511  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50399.6us
W20260709 13:02:38.228926  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 78817.5us
W20260709 13:02:38.272383  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.226698  7912 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:38.272825  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.234511  7583 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.276990  1531 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:38.278574  1432 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:38.281860  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.284075  1676 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
W20260709 13:02:38.266182  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 338046us
I20260709 13:02:38.268137  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:38.226716  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 216959us
W20260709 13:02:38.287015  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 89314.8us
I20260709 13:02:38.260175  7948 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.245986  8030 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.200634  8019 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:02:38.291137  1531 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:02:38.315927  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.327260  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.327762  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.315953  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.312230  1530 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.239008  7885 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.239836  7751 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:02:38.269207  8035 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:38.329113  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 101139us
I20260709 13:02:38.196031  7996 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.312798  7953 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.273267  7540 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.285701  7583 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:38.329798  1675 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:38.339843  1499 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:38.315323  7925 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:38.311607  8018 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:38.346912  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:38.335227  8009 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:38.312995  8023 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:02:38.341936  7864 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.006s
I20260709 13:02:38.355600  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.339809  8035 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:38.366453  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 128337us
I20260709 13:02:38.367152  1529 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:38.330451  7948 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.409590  1531 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:38.368420  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.413141  1676 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:38.387976  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.412417  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.409674  8035 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:38.423614  8043 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:38.339927  8030 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.426617  8030 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.427567  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.416889  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.429324  1526 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:38.431134  1531 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:38.434542  1531 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.368448  7841 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:38.415583  7936 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.350049  7771 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.368297  7926 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:38.367741  7887 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.434785  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 103455us
W20260709 13:02:38.414120  7850 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:02:38.361848  7925 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.441895  1530 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:02:38.419109  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.446925  1527 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:38.448406  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 114354us
I20260709 13:02:38.455952  1682 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:38.427685  7735 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.416042  7864 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.458869  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 116537us
I20260709 13:02:38.459643  1678 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:38.441510  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:38.409118  7679 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:02:38.437340  8019 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:38.470073  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.477631  1526 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:38.467698  1530 pending_rounds.cc:85] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 11
I20260709 13:02:38.479867  1530 pending_rounds.cc:107] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:02:38.480193  1530 raft_consensus.cc:2889] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.441236  7841 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:38.482183  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.465291  7887 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:38.489002  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.355086  7912 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.362040  8018 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:38.497864  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 78821.9us
I20260709 13:02:38.492489  8007 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.486044  7841 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.367534  8008 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.465603  7850 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.483016  8040 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:38.493680  8014 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.513164  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.516114  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:38.521963  7887 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.504976  8019 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.523634  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.481881  7735 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.522008  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.494489  7864 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.530589  1499 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.534152  1525 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:38.528345  7751 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:38.542342  8060 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.542945  7735 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.543324  8018 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:38.545159  8041 log.cc:927] Time spent T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:02:38.546684  8042 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:02:38.547505  7962 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.005s
W20260709 13:02:38.548434  8038 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:02:38.548655  8047 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:38.550509  7787 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:38.551175  7787 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.552042  7787 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.517818  8040 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:38.522430  7925 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.548738  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:38.557075  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.566097  8025 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:38.566756  8025 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.529809  8053 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:38.540614  8017 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.577150  7885 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:38.579999  8037 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:02:38.580855  1533 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:38.598249  1674 raft_consensus.cc:2410] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:38.598626  7762 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:38.574195  8053 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:38.539140  8015 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:02:38.531200  8019 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.561939  8040 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:38.561059  7887 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.601380  7912 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:38.609014  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70362.8us
W20260709 13:02:38.620621  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46944.8us
I20260709 13:02:38.611792  1602 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:38.621917  1602 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:38.614244  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.622700  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.612735  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.613018  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.624133  1606 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:38.626950  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.602124  7864 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.610070  7762 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.634428  7762 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.635617  7762 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.604831  7948 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.641094  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:38.600862  7841 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.644915  7841 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.655092  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:38.656121  8026 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.656581  8026 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.656903  8026 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.680130  1600 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:38.684393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.639086  1602 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.604589  7996 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.609658  8017 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.623401  7926 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:38.637941  7962 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:38.682057  8060 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.693336  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:38.693749  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.626538  8015 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:38.694763  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:38.709713  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82793.8us
W20260709 13:02:38.708197  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.686802  8016 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:38.690721  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:38.697088  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:38.705097  1602 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.693125  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.600299  7614 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.709609  1676 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:38.716967  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.687754  7948 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:38.718079  1676 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:38.711067  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:38.724254  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 215427us
I20260709 13:02:38.667879  8026 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:38.707765  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 219785us
I20260709 13:02:38.714835  1683 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:38.688923  7850 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.689293  8013 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:38.728224  8013 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:38.718941  7946 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 13:02:38.741384  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:38.740151  1602 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:38.709404  7751 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.713477  7996 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.742839  1648 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:38.739022  1683 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:38.750208  1602 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:38.743537  1648 leader_election.cc:403] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:38.744139  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:38.745961  1534 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:38.742765  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.610931  8053 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.766709  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:38.770573  1600 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:38.720640  7908 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:38.770831  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47873.5us
I20260709 13:02:38.721226  8016 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.735518  8030 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.717758  8012 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:38.735944  8025 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.769924  7912 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.850085  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:38.715981  8015 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.838752  7841 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 13:02:38.836481  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.736425  8013 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:38.857910  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 386208us
I20260709 13:02:38.859712  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:38.861692  2257 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:38.866798  7751 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.869212  8015 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.772248  8067 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:38.848765  7926 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.841252  2258 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:38.847677  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.850883  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:38.772850  7908 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.872856  1675 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:38.873522  1683 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.845148  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 101082us
W20260709 13:02:38.855525  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 79562.9us
I20260709 13:02:38.841619  8017 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.870675  8067 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:38.769673  7850 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 13:02:38.880491  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.877504  7908 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:38.882543  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:38.883122  2258 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:02:38.884512  8016 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.884975  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:38.886262  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:38.848070  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.852424  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.897198  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.897876  2255 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:38.881325  8061 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:38.836371  7885 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:38.847400  8006 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.874989  1677 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:38.907406  2253 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.744089  7948 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:38.843932  8069 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:38.912596  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62604.6us
W20260709 13:02:38.874989  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.913985  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.918749  8061 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:38.919909  8061 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:38.920506  7953 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:38.921272  7926 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.922063  7926 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.923828  7735 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.924450  7735 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.927160  7735 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.927347  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:38.921315  7975 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:02:38.928043  1677 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:38.930972  7953 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:38.931432  7953 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:38.932407  7926 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.836274  8062 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.130s
I20260709 13:02:38.914654  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:38.946861  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.947964  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:38.934131  7962 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:38.950377  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:38.952540  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.952772  8066 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:38.953369  8066 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:38.953750  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:38.954312  1526 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 8.
I20260709 13:02:38.955134  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.955593  8066 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.954195  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.958257  1529 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.957399  2254 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:38.935281  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:38.934713  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:38.963703  1683 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:38.965680  2253 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.905961  8053 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.968497  2252 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:38.974654  2257 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.974858  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.977753  7614 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.980522  8026 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:38.984654  2256 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:02:38.990056  8074 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
I20260709 13:02:38.990272  8008 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:38.990825  8030 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:38.915858  8006 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.991815  8030 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:38.992178  8030 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:38.993075  8006 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.993006  8030 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:38.994834  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:38.995412  7886 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.004s
W20260709 13:02:38.947671  8044 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.532s	user 0.004s	sys 0.000s
I20260709 13:02:38.967132  1527 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:38.962539  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.912298  7841 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:39.008999  2252 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:39.005728  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:38.935621  7787 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.012296  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:02:39.013783  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.852469  8035 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.001253  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:38.906742  7925 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:02:39.016906  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.026332  1675 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:39.017930  2252 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22. Ops: [20.15-21.16]
I20260709 13:02:39.018371  7614 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.015803  8066 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:39.019037  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.019234  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.009768  8006 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.048836  8006 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.049278  8006 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.049360  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:39.050241  1675 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:38.990099  8067 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.054530  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.018524  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.055289  2256 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.055042  7948 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.056682  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.057483  1674 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.057337  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.059654  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.060454  1678 raft_consensus.cc:2368] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17.
I20260709 13:02:38.970634  8069 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.014961  1603 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:39.038261  1532 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:39.062896  8069 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.063241  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.064000  1532 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.064805  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.065387  1532 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 8.
I20260709 13:02:39.065172  7908 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.066082  2256 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:39.006639  7841 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:39.066972  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.038362  7926 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:39.067093  7841 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.067878  7926 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.070886  7912 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:39.071269  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 3157) took 1336 ms. Trace:
I20260709 13:02:39.071662  1534 rpcz_store.cc:276] 0709 13:02:37.735352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.735510 (+   158us) service_pool.cc:224] Handling call
0709 13:02:39.071042 (+1335532us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540008e8d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:39.071176 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147323648}
I20260709 13:02:39.044081  8040 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.072727  1528 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:39.074295  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3166) took 1188 ms. Trace:
I20260709 13:02:39.066295  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:39.038468  1529 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:39.039647  7614 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:39.021572  7735 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:02:38.948127  8064 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:02:39.040920  8035 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.030601  8030 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.039798  2259 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:39.041026  2261 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:39.039664  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.086565  2252 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:39.087689  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.045840  1692 tablet_copy_service.cc:342] P b88b12b461734b3aa6a3da4f5c22c79b: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1 received from {username='slave'} at 127.0.0.1:33564
I20260709 13:02:39.088852  1692 tablet_copy_service.cc:434] P b88b12b461734b3aa6a3da4f5c22c79b: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1 on tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:39.047363  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:39.047566  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:39.054654  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:39.092404  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 84692.1us
I20260709 13:02:39.093737  1679 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.074714  1528 rpcz_store.cc:276] 0709 13:02:37.886046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.934582 (+ 48536us) service_pool.cc:224] Handling call
0709 13:02:39.072395 (+1137813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.073123 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.074036 (+   913us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540008e8d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:39.074185 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566063872}
I20260709 13:02:39.092729  1526 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.071493  7841 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.074118  8040 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:38.999166  7771 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:39.035862  2257 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:39.076009  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.132267  2253 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:39.080863  2256 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:39.081800  1530 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:39.080727  1675 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:39.082283  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:38.932343  7953 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.078069  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:39.024849  7787 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.128621  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.037881  8066 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.067337  7908 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:39.138062  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60091.5us
I20260709 13:02:39.145284  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.145668  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:39.146057  2253 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:39.146486  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:39.136451  7583 consensus_meta.cc:287] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:02:39.138064  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.140111  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.146065  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:39.145431  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.171203  7953 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.172639  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.173484  2256 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:39.173815  8079 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:39.175040  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.115159  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:39.175674  2257 raft_consensus.cc:2376] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17. Re-sending same reply.
I20260709 13:02:39.174923  2259 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 9.
I20260709 13:02:39.179042  1534 raft_consensus.cc:2368] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:39.175643  2254 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.139719  7886 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.147670  8066 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.142970  8069 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:39.184435  8062 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:39.138751  8035 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:02:39.185802  7926 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:39.209280  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 127478us
I20260709 13:02:39.182478  7583 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.190106  7886 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.191956  8069 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.205874  8062 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:39.218847  8008 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.239305  8078 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:39.239777  8034 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.240460  8015 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.234735  8069 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:39.247213  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 70258.8us
I20260709 13:02:39.254024  1681 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
W20260709 13:02:39.253034  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 106175us
I20260709 13:02:39.254033  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:39.244009  7762 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.006s
I20260709 13:02:39.255231  1607 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.235724  8026 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.246634  8007 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.007s
I20260709 13:02:39.260382  1529 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:39.255404  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:39.264698  7762 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:39.265799  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.248018  8008 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.267195  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:39.266886  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.268651  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.269328  1534 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:39.264881  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.273777  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.275054  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.275885  1532 raft_consensus.cc:2393] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.268101  8067 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:39.276721  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.253687  8015 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.281267  1525 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:39.286564  1527 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:39.288560  1532 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:39.296892  1533 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:39.247928  7908 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:39.263904  8007 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.303217  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.328025  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:39.335444  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:39.336469  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.252805  8034 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.271442  7887 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:39.343362  1607 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:39.263345  8026 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:39.352296  8090 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:39.353868  7583 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.303280  7614 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.297243  7762 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:02:39.348402  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.363648  2255 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:39.364439  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.360445  8008 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.368647  2259 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:39.373821  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.374357  2255 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:02:39.374574  2256 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:39.374853  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.375648  2261 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:39.375959  8019 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.376830  8066 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.377758  8015 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:39.378580  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3074) took 1397 ms (client timeout 1609 ms). Trace:
I20260709 13:02:39.368161  7583 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:39.383293  7583 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:39.382998  1681 rpcz_store.cc:269] 0709 13:02:37.981365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.981577 (+   212us) service_pool.cc:224] Handling call
0709 13:02:39.378342 (+1396765us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000ed3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:39.378475 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323530496}
I20260709 13:02:39.384234  7583 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.370862  2257 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:39.303241  8062 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.350534  7887 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.391916  8026 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.398068  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.398923  1603 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:39.378993  8066 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.381726  7762 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:39.404682  7762 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:39.405699  7762 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.356703  7787 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.358481  8067 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:02:39.408700  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.409600  8066 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:39.409973  8066 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:39.410364  8066 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.416253  8006 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.421293  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:39.421991  1604 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.424175  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:39.425738  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.425756  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:39.428014  2257 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:39.428635  2254 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:39.431922  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.433202  2254 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:39.429867  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.434748  1600 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:39.434510  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 155286us
I20260709 13:02:39.441552  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:39.442075  1603 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.445013  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:39.448393  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.449120  2254 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 9.
I20260709 13:02:39.431573  8015 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:39.450106  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.452598  2257 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:39.440655  8026 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:39.452907  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:39.455083  1602 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.456889  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.457751  1600 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:02:39.460987  8099 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.461679  8099 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.463857  8099 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.454741  7762 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.491703  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.492594  7926 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.493105  7926 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.493502  8017 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:39.494050  8017 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.495127  7926 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.497200  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.454350  8026 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.497983  8026 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.499068  8066 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.453114  8034 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.502341  8034 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:39.503207  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.504509  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.505309  1609 raft_consensus.cc:2410] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:39.509126  7887 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.509863  7887 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.518210  1604 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:39.514506  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:39.530098  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:39.496030  8017 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.512815  8006 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.528971  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.538326  1603 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:39.544790  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:39.545981  1683 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:39.544852  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.548614  1677 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:39.552271  1602 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:39.556036  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.540493  8064 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:39.545750  7946 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:39.561316  1649 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:39.546777  7864 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:39.532483  7787 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:39.555989  8023 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:39.580983  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.581156  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.581655  2253 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:39.583039  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.583578  2259 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:39.585592  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.585714  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.586300  2254 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:39.586793  2261 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: Advancing to term 20
I20260709 13:02:39.587091  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.586309  2256 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.578794  8006 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.569525  8034 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:39.574095  7864 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.577212  7908 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:39.584952  8053 consensus_meta.cc:287] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.001s
I20260709 13:02:39.600286  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.600128  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.599344  8006 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.616775  8066 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.617559  8034 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:39.623332  7864 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.584491  8064 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:39.630719  7908 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:39.645473  2256 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
W20260709 13:02:39.596163  8095 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:39.650794  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.650995  8034 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.653245  2256 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:39.657397  2258 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:39.659941  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 214983us
I20260709 13:02:39.660563  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.660815  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:39.636739  2261 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:39.634635  2259 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:39.592734  8023 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:39.646900  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.671840  2254 raft_consensus.cc:2410] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:39.644980  8069 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.674652  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.676640  2252 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:39.676829  2261 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.680760  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.681463  2256 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.677505  7946 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:39.688192  7946 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.696775  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.697363  2252 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.703783  8064 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.711247  2259 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:39.711414  2261 raft_consensus.cc:2410] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:39.712343  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.712919  2253 raft_consensus.cc:2376] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14. Re-sending same reply.
I20260709 13:02:39.715227  2256 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:39.715926  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.716799  2254 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:39.720504  2257 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:39.721007  8026 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.720717  8006 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.695442  7908 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.733304  8069 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.740764  2252 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:39.709168  8023 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.752039  2257 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:39.770623  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.772378  2254 raft_consensus.cc:2376] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17. Re-sending same reply.
I20260709 13:02:39.823292  7864 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.832077  7864 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:39.838689  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.839272  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.839917  2252 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.840334  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.841081  2257 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:39.847625  2252 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:39.851517  2254 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:39.853070  7886 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.860893  7771 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:39.861613  7771 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.864068  7771 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:39.874403  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.875166  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
W20260709 13:02:39.877121  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.877600  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.878304  8069 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.878914  8069 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.883960  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.884292  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:39.885001  2257 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:39.888191  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:39.889376  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:39.889843  2254 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.893831  8007 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.887748  8006 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:02:39.887068  7771 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.888517  8066 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:39.887198  7886 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.903916  7771 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.905761  1606 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:39.911541  7771 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:39.904697  7886 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:39.916005  8099 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:39.919122  2254 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:02:39.919874  8119 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:39.919934  8013 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.929730  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3468) took 1251 ms. Trace:
I20260709 13:02:39.929759  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:39.934453  8064 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.939837  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:39.941473  1648 leader_election.cc:400] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16.
I20260709 13:02:39.949245  1607 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.943915  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.944370  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.933828  7762 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.935279  8060 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:02:39.944649  1601 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:39.946070  1603 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:02:39.957978  1603 pending_rounds.cc:85] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:02:39.958269  1603 pending_rounds.cc:107] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:39.958508  1603 raft_consensus.cc:2889] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:39.945696  8119 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.935629  8007 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:02:39.946508  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.936358  8099 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:39.997611  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:39.947227  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 286480us
I20260709 13:02:39.998287  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:39.947866  8100 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.940768  1606 rpcz_store.cc:276] 0709 13:02:38.678241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.678366 (+   125us) service_pool.cc:224] Handling call
0709 13:02:38.678697 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.906207 (+1227510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.929426 (+ 23219us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400454cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:39.929635 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821487360}
I20260709 13:02:39.948299  7885 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:39.999013  8017 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.002348  8017 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:40.002883  8060 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:40.003314  8060 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:40.004252  8060 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.004886  8017 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.004992  8006 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.005771  8006 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:40.007843  8006 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:39.960283  1500 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:39.959738  7614 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:40.009589  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 79932.2us
W20260709 13:02:39.999519  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.956382  1608 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:40.000023  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:40.001202  1676 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:40.011107  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:40.011788  1606 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.987154  1607 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
W20260709 13:02:40.009720  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50650.9us
I20260709 13:02:39.967049  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:39.998556  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:40.014564  1604 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:40.014911  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.016688  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.020391  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.020758  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.020572  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.021167  1676 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:40.026296  1601 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:40.030025  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:39.957373  7787 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.031780  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:40.021461  1675 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:40.017781  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.025542  1498 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:40.032166  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.005174  8069 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.065762  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:39.996980  8119 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.037565  2252 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:40.042294  1603 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:40.067552  1526 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 13.
I20260709 13:02:40.035486  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:40.068624  1677 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.069679  1573 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:40.027078  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.606s (SENT) [suppressed 33 similar messages]
I20260709 13:02:40.064775  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1398) took 1144 ms. Trace:
I20260709 13:02:40.038560  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
W20260709 13:02:40.073169  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55466.8us
I20260709 13:02:40.074079  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:39.961025  7925 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.071282  2258 rpcz_store.cc:276] 0709 13:02:38.884158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.884749 (+   591us) service_pool.cc:224] Handling call
0709 13:02:40.028045 (+1143296us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54004eaa54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:40.028159 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734877952}
I20260709 13:02:40.074041  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.019918  8040 raft_consensus.cc:2764] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:39.995482  7962 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:02:40.088624  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.078442  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.089449  1683 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:39.961365  8066 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.065157  8070 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:40.035180  8118 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.128715  8066 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.035487  7540 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:39.960039  7762 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:39.955938  8013 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:40.035378  8019 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.096143  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 70726.4us
W20260709 13:02:40.144433  1498 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.538s (SENT)
I20260709 13:02:39.959236  8064 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.019829  8030 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:02:40.082242  8025 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:40.023244  7903 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:02:40.080827  7975 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:40.079777  8119 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:40.088019  8060 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.082965  8009 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:40.125128  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 165538us
I20260709 13:02:40.133090  7540 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:40.077236  7926 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:02:40.173485  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:40.174332  8127 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:40.170760  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:40.175186  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:40.175800  1528 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.176978  1534 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:02:40.126338  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 92181.8us
I20260709 13:02:40.127068  1677 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:40.178794  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.180883  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:40.181522  1533 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.075096  7787 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.185153  8026 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:40.185330  8070 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.185755  8013 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.180018  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.186192  7787 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.112629  7812 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:40.187332  7812 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:40.188488  8067 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:40.188342  7812 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:40.189296  1526 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:02:40.188292  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.175726  1527 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.086967  7925 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.191268  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.191948  1529 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 10.
I20260709 13:02:40.192853  7925 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.193959  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.194715  1529 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:40.195681  1526 pending_rounds.cc:85] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 15
I20260709 13:02:40.196035  1526 pending_rounds.cc:107] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:02:40.196342  1526 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.201330  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:40.206585  1529 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.196606  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.206072  2226 leader_election.cc:400] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17.
I20260709 13:02:40.209887  2226 leader_election.cc:403] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:40.210428  1528 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:40.116886  7864 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:02:40.118338  7948 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:02:40.090466  8099 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.019264  7614 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.200718  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:40.155431  7975 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:40.150846  8025 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.146075  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 119013us
I20260709 13:02:40.216979  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.246703  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.215437  1533 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:40.218953  1606 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:40.230170  1526 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:40.248128  1529 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
I20260709 13:02:40.168181  8009 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:40.230726  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.227936  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.201136  7762 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.217550  1527 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:02:40.269695  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.229799  8067 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.238902  8131 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.173324  8128 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:02:40.251813  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 163282us
I20260709 13:02:40.256772  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.315824  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.256876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.257906  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:40.259096  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:40.258496  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:40.249610  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.315748  1678 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:40.261343  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:40.262594  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:40.318835  2254 raft_consensus.cc:2376] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18. Re-sending same reply.
I20260709 13:02:40.319132  1680 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:40.262919  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:02:40.319049  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.250870  8070 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.151185  8019 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.266222  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:40.258626  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:40.199720  8134 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:40.270421  1527 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
W20260709 13:02:40.189231  8124 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.369s	user 0.002s	sys 0.001s
I20260709 13:02:40.271379  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:40.204178  8064 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.228364  7925 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.276933  2258 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:40.277913  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.287807  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:40.271000  8040 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.303160  1526 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:40.204384  7540 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.234279  8013 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:02:40.336537  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.338905  7583 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:40.339318  7583 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:40.339388  8013 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:40.340121  7583 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.341925  2252 raft_consensus.cc:2393] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:40.342245  1680 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:40.251144  8025 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.250471  8015 raft_consensus.cc:2764] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:02:40.260282  8106 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.320962  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.129410  8066 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:40.324057  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67387.1us
I20260709 13:02:40.320250  8131 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:40.325314  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75695.3us
W20260709 13:02:40.368683  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.327174  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.370030  1682 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:40.243522  7975 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.340667  8019 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.341842  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:40.269918  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:40.375568  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 105722us
I20260709 13:02:40.376331  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:40.377194  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:40.378436  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57563.4us
I20260709 13:02:40.314729  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:40.270494  8119 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:40.341269  7583 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:40.361635  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 284324us
I20260709 13:02:40.332278  8012 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:40.363502  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.264773  8009 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:40.331789  8134 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:40.341359  7886 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.342475  8006 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.340117  8013 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.386708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 72054.7us
I20260709 13:02:40.513082  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.379155  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:40.392984  1601 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:40.398973  8019 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:40.511227  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 109465us
I20260709 13:02:40.342892  8040 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.384824  7925 raft_consensus.cc:2764] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:40.383306  7540 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:40.397452  8118 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:40.392624  8070 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:40.389029  7926 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.539646  7926 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:40.520375  7946 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:40.401641  8134 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.548641  2257 raft_consensus.cc:606] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.549101  2257 raft_consensus.cc:614] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:40.524631  8012 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:40.536350  8008 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.559549  7926 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.537529  8118 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:40.542667  8070 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.520614  8133 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:40.524137  8013 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:40.589290  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.597129  8101 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.030s	user 0.007s	sys 0.004s
I20260709 13:02:40.546103  8034 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 13:02:40.609261  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 459153us
I20260709 13:02:40.594007  8118 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:40.619678  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 236303us
I20260709 13:02:40.594296  8070 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:40.607685  8130 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:02:40.604152  8131 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.624024  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:40.631168  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:40.599246  8140 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:40.633870  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.578554  8008 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.611824  7614 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:40.624218  8061 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.638072  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.635887  8147 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.635519  8106 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:40.646454  8100 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
W20260709 13:02:40.656826  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 143821us
I20260709 13:02:40.660208  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:40.666126  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.647676  7614 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:40.642840  8144 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:40.647440  8133 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:40.655648  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 276508us
I20260709 13:02:40.678318  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:40.690495  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55769.4us
I20260709 13:02:40.657182  8019 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.691269  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.670925  7864 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:40.674239  8100 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.689437  8152 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:40.687381  7925 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.692965  8141 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:40.638595  8012 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:40.712940  8142 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:02:40.722113  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:40.731355  7886 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.731920  7886 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:40.732911  7886 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.738067  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:40.738812  1526 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
W20260709 13:02:40.723105  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 92035.6us
I20260709 13:02:40.658336  8147 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.666860  8106 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.741328  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:40.802489  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61253.5us
W20260709 13:02:40.801489  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63688.5us
I20260709 13:02:40.719483  8040 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:40.742560  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:40.804105  1647 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:40.687503  8144 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.785255  8099 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:40.963330  8148 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:02:40.729718  8034 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:02:40.725358  7925 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:40.961854  8156 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.248s
I20260709 13:02:40.879491  7864 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:02:40.960963  8164 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:40.994016  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:41.018297  8060 consensus_meta.cc:287] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.014s
I20260709 13:02:41.019369  7903 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:41.019443  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:41.021268  8023 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.021725  8023 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.022058  8023 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.728565  8030 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:02:40.795682  8007 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:40.967269  8137 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:41.001013  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 288474us
W20260709 13:02:41.008909  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 317663us
I20260709 13:02:41.043407  1573 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:40.796518  8161 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:41.020056  7903 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:40.820516  8100 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:40.960297  8129 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:02:40.994362  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 251855us
I20260709 13:02:41.000711  8014 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:40.994118  8040 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.994642  8017 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.041986  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.932160  8064 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:41.042855  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:40.968896  8061 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:41.040791  7812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.021s	sys 0.037s
I20260709 13:02:41.058754  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:41.065424  8040 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.007805  7771 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:02:41.042377  8137 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:41.066212  8017 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:41.066933  8143 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:02:41.066725  8064 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.067317  8154 raft_consensus.cc:2764] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:41.067716  8158 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:02:41.070709  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51321.4us
I20260709 13:02:41.037833  8007 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:41.066073  8157 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.075812  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.075984  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.077178  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:41.077440  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:41.115106  1604 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:02:41.077831  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.115931  1602 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:41.066586  8149 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:02:41.134711  8106 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:41.142120  7975 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.000s
I20260709 13:02:41.059135  8100 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.147100  8100 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:41.068737  7812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.021s	sys 0.037s
I20260709 13:02:41.061553  8008 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.061977  8013 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:41.088558  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.093400  8151 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:41.094427  8138 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:02:41.081650  8060 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:41.151312  8060 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:41.151824  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3485) took 1221 ms. Trace:
I20260709 13:02:41.152395  8017 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.152231  8060 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.152240  1605 rpcz_store.cc:276] 0709 13:02:39.930604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.932547 (+  1943us) service_pool.cc:224] Handling call
0709 13:02:39.932802 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.933116 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.933152 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.937363 (+  4211us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.097948 (+160585us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:40.097993 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.098068 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.151637 (+1053569us) raft_consensus.cc:1685] finished
0709 13:02:41.151658 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.151769 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10517,"raft.queue_time_us":1167,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4717,"thread_start_us":150653,"threads_started":1,"wal-append.queue_time_us":418340}
I20260709 13:02:41.127051  8157 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:41.157593  8009 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.637s	user 0.003s	sys 0.007s
I20260709 13:02:41.095064  8061 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.082823  8137 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.088840  8169 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:41.121399  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.123162  1604 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:41.125253  7925 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.125609  8007 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.084244  8014 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:41.126873  8167 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:41.126886  8144 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:41.131158  7540 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
W20260709 13:02:41.142577  8067 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.826s	user 0.005s	sys 0.004s
I20260709 13:02:41.196589  8067 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17.
I20260709 13:02:41.054111  8161 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.150599  8151 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:41.197460  8161 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.198012  8151 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:41.205907  7946 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.001s
I20260709 13:02:41.206432  7946 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:41.175639  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 105856us
I20260709 13:02:41.180466  8169 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:41.208536  8169 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:41.211248  8172 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:02:41.168522  8025 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.000s
I20260709 13:02:41.212570  8025 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.213649  1676 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:41.214673  8025 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:41.214917  8064 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.145004  8040 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.216100  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3189) took 1022 ms. Trace:
I20260709 13:02:41.216492  1525 rpcz_store.cc:276] 0709 13:02:40.193573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.197419 (+  3846us) service_pool.cc:224] Handling call
0709 13:02:40.197744 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.272100 (+ 74356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.272131 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.272173 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:40.272210 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.215881 (+943671us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54003a75d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:41.215941 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.216050 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170556288}
I20260709 13:02:41.217227  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:41.221680  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:41.227819  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.228740  2252 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:41.229564  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.230192  2255 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:02:41.187300  8100 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.231843  1605 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:41.183380  7925 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.166929  8009 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.235531  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:41.191941  8133 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.003s
I20260709 13:02:41.238520  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.238667  2258 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:41.239295  2252 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 10: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:41.243191  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.243618  2255 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:41.243459  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:41.240372  7925 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.245357  8157 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.246397  7925 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:41.246893  8023 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.226148  7912 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:41.249394  2254 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:41.258118  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.256356  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.148442  7903 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.260344  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:41.265002  1526 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:41.268215  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:41.261669  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.267659  1676 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:41.269524  2261 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:41.268940  1681 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:41.270234  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:41.168366  7975 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.271135  1526 raft_consensus.cc:2410] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:02:41.274444  1525 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:41.267778  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:41.277282  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.277880  2258 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:41.279752  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:41.280872  8173 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.233177  8064 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:02:41.281279  8173 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.281626  8173 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.283800  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.285135  2255 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:41.286417  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:41.287122  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:41.240757  8133 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:41.293006  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.305063  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:41.360558  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55600.9us
I20260709 13:02:41.307071  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:41.286114  8118 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
W20260709 13:02:41.275921  8134 consensus_meta.cc:287] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.009s
W20260709 13:02:41.356276  8066 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.004s
I20260709 13:02:41.373584  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:41.365372  8070 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.729s	user 0.005s	sys 0.005s
I20260709 13:02:41.375068  8168 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.381281  8150 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.382133  7975 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.383698  8161 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.372691  8118 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.386030  8178 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.290405  8015 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:02:41.389875  8007 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:41.391527  8174 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:02:41.421694  8023 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.407507  8030 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.424813  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.425238  8030 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.426060  1604 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:41.427019  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:41.427332  8030 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.413882  7925 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.393558  8166 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:41.395386  7583 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.007s	user 0.008s	sys 0.002s
I20260709 13:02:41.389922  8009 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.405553  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:41.438369  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:41.411291  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.409826  8168 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.429193  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2978) took 1260 ms. Trace:
I20260709 13:02:41.429466  1674 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.441399  8012 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:41.442847  8168 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.393075  8066 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:41.430032  1604 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:41.426153  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.402432  8099 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.402745  8069 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.409979  7912 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:41.441346  1530 rpcz_store.cc:276] 0709 13:02:40.168705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.171101 (+  2396us) service_pool.cc:224] Handling call
0709 13:02:40.179317 (+  8216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.233283 (+ 53966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.233315 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.235740 (+  2425us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.331065 (+ 95325us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:40.331112 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.428694 (+1097582us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b5400266bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:41.428756 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.428818 (+    62us) raft_consensus.cc:1685] finished
0709 13:02:41.428833 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.429110 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46189,"raft.queue_time_us":47371,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":16804224,"thread_start_us":94886,"threads_started":1,"wal-append.queue_time_us":168920}
I20260709 13:02:41.429593  8161 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.436203  8166 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:41.451010  8166 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.436292  8062 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:41.452877  1607 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:41.453219  8099 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.450017  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:41.454346  1680 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:41.455264  8099 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:41.412647  8150 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.456482  7946 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:41.457738  8150 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.458282  7912 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:41.458740  7912 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.305377  8014 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.460455  8069 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.443961  7925 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.440595  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:41.470952  8035 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.471967  7925 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:41.407876  8070 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.462481  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:41.450040  8165 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.465436  1601 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:41.464643  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:41.456040  8100 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.469362  8137 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:41.448275  8179 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:41.501443  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:41.432520  8178 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.452126  8118 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.460487  8151 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:41.477319  8069 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.477856  7946 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:02:41.490497  1674 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:41.479935  8147 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.377492  8134 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.502279  1680 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:41.518049  1574 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:41.519702  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 290027us
I20260709 13:02:41.499763  8161 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:41.504691  8145 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.826s	user 0.003s	sys 0.002s
I20260709 13:02:41.500476  8131 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.542868  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.543591  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.517030  8151 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.549660  1527 raft_consensus.cc:1240] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:41.551143  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.547581  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:41.548957  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:41.561412  8168 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.562124  8168 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.572213  8131 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.549983  7903 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:41.575016  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:41.542140  8150 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:41.542598  8161 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.582839  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:41.585996  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:41.502102  8165 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.553797  8151 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:41.593662  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3498) took 1391 ms. Trace:
I20260709 13:02:41.580572  8118 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:41.581255  8169 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.586781  8161 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.595965  1609 rpcz_store.cc:276] 0709 13:02:40.202730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.204232 (+  1502us) service_pool.cc:224] Handling call
0709 13:02:40.204659 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.205026 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.205056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.205596 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.580796 (+375200us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:40.580844 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.581740 (+   896us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.472209 (+890469us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:41.593301 (+121092us) raft_consensus.cc:1685] finished
0709 13:02:41.593324 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.593591 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":807,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":19548,"spinlock_wait_cycles":6323584,"thread_start_us":263937,"threads_started":1,"wal-append.queue_time_us":387999}
I20260709 13:02:41.591710  8150 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:41.597198  8099 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:41.618413  8185 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:41.622463  8137 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.624193  8007 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.599874  8169 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.609563  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.598845  8140 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:41.640041  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:41.640578  8178 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.641180  1602 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:02:41.641929  8140 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:41.643718  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.635053  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.634950  8168 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.637171  8150 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.637740  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.663738  2258 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:02:41.647786  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:41.652132  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:41.653335  2257 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:41.655853  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:41.660405  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.598623  7925 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:02:41.685256  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:41.687624  1601 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:41.658354  8161 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.646461  8169 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.702131  7912 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.720554  7975 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.721275  7975 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.723706  7975 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.743247  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:41.743927  1676 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.746441  1601 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:41.753197  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:41.697628  8070 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.757056  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:41.760878  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:41.718303  7912 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.742465  8161 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.779434  1676 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:41.769748  8165 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.789543  8173 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.859135  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:41.859858  1528 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:41.863135  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:41.870949  1528 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:02:41.871739  8099 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:41.846697  8134 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.873891  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:41.874359  8173 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:41.874588  1533 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:41.875053  1603 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:41.872157  8099 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:41.876684  8099 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.877667  8099 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.878397  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 227) took 4562 ms. Trace:
I20260709 13:02:41.835842  8166 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.882758  8154 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:41.883039  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:41.883298  8154 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:41.883701  8154 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.883847  8119 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.884348  8119 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:41.884421  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:41.884784  8119 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.891928  7912 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.892369  7912 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:41.892750  7912 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.900077  8070 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.900239  2258 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:41.916513  2255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06"
dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:55502
I20260709 13:02:41.917747  2255 raft_consensus.cc:606] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:41.919028  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.919803  2253 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:41.922807  8026 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.923405  8026 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.925176  8067 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.925868  8026 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:41.928292  2255 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:41.896232  8118 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.895200  8106 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.901587  8007 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:41.878764  1432 rpcz_store.cc:276] 0709 13:02:37.315835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.316133 (+   298us) service_pool.cc:224] Handling call
0709 13:02:41.878304 (+4562171us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:38.552401 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:38.553080 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:38.553132 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:02:38.553152 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:38.554067 (+   915us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:38.554151 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:38.554180 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:02:38.554842 (+   662us) tablet.cc:701] Row locks acquired
0709 13:02:38.554897 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:02:38.555056 (+   159us) write_op.cc:270] Start()
0709 13:02:38.579593 (+ 24537us) write_op.cc:276] Timestamp: P: 1783602158554990 usec, L: 0
0709 13:02:38.579621 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:02:38.580461 (+   840us) log.cc:844] Serialized 2894 byte log entry
0709 13:02:39.351108 (+770647us) op_driver.cc:464] REPLICATION: finished
0709 13:02:39.387365 (+ 36257us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e67567ef0
0709 13:02:39.593519 (+206154us) write_op.cc:301] APPLY: starting
0709 13:02:39.593613 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.627722 (+ 34109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.627744 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:39.729405 (+101661us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:39.729641 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:02:39.729685 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:39.731101 (+  1416us) log.cc:844] Serialized 73 byte log entry
0709 13:02:39.732820 (+  1719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:39.732934 (+   114us) write_op.cc:454] Released schema lock
0709 13:02:39.732982 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:39.733337 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:39.733367 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":354684,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":234091,"apply.run_cpu_time_us":11585,"apply.run_wall_time_us":147858,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33457,"num_ops":7,"prepare.queue_time_us":96937,"prepare.run_cpu_time_us":13158,"prepare.run_wall_time_us":202424,"raft.queue_time_us":281974,"raft.run_cpu_time_us":15336,"raft.run_wall_time_us":218589,"replication_time_us":755832,"spinlock_wait_cycles":17220480,"thread_start_us":623777,"threads_started":4,"wal-append.queue_time_us":331860,"wal-append.run_cpu_time_us":19584,"wal-append.run_wall_time_us":1823918}]]}
I20260709 13:02:41.949052  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:41.902180  8140 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.925801  8067 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.918962  8070 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:41.964648  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 204574us
I20260709 13:02:41.939015  8118 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:41.942543  8106 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:41.982851  8197 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.311s	user 0.001s	sys 0.003s
I20260709 13:02:41.947980  8007 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:41.987012  7886 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:41.998838  8176 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:42.001816  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:42.003175  8208 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:02:42.005177  8210 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:02:42.005528  8067 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.007170  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:42.008556  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:42.009198  2259 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:42.020031  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:42.023365  8204 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:02:42.026325  2253 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:42.027478  8118 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.028165  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:42.029484  8070 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.030476  8166 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.034418  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.035171  1531 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:42.055859  2260 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:02:42.056205  8209 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:41.979477  8151 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:42.077474  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57550.7us
I20260709 13:02:42.080849  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.076784  8118 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.080410  8140 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.086180  8169 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.097074  8169 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.098130  8118 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:42.098635  8118 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:42.099505  8118 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.103283  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.104494  8099 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:42.105036  8099 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.105803  8099 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.106268  7912 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.110100  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:42.112464  8169 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.113123  8169 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.115278  8169 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.104663  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:02:42.122014  8191 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.407s	user 0.000s	sys 0.005s
I20260709 13:02:42.128521  8140 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.129036  8140 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.129362  8140 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.131567  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.132246  1528 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 10.
I20260709 13:02:42.134382  8106 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.135877  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.147060  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.155715  1600 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:42.128563  8154 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:42.159627  8171 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.080s	user 0.004s	sys 0.000s
W20260709 13:02:42.173014  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 173750us
I20260709 13:02:42.145076  8151 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.162894  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:42.177522  2260 raft_consensus.cc:2410] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 21 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:42.116413  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.164686  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:42.165187  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:42.178793  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 62788.4us
I20260709 13:02:42.175940  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1321) took 1100 ms. Trace:
I20260709 13:02:42.142210  8007 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.177107  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:42.178625  2257 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:42.180845  2252 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:42.179309  1608 rpcz_store.cc:276] 0709 13:02:41.075348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.075510 (+   162us) service_pool.cc:224] Handling call
0709 13:02:42.175709 (+1100199us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:42.175876 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473205120}
I20260709 13:02:42.147804  8140 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.187237  2254 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Advancing to term 19
I20260709 13:02:42.192022  2252 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:42.193420  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:42.193962  2261 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:42.194588  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.194989  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.184721  7787 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.203073  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.204123  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.216704  2261 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:42.194862  8067 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:42.231128  2254 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:02:42.235314  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.238392  1676 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:42.239168  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.250423  1607 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:42.252784  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.253716  1534 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:42.254645  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.255735  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:42.261276  1600 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:42.262164  1680 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:42.262585  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:42.263317  1674 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:42.265094  8009 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.265268  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.265779  8009 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.268576  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.268824  1674 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:42.198825  8133 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.270280  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.271613  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:42.273528  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.276749  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.277913  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.203667  8064 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:42.281018  1675 raft_consensus.cc:2393] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:42.274894  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:42.282480  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.281275  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.284713  1681 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:42.268466  8026 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:42.233844  8067 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.289754  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.289767  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.289606  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.200716  8134 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:02:42.218750  7787 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.207135  8151 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:02:42.376878  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.291154  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:42.378733  1678 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:42.290164  1674 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:02:42.303620  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 100614us
I20260709 13:02:42.381472  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.302222  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:42.378733  1677 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:42.382380  1683 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:42.268193  8009 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.383541  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:42.334324  8212 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:42.281844  8064 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.381322  7912 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.359807  7614 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:42.381561  8067 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:42.242951  8119 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.409216  8009 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.427261  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.438618  1674 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
W20260709 13:02:42.432487  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 203519us
W20260709 13:02:42.433117  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 225158us
I20260709 13:02:42.437780  1680 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:02:42.440006  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.441649  1680 pending_rounds.cc:85] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 10
I20260709 13:02:42.441999  1680 pending_rounds.cc:107] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:02:42.442226  1680 raft_consensus.cc:2889] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.442490  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.285799  8133 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.360131  8157 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:02:42.421947  8064 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.423127  7614 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.458622  8207 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.590s	user 0.003s	sys 0.000s
I20260709 13:02:42.406636  8026 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:42.454308  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 170931us
I20260709 13:02:42.495532  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:42.509477  8219 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:42.509986  8026 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.449973  7912 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:02:42.510914  1602 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:42.512051  8012 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:42.512791  8012 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.493176  7614 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:42.520548  7886 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.521130  7886 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.521646  8119 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.420630  8099 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.522046  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.442179  8009 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.680052  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:42.667579  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:42.570051  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.567551  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.634796  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:42.596786  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:42.688566  2226 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.786s (SENT)
I20260709 13:02:42.689481  2258 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:42.687237  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 235328us
I20260709 13:02:42.574241  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:42.600612  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.696445  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.697994  1602 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:42.695482  1607 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:42.701051  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:42.702378  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:42.702648  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:42.689497  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:42.493546  8185 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:02:42.696913  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:42.718930  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.494524  8161 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.597100  7925 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.524293  8151 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.575387  8118 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.667563  7903 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:42.575209  8106 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.559609  8140 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.523948  8099 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:42.558802  8154 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.717522  8119 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:02:42.728744  7925 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.738692  1525 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:42.735878  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.575031  8026 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:02:42.655620  8222 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.676575  8025 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:02:42.747217  1531 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:42.616760  7912 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:02:42.769778  8227 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:02:42.728138  7886 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.748253  2258 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:02:42.790179  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.791157  1607 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:42.743330  7903 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.796382  1525 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:42.752105  8106 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.800421  8025 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:42.802228  8099 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.780686  8222 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.802486  8106 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:42.725759  8161 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.803184  8012 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:42.778569  8169 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:42.751744  8233 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.810702  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:42.826176  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.771981  8228 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:42.737689  8151 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.798692  7886 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.829689  1533 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:42.747262  8118 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:42.838541  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 149976us
I20260709 13:02:42.801070  7925 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:42.840487  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145854us
I20260709 13:02:42.808893  8025 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:42.849749  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.850729  1525 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:42.813160  8133 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:42.824795  8226 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:42.852550  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:42.832497  8106 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.853621  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:42.862005  1530 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:42.863168  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:42.828416  7912 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:42.845549  8099 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.877130  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:42.836449  8012 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:02:42.856959  8230 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:42.856787  8119 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:42.834532  8169 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.887212  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.887605  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:42.881203  1533 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:42.832463  8233 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.825484  7614 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:42.867311  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 703127us
I20260709 13:02:42.891944  2227 leader_election.cc:400] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:02:42.892354  2227 leader_election.cc:403] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.871560  8228 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:02:42.874982  8201 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.014s	user 0.004s	sys 0.000s
I20260709 13:02:42.898777  1530 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:42.845486  7886 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.881597  8009 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:42.886360  8230 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:42.916101  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 379540us
I20260709 13:02:42.863494  8106 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.860114  8226 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:42.909690  8119 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.893944  8223 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.881528  8133 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:02:42.929668  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.935868  8241 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.937529  1533 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:42.884327  8099 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.911700  8237 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:42.936447  7925 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
W20260709 13:02:42.942384  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.947862  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:42.899554  8236 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:02:42.932946  8136 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:42.943178  8237 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.960973  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:42.894522  8025 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:42.969177  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:42.972173  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 80344.5us
I20260709 13:02:42.929232  8240 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:02:42.973897  1531 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:42.952626  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 99073.9us
I20260709 13:02:42.980934  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:42.966421  8154 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.980453  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60753.9us
I20260709 13:02:42.965346  8228 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.973449  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:42.960502  8237 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:42.952839  8224 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:02:42.988672  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.950716  8242 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:02:42.995731  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.983646  8025 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.965551  8136 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.007005  1531 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:43.011101  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.012512  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.013051  1531 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.014505  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:42.985605  8222 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.026196  1531 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:42.992568  8161 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.028056  1676 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:02:43.015960  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128423us
I20260709 13:02:43.031770  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.032987  1531 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.032778  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:42.994684  8151 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.036966  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.037590  1683 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:42.988826  8154 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.016994  8240 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:42.969430  8230 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.027661  8118 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.028836  7925 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:43.049810  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:43.050127  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.051635  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.053644  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.053826  1527 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:43.043882  1531 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:43.054857  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.055323  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.056692  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.058598  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.060885  1683 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:02:43.062362  7886 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.063023  8106 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.041534  7912 raft_consensus.cc:2764] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:43.064010  1531 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:43.042500  8240 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.065094  8240 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.065186  1531 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:43.067525  8222 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:43.064393  8250 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:02:43.072954  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.073664  1676 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.075173  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.067950  8222 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.076725  8222 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:43.081148  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.081768  8154 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:43.083042  8238 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:02:43.086114  8136 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.040019  7614 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.068758  8230 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.087812  8226 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:43.089536  8064 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.005s
I20260709 13:02:43.048537  8169 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.075937  8258 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.103336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.064509  8099 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:43.148178  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72335.9us
I20260709 13:02:43.148195  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.072080  8151 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:43.120843  8246 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:02:43.155220  7787 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.157096  1682 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:43.158032  8258 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:43.164552  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.166256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:43.169898  8067 consensus_meta.cc:287] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.002s
W20260709 13:02:43.173225  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.176074  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3199) took 1038 ms. Trace:
I20260709 13:02:43.110554  7614 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.091112  7912 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.147670  8253 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:43.185025  1603 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:43.185066  1676 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
W20260709 13:02:43.192178  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.110944  8228 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:02:43.190124  1534 rpcz_store.cc:276] 0709 13:02:42.137161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.411345 (+274184us) service_pool.cc:224] Handling call
0709 13:02:42.411673 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.596500 (+184827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.596534 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.667883 (+ 71349us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.867542 (+199659us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:42.880323 (+ 12781us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.983280 (+102957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.983353 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.175793 (+192440us) raft_consensus.cc:1685] finished
0709 13:02:43.175819 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.175996 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19236,"prepare.queue_time_us":16439,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":5892,"raft.queue_time_us":331733,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":12683,"thread_start_us":418383,"threads_started":3,"wal-append.queue_time_us":244931}
I20260709 13:02:43.144682  8237 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:43.177922  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123126us
I20260709 13:02:43.090019  8064 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:43.183162  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 202302us
I20260709 13:02:43.212482  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.213848  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:43.195263  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.215799  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1436) took 1344 ms. Trace:
I20260709 13:02:43.216177  1530 rpcz_store.cc:276] 0709 13:02:41.871788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.871914 (+   126us) service_pool.cc:224] Handling call
0709 13:02:42.574039 (+702125us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:02:43.215589 (+641550us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540008d9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:43.215718 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388836096}
I20260709 13:02:43.217605  1531 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:43.211356  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.208520  1534 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:43.220412  8260 consensus_queue.cc:1059] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:43.206730  8253 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.223009  8253 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.225183  8106 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.225728  1528 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:02:43.226403  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3200) took 1089 ms. Trace:
I20260709 13:02:43.226732  1528 rpcz_store.cc:276] 0709 13:02:42.137403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.663861 (+526458us) service_pool.cc:224] Handling call
0709 13:02:42.664324 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.225478 (+561154us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001561a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aa8dc0 00007f7e63b331c0 00007f7e63b34231 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c
0709 13:02:43.226113 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.226344 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300404096}
I20260709 13:02:43.227815  8237 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.229297  8223 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:43.229734  8223 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:43.226749  8064 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.230521  8223 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.231060  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.231871  8118 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.203029  8099 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.232292  8118 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.218928  1533 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:43.234840  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.235585  1534 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:43.237552  7903 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.238839  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1444) took 1300 ms. Trace:
I20260709 13:02:43.239205  2253 rpcz_store.cc:276] 0709 13:02:41.938030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.939453 (+  1423us) service_pool.cc:224] Handling call
0709 13:02:43.238673 (+1299220us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54004c4854. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:43.238784 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175870208}
I20260709 13:02:43.239646  7903 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.240540  8118 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.192957  8258 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.243834  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.244766  8258 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.247686  8119 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.240585  8176 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:43.248853  8176 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:43.249212  7925 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:43.194881  8067 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.249744  8176 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.251705  8255 raft_consensus.cc:3055] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:43.252125  8255 raft_consensus.cc:740] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.253302  8069 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:43.253003  8255 consensus_queue.cc:260] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.253578  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.253968  8069 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.231550  8223 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.254324  8255 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.218842  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:43.270862  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52079.3us
I20260709 13:02:43.272714  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.276083  1674 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:43.278425  1574 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:43.281601  8222 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:43.283154  8261 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:43.283423  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:43.284483  8258 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:43.232594  8099 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.286149  8258 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:43.286455  7975 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:43.287004  7975 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.283968  8222 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.287958  7975 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.289002  8261 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.289286  8062 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.289819  8062 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.290057  8261 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.292289  8062 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.294047  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:43.294605  8258 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:43.294884  8136 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:43.295493  8136 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.296391  8136 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.296572  8118 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.300433  8106 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.301910  8118 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.305130  1677 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:43.251798  8067 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.280946  7925 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.309516  1532 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:43.316279  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.321518  1676 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:43.336362  8263 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:43.328425  8067 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.338176  8067 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.338641  1529 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:43.284570  8069 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.328662  7925 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.341423  7925 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.278290  8007 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.342631  8007 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.343003  8007 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.287139  8099 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.347580  8249 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:43.325961  8118 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.348783  8118 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.350936  8118 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.351711  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.355052  1680 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:43.370510  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:43.384824  2252 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.370118  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:43.385959  2258 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.370411  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:43.354558  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.307251  8140 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.352596  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:43.398540  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 425122us
I20260709 13:02:43.348132  8249 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:43.409298  2258 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:43.414654  2252 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:43.352214  8255 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:43.419921  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.424113  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.424822  1608 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.425065  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.425868  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.426021  1600 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:43.428531  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.428591  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.429832  1607 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:43.436615  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:43.440595  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.446869  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.451448  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.454077  1607 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:02:43.447834  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.463999  1603 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.462146  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.463749  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.442289  8140 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:43.419340  8264 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:43.525142  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61490.1us
I20260709 13:02:43.527107  1526 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:43.531484  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 2999) took 1423 ms. Trace:
I20260709 13:02:43.447786  7953 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:43.540649  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.541397  1681 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.542325  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.531838  1526 rpcz_store.cc:276] 0709 13:02:42.107623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.111790 (+  4167us) service_pool.cc:224] Handling call
0709 13:02:43.526720 (+1414930us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:02:43.526924 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.531125 (+  4201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.531424 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36312832}
I20260709 13:02:43.544086  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.545074  1526 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.546649  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:43.547709  1647 leader_election.cc:336] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.606s (SENT)
I20260709 13:02:43.548391  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:43.537963  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.495121  8255 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:43.556597  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:43.559298  1680 raft_consensus.cc:606] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:43.559695  1680 raft_consensus.cc:614] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:43.560770  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.562184  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:43.568919  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.570055  1603 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.572058  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.535988  8169 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:43.529063  8140 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:43.576359  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.557070  8230 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.580546  1675 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.582082  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:43.553158  7953 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:43.556075  8257 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.558336  8264 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:43.572058  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.587244  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.561507  8106 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.597227  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.598516  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.599534  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.604329  8268 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:43.604766  1527 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:43.604971  8268 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.606755  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3212) took 1431 ms. Trace:
I20260709 13:02:43.607333  8268 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.607138  1527 rpcz_store.cc:276] 0709 13:02:42.175520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.061937 (+886417us) service_pool.cc:224] Handling call
0709 13:02:43.604593 (+542656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.605163 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.606575 (+  1412us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54000d48d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:43.606692 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247228288}
I20260709 13:02:43.609297  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.610909  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.611934  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.612470  1528 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:43.613232  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.613881  1528 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 22: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:43.614208  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1443) took 1678 ms. Trace:
I20260709 13:02:43.614631  2255 rpcz_store.cc:276] 0709 13:02:41.935454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.935760 (+   306us) service_pool.cc:224] Handling call
0709 13:02:41.941640 (+  5880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.990721 (+ 49081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.990755 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.991320 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.189935 (+198615us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:42.189980 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.613780 (+1423800us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b54004eaa54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:43.613832 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.613917 (+    85us) raft_consensus.cc:1685] finished
0709 13:02:43.613935 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.614148 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14215,"spinlock_wait_cycles":86186880,"thread_start_us":120657,"threads_started":1,"wal-append.queue_time_us":355368,"wal-append.run_cpu_time_us":2141,"wal-append.run_wall_time_us":1118912}
I20260709 13:02:43.605237  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.609042  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.609541  8231 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:43.616707  1498 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:43.617410  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.648078  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.614625  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:43.630301  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.575928  8157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.011s	sys 0.009s
I20260709 13:02:43.649410  1527 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:43.650663  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 197966us
I20260709 13:02:43.583556  8140 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:43.551458  8240 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:43.671677  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.671994  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 55388.1us
I20260709 13:02:43.586313  7953 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:43.672022  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:43.661917  8157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.012s	sys 0.010s
I20260709 13:02:43.666157  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.622800  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.662400  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.674100  1680 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:43.647204  8237 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.684901  1527 raft_consensus.cc:2410] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:43.647524  8119 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.648476  8231 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:43.679795  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.648718  8169 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.717275  1680 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:43.720594  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:43.721412  2256 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:02:43.722154  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 56085.4us
I20260709 13:02:43.675230  7975 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:43.674394  8099 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:43.718307  1677 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.674871  8252 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.674279  8062 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:43.724021  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.795277  1527 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:43.795142  8062 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.796286  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.797389  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.798067  1527 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:43.798727  8062 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.744275  8067 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:43.760970  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.761179  8064 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:43.802000  8064 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:43.802923  8064 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:43.804023  8223 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.000s
I20260709 13:02:43.722782  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.804497  8283 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.805279  7925 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:43.823067  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:43.810066  8134 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:43.648554  8106 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:43.761250  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 81543.4us
I20260709 13:02:43.843922  2255 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:43.844336  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.777181  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:43.846643  1674 raft_consensus.cc:606] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.847020  1674 raft_consensus.cc:614] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:43.784283  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.790370  1679 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:43.778033  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:43.786180  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.821533  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.849921  1600 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:43.763933  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.829977  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.820647  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:43.833122  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.850557  1526 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:43.826038  1528 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:02:43.806325  8240 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.838873  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:43.851960  2252 raft_consensus.cc:2368] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17.
I20260709 13:02:43.840354  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.840555  1607 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:43.841198  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.790591  1680 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.854997  1680 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:43.856873  2252 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:43.857290  2260 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:02:43.768849  8247 raft_consensus.cc:993] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: : Instructing follower 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:43.781296  8009 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:43.869266  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.570497  8136 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.178s
I20260709 13:02:43.723796  8119 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.837256  7925 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.884258  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:43.855167  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:43.790978  1424 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.724814  8161 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:43.886443  1424 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 13 to 15, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.863660  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:43.866139  8269 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:43.852710  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:43.759567  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.883765  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.899459  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:43.863577  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:43.783136  8233 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:43.900718  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:43.901086  8106 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.776571  7975 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.901620  8258 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:43.902333  1526 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:43.899509  1603 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:43.777019  8099 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.888376  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.891176  1679 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.843590  8134 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:43.895347  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:43.895990  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51777.3us
I20260709 13:02:43.897188  1424 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 17, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:43.905485  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:43.915333  2254 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:43.915359  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:43.903993  7975 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:43.917575  1680 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:02:43.906240  2259 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:43.906858  2258 raft_consensus.cc:2410] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:43.723971  8237 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.930368  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:43.925925  1424 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:43.893312  8213 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:43.673273  8268 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:43.869668  8066 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.905952  8221 raft_consensus.cc:2764] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:43.865109  2252 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:43.951086  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.869586  8009 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:43.889395  7925 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:43.904214  8274 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:02:43.896450  8260 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.912284  1675 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:43.889699  8161 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.941439  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.932583  1424 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:43.963212  2254 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:43.943987  1679 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:43.965068  1674 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:43.836774  8283 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.678925  8250 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.952270  2252 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:43.952096  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:43.792222  8264 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.960774  1533 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:43.949383  8106 raft_consensus.cc:1081] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Signalling peer 428f0180c2cd487c8b48e91f14dff65d to start an election
I20260709 13:02:43.869489  8231 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.938299  8268 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.966849  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.904099  8278 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:02:43.939289  8222 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:43.970672  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.957968   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:43.958259  8066 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:43.946290  8223 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:43.978641  1676 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:43.942236  8213 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:43.981256  1648 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.015s	sys 0.029s
I20260709 13:02:43.982218  8283 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:43.982079  8009 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.002085  8009 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:43.973431  2259 raft_consensus.cc:2410] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:43.967016  1424 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 11 to -1, term changed from 17 to 19, leader changed from <none> to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) evicted, now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:43.991350  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:43.963577  8070 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.984560  8268 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:43.999920  1533 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:02:43.999384  1648 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.029s
I20260709 13:02:44.003696  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:44.007349  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.011296  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 577967us
W20260709 13:02:44.013202  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.014032  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.008343  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 113120us
I20260709 13:02:44.019275  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.019984  2252 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:44.020960  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.017527  1424 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 19, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.016098  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:44.024238  1527 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:43.997992  8222 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:44.003985  8231 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.030953  1424 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 17, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:44.025321  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:44.035454  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.003206  8223 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:44.038722  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.007603  8070 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.039726  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.039534  1424 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.040529  2252 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:43.975709  8161 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:43.979753  8169 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.042688  1424 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 21 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.057024  7925 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:43.983419  8134 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.058298  1424 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 10 to 13, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:02:44.059907  1424 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 12 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.061775  2254 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:44.041553  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.062319  8099 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.043262  1648 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.038277  8236 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:44.036933  8062 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.043041  8260 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:44.054260   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:44.055841  2252 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
W20260709 13:02:44.052881  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.068660  1424 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:44.065910  8272 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:44.038519  8136 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:02:44.075299  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 222671us
W20260709 13:02:44.066184  8277 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 13:02:44.066493  8282 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:44.074885  8267 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:44.074764  2252 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 13
I20260709 13:02:44.070909  8025 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.051723  8070 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.077133  8260 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.053305  8253 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.075106  8295 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:44.087762  2252 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:02:44.100080  2252 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.080410  1424 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.066023  8284 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.068751  8236 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:44.066150  8291 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:44.086078  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.075973  8119 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.135066  1676 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:44.063423  8066 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.101917  1424 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 18 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.097175  8260 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:44.107383  8281 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:02:44.091032  8288 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:02:44.128611  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:44.109265  8289 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:02:44.129845  8236 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:44.155738  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.156498  2257 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 10.
I20260709 13:02:44.156970  2252 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:02:44.130096  8007 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.003s
I20260709 13:02:44.142563  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:44.131184  8136 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:02:44.144683  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46846.8us
I20260709 13:02:44.158133  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.160356  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:44.163916  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.164494  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:44.133227  8237 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.165648  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:44.166242  2257 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.167723  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:44.167613  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:44.172124  1676 raft_consensus.cc:2376] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16. Re-sending same reply.
I20260709 13:02:44.173250  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:44.166113  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.128655  7903 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:44.187844  1679 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:02:44.198279  2252 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:44.186772  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.208328  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3539) took 1050 ms. Trace:
I20260709 13:02:44.190788  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:44.211347  1604 rpcz_store.cc:276] 0709 13:02:43.157888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.162706 (+  4818us) service_pool.cc:224] Handling call
0709 13:02:43.162969 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.163316 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.163342 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.163813 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.384142 (+220329us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:43.384187 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.384273 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.207946 (+823673us) raft_consensus.cc:1685] finished
0709 13:02:44.207967 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.208229 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":219958,"threads_started":1,"wal-append.queue_time_us":762646}
W20260709 13:02:44.209136  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48439.6us
I20260709 13:02:44.213795  1676 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:44.214998  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:44.212865  2257 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:44.133823  8254 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:02:44.095453  8223 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.218178  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.231904  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.214824  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.093053  8222 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.189316  8300 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:02:44.233099  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.160264  8136 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:44.164947  8026 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:44.206739  8240 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.138213  8284 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.213635  8106 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:44.208738  8233 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.239631  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.240339  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:44.268584  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.269243  1679 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:44.241966  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.269732  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3010) took 1343 ms. Trace:
I20260709 13:02:44.234994  8221 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.217163  8119 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:44.258828  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46271.1us
I20260709 13:02:44.255867  8178 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:44.227440  8227 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:44.136803  8291 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.241777  8302 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:02:44.270354  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.207454  8099 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:44.224485  8297 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:02:44.279130  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:44.265856  8298 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:44.166965  8007 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.277673  8119 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.310099  8119 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:44.312054  7953 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.000s
W20260709 13:02:44.288281  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 87086.1us
I20260709 13:02:44.331647  7953 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.272022  8230 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.334952  7953 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.277788  8253 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:44.291035  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 220275us
I20260709 13:02:44.294803  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:44.283598  1530 rpcz_store.cc:276] 0709 13:02:42.926662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.217147 (+290485us) service_pool.cc:224] Handling call
0709 13:02:43.229056 (+ 11909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.229358 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:43.229641 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.557645 (+328004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.573479 (+ 15834us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.574685 (+  1206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:43.574751 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.574851 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.269513 (+694662us) raft_consensus.cc:1685] finished
0709 13:02:44.269532 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.269678 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2710,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1109,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":8715,"thread_start_us":327445,"threads_started":1,"wal-append.queue_time_us":487869}
I20260709 13:02:44.336890  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:44.337275  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.302031  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.284087  8067 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:44.339835  8178 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:44.340194  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.340497  8178 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:44.309561  8227 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.289636  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:44.345983  8169 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.347625  8169 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:44.315634  8296 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:02:44.292752  8240 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:44.326637  2257 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
I20260709 13:02:44.285499  8213 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.262032  8026 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.359496  8026 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.349474  2260 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:44.361334  2260 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:44.362579  2260 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:44.335821  8253 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:44.364789  8253 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.366164  8253 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.296440  8099 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.369386  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.375327  1530 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
W20260709 13:02:44.384704  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.392904  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.393392  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:44.276134  8233 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.399967  1609 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:44.396955  1681 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:44.397070  1530 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:44.450260  1534 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:02:44.453497  8106 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:44.454439  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1434) took 2590 ms (client timeout 3326 ms). Trace:
I20260709 13:02:44.454140  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.457510  8106 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.457324  8268 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.462906  2252 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:02:44.455082  1532 rpcz_store.cc:269] 0709 13:02:41.859430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.859541 (+   111us) service_pool.cc:224] Handling call
0709 13:02:42.115921 (+256380us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ceee 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:02:43.211269 (+1095348us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cf8c 00007f7e60a0cef6 0000000000375939 00007f7e68a801e0 00007f7e68b490c4 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:02:44.449848 (+1238579us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54002ccc54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.450006 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143524224}
I20260709 13:02:44.468629  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:44.469084  8140 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.006s
I20260709 13:02:44.469636  8140 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.470034  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.470808  1532 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:44.471948  8140 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.471987  1532 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:44.475069  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3016) took 1130 ms. Trace:
I20260709 13:02:44.475512  1532 rpcz_store.cc:276] 0709 13:02:43.344647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.471548 (+1126901us) service_pool.cc:224] Handling call
0709 13:02:44.471835 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.474799 (+  2964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.475009 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:44.477221  1681 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:44.478547  1530 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:44.434949  8240 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:44.316577  8136 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:44.485050  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 146312us
I20260709 13:02:44.488699  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.398597  8312 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.152s
I20260709 13:02:44.508051  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:44.510344  2255 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:44.431282  8070 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.521888  8314 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:44.523743  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1454) took 1217 ms. Trace:
I20260709 13:02:44.524153  2253 rpcz_store.cc:276] 0709 13:02:43.306360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.306497 (+   137us) service_pool.cc:224] Handling call
0709 13:02:43.330987 (+ 24490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.331307 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.331332 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.163006 (+831674us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:02:44.163376 (+   370us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.281447 (+118071us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.281487 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.283256 (+  1769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.523375 (+240119us) raft_consensus.cc:1685] finished
0709 13:02:44.523396 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.523598 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13788,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":53845760,"thread_start_us":47033,"threads_started":1,"wal-append.queue_time_us":184551}
I20260709 13:02:44.527269  8254 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:44.527736  8254 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:44.528539  8254 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.529528  8254 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.530988  8007 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.536545  8240 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.540199  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.550640  2259 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:44.551537  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.559374  1526 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:44.561046  1526 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:02:44.562263  1526 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:44.482728  8260 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.565353  8260 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:44.565493  8009 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 13:02:44.566206  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:44.566565  8236 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.567773  8284 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.567929  1677 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:44.569713  8236 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.572794  8233 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.574569  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3218) took 1787 ms. Trace:
I20260709 13:02:44.575021  1531 rpcz_store.cc:276] 0709 13:02:42.786739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.066876 (+280137us) service_pool.cc:224] Handling call
0709 13:02:43.217439 (+150563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.218272 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.574382 (+1356110us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540008d9d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.574512 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345672960}
I20260709 13:02:44.553256  8026 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:44.578148  1531 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:44.579197  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:44.580672  2252 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:44.581667  2252 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:44.549954  8025 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.517494  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.557360  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:44.586767  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1455) took 1280 ms. Trace:
I20260709 13:02:44.578218  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3224) took 1338 ms. Trace:
I20260709 13:02:44.589769  1534 rpcz_store.cc:276] 0709 13:02:43.240152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.252760 (+ 12608us) service_pool.cc:224] Handling call
0709 13:02:44.450009 (+1197249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.450774 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.578035 (+127261us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002ccc50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.578152 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752540544}
I20260709 13:02:44.587471  2256 rpcz_store.cc:276] 0709 13:02:43.306663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.313790 (+  7127us) service_pool.cc:224] Handling call
0709 13:02:43.314211 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.770901 (+456690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.586480 (+815579us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54003a1e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:44.586701 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935914240}
I20260709 13:02:44.593150  8242 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:02:44.596140  8019 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:44.601511  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.601936  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.602272  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.611011  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.616075  2227 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.574548  8070 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.613997  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:44.620136  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:44.600383  8019 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:44.626192  8019 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:44.625583  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:44.628721  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.623577  8119 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:44.624753  8305 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:02:44.639344  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.641510  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.626818  8106 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:44.643126  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:44.665913  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.637027  8009 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:44.645128  8035 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:44.597014  8026 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:02:44.647626  1574 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:44.640725  8242 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:44.640900  8070 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.654506  8119 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.625196  8309 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:44.655524  8099 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.637584  8311 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.619124  8249 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.658334  8250 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:44.631225  8260 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:02:44.669763  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.673286  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.627242  8295 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:44.669783  8284 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:44.668929  8035 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:44.692656  8035 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.693249  8316 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:44.675509  8007 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:44.698959  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3018) took 1353 ms. Trace:
I20260709 13:02:44.699426  1530 rpcz_store.cc:276] 0709 13:02:43.345246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.482784 (+1137538us) service_pool.cc:224] Handling call
0709 13:02:44.515426 (+ 32642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.515853 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.515910 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.516716 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.630952 (+114236us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:44.631001 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.631065 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.698691 (+ 67626us) raft_consensus.cc:1685] finished
0709 13:02:44.698714 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.698880 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":77458,"threads_started":1,"wal-append.queue_time_us":161935}
I20260709 13:02:44.700661  8268 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:44.671474  8312 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:44.678013  8309 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.698634  8242 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:44.688953  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:44.680351  8213 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:02:44.721578  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.709321  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3113) took 1126 ms. Trace:
I20260709 13:02:44.673846  8224 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:02:44.678393  8250 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:44.724269  1675 rpcz_store.cc:276] 0709 13:02:43.582560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.962316 (+379756us) service_pool.cc:224] Handling call
0709 13:02:43.962623 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.971134 (+  8511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.971167 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.971622 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.087017 (+115395us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.087055 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.087124 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.698441 (+611317us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b240022b038. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a82fb0 00007f7e636f9488 00007f7e636f9be8 00007f7e636d1398 00007f7e636cc76a 00007f7e636cbbb6
0709 13:02:44.701316 (+  2875us) raft_consensus.cc:1685] finished
0709 13:02:44.701339 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.709245 (+  7906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10344,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4409,"spinlock_wait_cycles":7812864,"thread_start_us":115124,"threads_started":1,"wal-append.queue_time_us":168790}
I20260709 13:02:44.722594  8284 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:44.731743  8284 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.732715  8260 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:44.734007  8328 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:44.708788  8007 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:44.707074  8264 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:44.737020  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 3203) took 2598 ms (client timeout 1993 ms). Trace:
I20260709 13:02:44.738108  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1347) took 1313 ms. Trace:
I20260709 13:02:44.735512  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.742929  1609 rpcz_store.cc:276] 0709 13:02:43.424300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.424702 (+   402us) service_pool.cc:224] Handling call
0709 13:02:44.737915 (+1313213us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400027454. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.738048 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126487808}
W20260709 13:02:44.740458  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63844us
I20260709 13:02:44.734584  8321 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:44.746394  8321 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:44.747205  8321 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.749465  8007 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.737039  8253 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:44.725136  8295 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:44.752542  8253 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:44.753379  8253 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.743688  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:44.745414  8250 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.741418  7953 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:44.741843  1529 rpcz_store.cc:269] 0709 13:02:42.138176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.147936 (+  9760us) service_pool.cc:224] Handling call
0709 13:02:43.243666 (+1095730us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:02:44.736807 (+1493141us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b5400304dd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.736947 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226296064}
W20260709 13:02:44.759478  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.759296  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.735242  8066 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.760167  2257 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:44.770592  8233 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.771227  8233 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.773120  7614 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.773500  8233 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.774004  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.774435  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.774681  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:44.775269  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:44.775904  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.773553  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.774746  1529 raft_consensus.cc:2393] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:44.777067  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3229) took 1531 ms. Trace:
I20260709 13:02:44.761317  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:44.778034  2257 raft_consensus.cc:2410] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:44.780684  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3107) took 1221 ms. Trace:
I20260709 13:02:44.780689  1527 rpcz_store.cc:276] 0709 13:02:43.245904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.807146 (+561242us) service_pool.cc:224] Handling call
0709 13:02:43.807503 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.024790 (+217287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.776836 (+752046us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000d43d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:44.777012 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497840000}
I20260709 13:02:44.784812  1530 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 11: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:44.785573  2252 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:44.781380  1674 rpcz_store.cc:276] 0709 13:02:43.559582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.880225 (+320643us) service_pool.cc:224] Handling call
0709 13:02:43.964866 (+ 84641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.965451 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.780468 (+815017us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54003b9cd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.780618 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113231616}
W20260709 13:02:44.798631  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.829866  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.829617  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:44.757448  8253 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.761384  8035 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.831840  2254 raft_consensus.cc:2410] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:44.752565  8264 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:44.833485  2257 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
W20260709 13:02:44.831578  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 103982us
W20260709 13:02:44.778424  8247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.012s	sys 0.012s
I20260709 13:02:44.786274  7925 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.761173  7953 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:44.838781  2257 pending_rounds.cc:85] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 14
I20260709 13:02:44.850719  2257 pending_rounds.cc:107] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 19.15
W20260709 13:02:44.851150  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.851298  2257 raft_consensus.cc:2889] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.852392  8140 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:44.853330  2257 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:02:44.853008  8140 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.773618  7614 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:44.856932  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.858510  7614 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.862314  8309 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:44.864967  8249 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.864584  7953 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.865815  7953 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:44.866726  8264 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.868204  1525 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:44.850697  8019 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:44.870486  8019 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:44.868088  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 3228) took 1622 ms (client timeout 1690 ms). Trace:
W20260709 13:02:44.848855  8247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.012s	sys 0.012s
W20260709 13:02:44.872005  1533 rpcz_store.cc:269] 0709 13:02:43.245625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.604914 (+359289us) service_pool.cc:224] Handling call
0709 13:02:44.867907 (+1262993us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54001abb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:44.868029 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716210560}
W20260709 13:02:44.899088  8340 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:44.915169  8316 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:44.917514  8067 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:44.918016  8067 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:44.923664  8337 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:44.856196  8295 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:44.928077  8035 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:44.929418  8070 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.940641  8007 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:44.940960  8345 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.932533  8066 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.944643  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:44.949502  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.951119  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:44.951644  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:44.952292  1533 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.955440  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:44.956000  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:44.956152  1527 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:44.952235  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:44.957688  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:44.957894  1528 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.954519  1608 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:44.976738  1533 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:44.942507  8007 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:44.991156  2261 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:44.993425  1526 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:44.994176  1609 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:44.993474  1528 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:45.001453  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.002550  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.011667  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:45.022006  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:44.992573  8325 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.022809  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:44.985289  8007 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:45.025260  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.027788  1528 raft_consensus.cc:2376] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20. Re-sending same reply.
I20260709 13:02:45.025874  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:44.971261  8213 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:02:45.014039  7614 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.036814  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:45.042064  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.042662  1530 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:45.026749  8321 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.056852  8320 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:45.057610  8320 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:45.058988  2259 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:45.058614  8320 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.060268  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:45.061347  8346 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:02:45.061810  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:45.063153  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:45.063321  1573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.163s (SENT) [suppressed 27 similar messages]
I20260709 13:02:45.066419  8134 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.036334  8325 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.073148  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1737) took 1153 ms. Trace:
I20260709 13:02:45.073630  2255 rpcz_store.cc:276] 0709 13:02:43.920204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.356996 (+436792us) service_pool.cc:224] Handling call
0709 13:02:44.357375 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.510823 (+153448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.072880 (+562057us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540039c6d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:45.073082 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351354112}
I20260709 13:02:45.076156  1526 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:45.028990  8308 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:45.079973  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:45.112149  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.112877  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:45.114317  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77568us
I20260709 13:02:45.086355  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:45.092031  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.092891  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.076915  8007 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.119168  2254 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:45.119462  1526 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:45.118037  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:45.125448  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:45.045492  8140 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:45.133456  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.132938  2255 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:45.112612  8119 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.132408  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.135432  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:45.136328  2254 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:45.040361  8306 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:02:45.136238  1526 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:02:45.078184  8321 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:45.111387  8264 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.139366   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:45.146055  1526 pending_rounds.cc:85] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 12
I20260709 13:02:45.149255  1526 pending_rounds.cc:107] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:02:45.149506  1526 raft_consensus.cc:2889] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.142509  1528 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:45.133000  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.176847  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.148550  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.148546  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:45.125803  8035 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:45.119194  8012 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:45.124541  8308 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:45.245632  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 112690us
I20260709 13:02:45.382759  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.387817  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.388549  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1464) took 1300 ms. Trace:
I20260709 13:02:45.388968  2258 rpcz_store.cc:276] 0709 13:02:44.087897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.671962 (+584065us) service_pool.cc:224] Handling call
0709 13:02:44.679004 (+  7042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.679201 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:44.680751 (+  1550us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.054231 (+373480us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b1800432be0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:02:45.386784 (+332553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.386841 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:45.386899 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.388360 (+  1461us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.388489 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6033,"prepare.queue_time_us":920,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":18940288,"thread_start_us":197472,"threads_started":1}
I20260709 13:02:45.138675  7614 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.201s
I20260709 13:02:45.397017  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:45.400048  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 336722us
W20260709 13:02:45.251312  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.252661  8012 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:45.317703  8347 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.322535  8350 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:02:45.146195  8321 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.236771  8007 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:45.147306  8316 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.136584  7962 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.381650  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 233159us
I20260709 13:02:45.414315  1647 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:45.236979  8119 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.146445  8264 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:45.466321  8353 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:45.469064  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.387458  8035 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:45.478966  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.438062  8355 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:02:45.412510  8224 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.416870  8344 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.395568  8268 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:45.433759  8176 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:45.432826  8316 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:45.508965  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:45.513096  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 130594us
I20260709 13:02:45.481271  7925 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.492462  7583 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:45.436197  8252 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:02:45.527369  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.482326  8263 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.525812  7583 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:45.532152  8309 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.532673  8262 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.532913  8263 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.533238  8262 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.533560  8306 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:45.535413  8262 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:45.532215  7583 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:45.538245  8119 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.538806  8324 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:45.536453  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.540848  7975 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:45.541280  1528 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:45.542317  8263 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.542743  7975 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:45.543198  7975 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:45.513743  7953 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.000s
I20260709 13:02:45.536530  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3014) took 2231 ms. Trace:
I20260709 13:02:45.475811  8247 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 13:02:45.480782  7962 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.553570  1525 rpcz_store.cc:276] 0709 13:02:43.305151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.903349 (+598198us) service_pool.cc:224] Handling call
0709 13:02:44.868030 (+964681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.868647 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.536162 (+667515us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54001abb50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:45.536465 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217843584}
I20260709 13:02:45.555117  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:45.508821  8325 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.556557  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.560825  1608 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:45.515146  8316 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.513746  8295 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:45.532243  8293 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.290s	user 0.005s	sys 0.001s
I20260709 13:02:45.525983  8012 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.529219  8140 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:45.532614  8309 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:45.573913  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 159693us
I20260709 13:02:45.574934  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.585088  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 103208us
I20260709 13:02:45.562258  8119 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.533279  8240 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:45.581532  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.569923  7903 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.569350  7953 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:45.618613  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.436991  8347 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.574401  8309 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.635627  1525 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:45.644356  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114175us
I20260709 13:02:45.645238  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:45.585582  8257 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:45.644446  1525 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:45.585633  8342 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.582398  7614 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.650095  1525 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.652817  7962 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.649649  7953 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:45.654978  8067 consensus_meta.cc:287] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.005s
I20260709 13:02:45.635867  8119 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.661871  8250 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:45.702726  7614 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.709463  7953 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.662129  8257 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.664453  8295 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:45.713763  7614 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.665791  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:45.666450  8311 raft_consensus.cc:1064] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:02:45.666887  8316 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.509521  8308 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:45.716457  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50752.1us
I20260709 13:02:45.698966  1525 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.636009  7903 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.717338  8347 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.717687  7903 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.718343  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.717604  8119 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.720283  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.720192  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.720646  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.701825  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.720664  7953 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:45.721895  1608 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:45.563216  7975 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.721522  1603 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:02:45.724123  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.725574  7953 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:45.725576  8352 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:02:45.728946  8025 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.729598  8025 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.668758  8367 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.732791  8367 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.733471  8311 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.734099  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:45.734921  8119 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.735087  8367 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.707590  8067 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.735366  8119 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.735870  8119 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.736526  2253 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:45.737180  8067 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.723356  1608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:49526
I20260709 13:02:45.738485  1608 raft_consensus.cc:476] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Not starting forced leader election -- already a leader
I20260709 13:02:45.738685  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:45.739877  8136 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:45.740450  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.741472  1527 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:45.741811  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:45.742568  8178 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:45.742406  7583 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.742990  8178 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.743031  8025 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.743449  8178 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.697935  8263 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:02:45.741192  1600 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 15: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:45.706151  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.565048  8035 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.714296  8371 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.724169  7975 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.671592  8140 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.635437  8012 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.749544  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:45.673441  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54924.6us
I20260709 13:02:45.636128  8262 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:45.758692  1600 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:45.699267  8370 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.767459  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.767725  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.770956  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:45.775697  2227 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.794914  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.797027  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.817250  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:45.817781  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.827126  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:45.834889  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:45.835990  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:45.836218  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.837280  1603 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:45.848909  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.851135  1525 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:45.859107  1525 pending_rounds.cc:85] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 13
I20260709 13:02:45.860714  1525 pending_rounds.cc:107] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:45.860980  2227 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:45.795523  8342 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.825582  8257 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.857436  7925 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.820850  8067 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.866197  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:45.863528  1525 raft_consensus.cc:2889] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.864965  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:45.870850  2259 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 11.
I20260709 13:02:45.825865  8009 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.825018  7583 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:45.876976  1532 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:45.858464  8325 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:45.795351  7903 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.857904  8373 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:45.864022  8324 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.867074  8257 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:45.872555  7614 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:45.883332  8157 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:02:45.770681  8371 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:45.889864  8134 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.005s
I20260709 13:02:45.881347  8325 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:45.905974  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.910109  1534 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:45.873904  8369 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:02:45.900206  8324 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.871387  8342 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.915474  8368 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.925169  7903 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:45.925689  8240 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:45.889521  7925 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
W20260709 13:02:45.929543  8359 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:02:45.929842  8178 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:45.898788  8257 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:45.935530  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:45.939462  8264 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:45.942731  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:45.947712  8337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.009s	sys 0.038s
I20260709 13:02:45.953938  8371 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:45.957476  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.959174  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1731) took 2094 ms (client timeout 2162 ms). Trace:
W20260709 13:02:45.962882  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.912642  8325 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.974932  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.010654  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.011364  1531 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:45.975297  7925 consensus_queue.cc:1243] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:02:46.019326  8250 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.019855  8250 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.021061  8223 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.021875  8250 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.022291  8134 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.022799  8134 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:45.994375  1528 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:45.995142  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.024711  8134 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.024978  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.025161  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.026029  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:45.996359  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:45.997486  1602 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:45.998030  1605 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:45.891850  8373 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.000808  8178 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.002086  8169 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.003859  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:46.004793  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:46.032841  1534 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.905977  8321 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.006137  8309 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.008766  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.008567  8119 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:45.992646  2261 rpcz_store.cc:269] 0709 13:02:43.864784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.883988 (+ 19204us) service_pool.cc:224] Handling call
0709 13:02:45.959017 (+2075029us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005131d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:45.959120 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428940160}
W20260709 13:02:45.992290  8337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.009s	sys 0.038s
I20260709 13:02:45.970224  8368 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.021589  8223 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.026160  1601 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.995584  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:45.919220  8370 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.032178  1533 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:46.034866  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.034068  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.054278  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
W20260709 13:02:46.054144  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50370.2us
I20260709 13:02:46.044973  1528 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:46.049751  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.055862  1602 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:02:46.002025  8257 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.058728  1677 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:46.059888  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:45.998705  8316 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.069613  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.065517  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.070550  1678 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:46.066582  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:46.067613  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.072207  1682 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:46.072083  1676 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.068166  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:46.069048  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 73527.4us
I20260709 13:02:46.075037  1609 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.076438  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.078428  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.050073  8261 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.079016  1528 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:46.075253  8283 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:46.082406  1683 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:46.086596  1679 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:46.087261  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:46.085922  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.093986  2261 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
W20260709 13:02:46.106412  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.048085  8176 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:02:46.096315  8283 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:46.113442  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.113806  8255 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:46.114748  8283 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:46.120561  8310 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.120793  8369 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:46.121199  8310 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.122574  1674 raft_consensus.cc:2410] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:02:46.108215  8306 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.092723  8308 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.132195  8136 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:46.132714  8134 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.133075  7614 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.082367  8377 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.076391  8226 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.074302  8370 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.083369  7925 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:46.082221  8367 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:46.143399  8268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.014s	sys 0.010s
I20260709 13:02:46.165179  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:46.178283  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.141810  8378 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:46.178938  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65552.8us
I20260709 13:02:46.096122  8261 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.177043  1676 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:46.144547  8369 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.164445  8382 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:02:46.166065  8007 consensus_meta.cc:287] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
W20260709 13:02:46.177693  8268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.015s	sys 0.011s
I20260709 13:02:46.164532  8377 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.228359  1601 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:46.177877  8367 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.211705  8379 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:02:46.215397  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 354445us
W20260709 13:02:46.220923  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.245972  1500 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.201020  8136 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:46.225525  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:46.150668  8250 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:02:46.200778  7953 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.251617  1534 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:46.068439  8169 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.212958  8369 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:46.246031  8252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.013s
I20260709 13:02:46.153909  8306 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.255965  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:46.247136  8377 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.169440  8134 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.153611  8308 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.259385  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.259975  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.279290  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.226262  8223 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.260927  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.261561  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:46.268990  8252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.000s	sys 0.014s
I20260709 13:02:46.261886  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:46.285620  2253 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:46.164296  7614 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.178016  8226 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.241923  8321 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.227221  8268 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:46.264501  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:46.228379  8295 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:46.310137  8374 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:02:46.310288  8295 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.311525  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3145) took 1804 ms. Trace:
W20260709 13:02:46.267971  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.250772  8367 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.255213  8062 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.255693  8136 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.261749  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:46.256464  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.253931  8035 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.262396  8178 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:46.260560  8157 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.322455  8157 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:46.274003  7975 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 13:02:46.293646  8373 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.294989  8261 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.284195  8019 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:46.300714  1526 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:46.302814  8226 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.306842  2259 raft_consensus.cc:2376] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11. Re-sending same reply.
I20260709 13:02:46.311868  1681 rpcz_store.cc:276] 0709 13:02:44.506890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.511093 (+  4203us) service_pool.cc:224] Handling call
0709 13:02:44.541399 (+ 30306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.555356 (+ 13957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.555387 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.534434 (+979047us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b2c0012ecf8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:02:45.534892 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.757486 (+222594us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:45.757528 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.757608 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.311046 (+553438us) raft_consensus.cc:1685] finished
0709 13:02:46.311079 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.311460 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":394,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6474,"spinlock_wait_cycles":66153728,"thread_start_us":222189,"threads_started":1,"wal-append.queue_time_us":333744}
I20260709 13:02:46.317296  1601 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:46.292416  8119 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.264438  7953 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:46.332886  1602 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:46.337077  8134 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.312662  8342 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.324221  8035 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.317183  8136 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.338332  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3017) took 2993 ms. Trace:
I20260709 13:02:46.363335  1532 rpcz_store.cc:276] 0709 13:02:43.344960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.476411 (+1131451us) service_pool.cc:224] Handling call
0709 13:02:44.479518 (+  3107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.877438 (+1397920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.338077 (+460639us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000b4ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:46.338272 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213358464}
I20260709 13:02:46.339964  1531 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:46.342851  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.351476  8252 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.309468  8169 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.359273  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:46.347128  8067 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.366016  1531 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:46.374122  1531 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:46.383015  1601 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:46.396165  8369 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.397387  8367 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.338016  8295 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.340384  8178 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:46.411372  2258 raft_consensus.cc:1240] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:46.370515  8012 consensus_meta.cc:287] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.007s
I20260709 13:02:46.358316  7614 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.320010  8062 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.361588  8019 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:46.408247  8387 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:46.408682  8252 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.426980  8370 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.408818  8325 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.464943  8283 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:46.467725  8140 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.001s
I20260709 13:02:46.468667  8377 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.574010  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:46.469801  8035 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:46.470330  8306 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.471941  7953 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.476094  8308 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.424445  8268 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.487329  8230 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:46.490010  8136 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:46.499689  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 216864us
I20260709 13:02:46.572777  8325 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.551192  8309 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.501286  8391 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:46.512554  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.516798  8393 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.587327  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:46.524840  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.530601  8278 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:46.537211  1680 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:02:46.585920  8391 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.589598  1680 pending_rounds.cc:85] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 12
I20260709 13:02:46.590255  1680 pending_rounds.cc:107] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:46.590514  1680 raft_consensus.cc:2889] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:46.539096  8333 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.775s	user 0.000s	sys 0.003s
W20260709 13:02:46.526782  8394 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.128s	user 0.007s	sys 0.003s
I20260709 13:02:46.591661  8391 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:46.526963  8380 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.105s	user 0.013s	sys 0.003s
W20260709 13:02:46.526959  8386 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.241s	user 0.010s	sys 0.001s
W20260709 13:02:46.526413  8400 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:02:46.592463  8393 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:46.528817  8379 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.076s	user 0.004s	sys 0.007s
W20260709 13:02:46.528640  8389 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.205s	user 0.008s	sys 0.003s
W20260709 13:02:46.527817  8363 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.976s	user 0.000s	sys 0.004s
I20260709 13:02:46.595036  8213 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.595528  8213 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.546523  1528 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:46.597630  8213 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.598712  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1755) took 1538 ms. Trace:
I20260709 13:02:46.598857  7886 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.600354  8278 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:46.599166  2256 rpcz_store.cc:276] 0709 13:02:45.060642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.071638 (+ 10996us) service_pool.cc:224] Handling call
0709 13:02:45.071941 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.087087 (+ 15146us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:45.133023 (+ 45936us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.387336 (+254313us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.388013 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.388176 (+   163us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:45.392523 (+  4347us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.392730 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.392803 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.433619 (+1040816us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800023ec0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f
0709 13:02:46.445750 (+ 12131us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b48000cc0d8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:02:46.491634 (+ 45884us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:46.598528 (+106894us) raft_consensus.cc:1685] finished
0709 13:02:46.598547 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.598656 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25060,"prepare.queue_time_us":149980,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3408,"raft.queue_time_us":72372,"raft.run_cpu_time_us":3103,"raft.run_wall_time_us":1081270,"spinlock_wait_cycles":34940288,"thread_start_us":228445,"threads_started":1,"wal-append.queue_time_us":355426}
W20260709 13:02:46.528949  8388 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.207s	user 0.000s	sys 0.010s
W20260709 13:02:46.556567  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.601251  8278 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.602283  8278 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.603520  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.560702  8140 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:46.594789  8370 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.605307  8140 consensus_queue.cc:1059] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:46.605629  7886 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.606194  8140 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:46.594774  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:46.606738  8140 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:46.607846  8384 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.608425  8308 raft_consensus.cc:3055] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:46.608844  8308 raft_consensus.cc:740] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:46.609820  8308 consensus_queue.cc:260] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.611096  8308 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.563769  8178 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.612696  1606 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:46.613734  8313 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:46.562623  8252 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.614735  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3030) took 1663 ms. Trace:
I20260709 13:02:46.614811  7787 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:46.615782  7787 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.615206  1529 rpcz_store.cc:276] 0709 13:02:44.951767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.951875 (+   108us) service_pool.cc:224] Handling call
0709 13:02:44.953135 (+  1260us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.953899 (+   764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.953928 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:44.971722 (+ 17794us) log.cc:844] Serialized 52 byte log entry
0709 13:02:45.140996 (+169274us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:45.285520 (+144524us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.381112 (+ 95592us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.430877 (+1049765us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b18002f6740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:02:46.614306 (+183429us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18002f6740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:02:46.614413 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.614491 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.614531 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:46.614543 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.614661 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6356,"prepare.queue_time_us":207674,"prepare.run_cpu_time_us":3931,"prepare.run_wall_time_us":87247,"raft.queue_time_us":59175,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":18473,"spinlock_wait_cycles":23218944,"thread_start_us":209582,"threads_started":2,"wal-append.queue_time_us":437978,"wal-append.run_cpu_time_us":3022,"wal-append.run_wall_time_us":1067219}
I20260709 13:02:46.617965  7886 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.605226  8370 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.619719  7787 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.620471  8370 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.589197  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.621086  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:46.621590  2256 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.568759  8019 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.571244  2259 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:46.572873  8295 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.556418  2253 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:46.625679  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.575040  1534 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:46.537533  8387 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.535692  8119 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:46.633152  8119 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:46.576699  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.578797  2255 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:46.635281  1682 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:46.635538  8119 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.636834  1681 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:46.587846  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.581110  8230 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:46.641528  8368 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.642496  8291 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.594565  8393 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.641579  2253 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:46.651525  2259 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:46.607616  8140 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.622012  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.567852  8367 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.624024  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:46.709789  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.710981  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.712738  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:46.713017  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 89058.1us
I20260709 13:02:46.713466  1679 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:46.714090  2256 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:46.614717  8242 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:46.630002  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.631692  8321 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:46.628875  7953 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:46.600751  8283 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.632408  8369 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.632180  8295 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:46.633656  8356 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.164s	user 0.002s	sys 0.000s
I20260709 13:02:46.646124  7886 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.637447  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.629006  8387 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:46.638257  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.743048  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.639039  1675 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:02:46.690594  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.598739  8213 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:46.723810  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.723699  2253 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:46.725358  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:46.724231  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82368.1us
I20260709 13:02:46.522629  8373 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:46.708775  8309 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.720422  8254 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:46.769251  8161 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:46.730967  8291 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.715924  8242 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:46.775302  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1754) took 2017 ms. Trace:
I20260709 13:02:46.777473  2257 rpcz_store.cc:276] 0709 13:02:44.757514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.911506 (+153992us) service_pool.cc:224] Handling call
0709 13:02:44.912276 (+   770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.912745 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.912785 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.925994 (+ 13209us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.133539 (+207545us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:45.396838 (+263299us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.397115 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.397303 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.722221 (+324918us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b180002de80. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:02:46.632967 (+910746us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:46.775104 (+142137us) raft_consensus.cc:1685] finished
0709 13:02:46.775125 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.775244 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1000,"prepare.queue_time_us":245703,"prepare.run_cpu_time_us":236,"prepare.run_wall_time_us":9398,"raft.queue_time_us":855,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":11371,"spinlock_wait_cycles":20092416,"thread_start_us":357255,"threads_started":2,"wal-append.queue_time_us":267429}
W20260709 13:02:46.786785  8398 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.170s	user 0.001s	sys 0.010s
I20260709 13:02:46.760432  8213 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.764726  8309 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.781412  8291 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.807307  8295 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.790470  8242 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:46.810748  8376 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.773s	user 0.004s	sys 0.005s
I20260709 13:02:46.811594  8242 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.810748  8310 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.805282  8377 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.821646  8213 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:46.823709  8321 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:46.824064  8321 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:46.824729  8321 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:46.818516  8309 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:46.825587  8321 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:46.831498  8387 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.835060  8384 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:46.614717  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:46.866319  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.584898  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.874522  1500 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.885506  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.887878  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.932811  1525 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:46.889657  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1464) took 1298 ms. Trace:
I20260709 13:02:46.934083  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:46.889734  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.935111  1534 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:46.890941  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.893998  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:46.639175  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.937234  1526 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:46.934369  1533 rpcz_store.cc:276] 0709 13:02:45.590626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.591527 (+   901us) service_pool.cc:224] Handling call
0709 13:02:45.591868 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.053669 (+461801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.888897 (+835228us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002cdb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:46.889370 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011834112}
I20260709 13:02:46.936185  1525 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:46.937196  2256 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:46.898012  1530 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:46.639727  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.948424  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.719409  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.952294  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.949973  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.953203  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1473) took 1119 ms. Trace:
W20260709 13:02:46.956966  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 209743us
I20260709 13:02:46.953663  2252 rpcz_store.cc:276] 0709 13:02:45.834116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.834597 (+   481us) service_pool.cc:224] Handling call
0709 13:02:46.952781 (+1118184us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004079d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:46.952980 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517777664}
I20260709 13:02:46.899988  1607 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:46.954003  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.960283  1601 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:46.968552  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:46.905400  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1356) took 1182 ms. Trace:
I20260709 13:02:46.969843  1606 rpcz_store.cc:276] 0709 13:02:45.722242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.722995 (+   753us) service_pool.cc:224] Handling call
0709 13:02:45.723607 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.613113 (+889506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.904585 (+291472us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540011dd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:46.905008 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044208384}
I20260709 13:02:46.906977  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3161) took 1158 ms. Trace:
I20260709 13:02:46.907028  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.744361  1675 pending_rounds.cc:85] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 15
I20260709 13:02:46.909081  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.910967  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.972278  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.911988  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3162) took 1020 ms. Trace:
I20260709 13:02:46.914464  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.975409  1676 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:46.977624  1609 rpcz_store.cc:276] 0709 13:02:45.891666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.891830 (+   164us) service_pool.cc:224] Handling call
0709 13:02:45.892151 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.080088 (+187937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.900008 (+819920us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540031bd54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:46.911787 (+ 11779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409568000}
I20260709 13:02:46.979362  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.980495  1682 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:46.981559  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.982884  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:46.979161  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.912590  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.917776  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.915567  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.885787  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:46.985070  1603 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:46.984244  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.974661  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:46.989308  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50203us
I20260709 13:02:46.990111  1601 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:46.993239  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:46.963187  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.995728  1607 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:46.972581  1608 rpcz_store.cc:276] 0709 13:02:45.748876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.749114 (+   238us) service_pool.cc:224] Handling call
0709 13:02:46.906495 (+1157381us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400337054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:46.906730 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054726528}
I20260709 13:02:46.973528  1675 pending_rounds.cc:107] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:02:46.996883  1675 raft_consensus.cc:2889] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.979122  1606 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:46.998695  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.989357  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.986162  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.755450  1679 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
W20260709 13:02:46.985419  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 68126.8us
I20260709 13:02:47.004343  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:46.759210  7886 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:46.984855  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.007085  1681 raft_consensus.cc:2410] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:47.008723  7886 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.999734  1675 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:47.010324  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.011217  7886 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.011615  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:46.903488  1674 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:47.002321  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.012995  1679 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:47.013422  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.013813  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:47.014472  1679 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:47.014530  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.015285  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.015614  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.011926  7886 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.019037  7886 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:46.999781  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.021911  1681 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:47.023234  7787 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.023638  1681 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:47.023824  7787 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.025532  1681 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:47.008618  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:02:46.983243  1609 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:47.027128  7787 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.028040  7787 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:47.028985  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.029568  7787 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.031088  7787 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.035235  1679 raft_consensus.cc:2393] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:47.036657  1676 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:47.039662  1682 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:47.034801  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:46.978013  2226 leader_election.cc:400] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:47.090981  2226 leader_election.cc:403] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.046247  8064 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.040795  7614 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:47.059727  8136 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.055751  8070 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.040449  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:46.827767  8264 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:47.112262  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:47.119755  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 142337us
W20260709 13:02:47.117587  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 398296us
I20260709 13:02:47.122527  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.100831  8064 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.121954  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:47.123960  1679 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:47.127758  1601 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:02:47.128798  8385 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:47.112888  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:47.130713  1676 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Received request to transfer leadership
I20260709 13:02:47.128947  8178 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:47.132009  8157 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.048334  8134 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:02:47.117606  8070 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.125977  8064 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.149498  1527 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 15.
I20260709 13:02:47.154736  8268 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.156586  8264 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:47.173409  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45924.5us
I20260709 13:02:47.164763  8227 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:02:47.186007  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50947.5us
I20260709 13:02:47.183216  1605 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:47.191227  8268 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.143241  8385 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:47.194955  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:47.196153  1676 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Received request to transfer leadership
I20260709 13:02:47.184705  7614 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.201126  8423 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:47.201972  8062 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.204502  7975 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:47.204794  8222 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:47.205199  7975 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:47.206686  8310 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:47.206424  7975 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.206333  8119 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.223075  8119 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.225903  8119 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.209719  8222 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.226827  8222 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.228881  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.229918  2255 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:47.233945  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.234724  2257 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:47.235743  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.204883  7614 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.237365  2258 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:47.238013  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.238718  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:47.239279  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 263250us
I20260709 13:02:47.239548  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.239916  1681 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:47.242914  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.237097  8393 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.244522  8393 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.245098  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.245914  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.245707  8393 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.246798  2252 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:47.247778  8393 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.248507  8178 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:47.251044  8134 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:47.251456  8178 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:47.238608  8070 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.251931  8178 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.253547  8178 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.255240  8178 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.249058  8254 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.255936  8254 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:47.245043  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 210498us
I20260709 13:02:47.257488  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.263432  8385 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.261811  2257 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:47.266044  8385 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:47.267823  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.288678  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:47.289407  1531 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.294771  8222 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.295826  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.297228  8227 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:47.272250  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.277314  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.274080  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.302407  2252 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:47.276750  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.280174  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.265761  8268 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:47.281517  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.279160  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.274407  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.288018  8291 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.306682  1498 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:47.280913  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.276584  8308 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:47.346938  8222 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.341051  8227 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:47.348902  1426 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 14 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:47.350337  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.350522  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 102404us
I20260709 13:02:47.264228  8254 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:47.351397  8384 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:47.354492  1601 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:47.281220  7614 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:02:47.352949  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:47.272774  8422 log.cc:927] Time spent T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.062s	user 0.003s	sys 0.001s
I20260709 13:02:47.353931  1606 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
W20260709 13:02:47.270138  8161 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.500s	user 0.019s	sys 0.000s
W20260709 13:02:47.364106  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63057.8us
W20260709 13:02:47.369148  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.273811  8230 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.369506  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.369982  8264 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.371805  8264 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.365270  2255 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:02:47.369632  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.373544  1527 raft_consensus.cc:2368] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18.
I20260709 13:02:47.371795  1530 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:47.368476  2259 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:47.377349  1532 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:47.359773  8291 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:02:47.382902  8134 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:47.383113  8308 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:47.382454  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 101644us
I20260709 13:02:47.364210  8119 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:47.384799  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 127153us
I20260709 13:02:47.279105  8064 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.389355  1531 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
W20260709 13:02:47.390743  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.388907  1604 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:02:47.394070  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.395987  8347 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.396672  8347 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.397215  8064 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.396987  8233 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:47.387899  8119 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.412813  8119 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.429474  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.430454  1601 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.432902  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.433706  1526 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:47.430634  7886 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.435070  7886 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.436651  7614 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.437532  7886 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.435436  8387 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.438128  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.439584  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:47.444396  1527 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 11.
W20260709 13:02:47.445576  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66150.6us
W20260709 13:02:47.446641  8420 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:02:47.446792  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:47.450359  8230 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.450460  8161 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:47.451371  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.451717  8161 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.452626  8306 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:47.453045  8306 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.453145  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.454241  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1580) took 1200 ms. Trace:
I20260709 13:02:47.454772  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:47.455475  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 86261.2us
I20260709 13:02:47.437464  7614 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.456416  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.456662  8268 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:47.457523  8268 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.457882  8268 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.458279  8268 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.460350  8308 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.453771  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1577) took 1203 ms. Trace:
I20260709 13:02:47.462411  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.463614  8306 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.452198  8161 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:47.427387  8233 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.472733  1609 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:47.473111  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.474267  1678 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:47.472985  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50849.5us
I20260709 13:02:47.473449  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:47.466508  1418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 97985.8us
I20260709 13:02:47.458072  7614 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.483846  1608 raft_consensus.cc:2368] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:47.472682  8385 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.488687  1607 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:47.471954  8069 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:47.465971  7886 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.493331  8157 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:47.493799  8157 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:47.494199  8157 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.494601  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:47.491242  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58708.7us
I20260709 13:02:47.491205  8069 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.474162  8222 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.497184  8387 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:47.474080  8062 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:47.498874  8062 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.498986  8249 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:47.467394  7975 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:47.499357  8062 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.489240  8385 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.500084  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:47.506701  1605 raft_consensus.cc:2368] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:47.499570  1426 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.510542  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.511416  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:47.511889  8250 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:47.512452  8291 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:47.513017  8291 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:47.505105  8385 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.515264  8316 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:02:47.512466  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:47.516520  8064 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.517040  1683 raft_consensus.cc:606] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Received request to transfer leadership
I20260709 13:02:47.517057  8064 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:47.513271  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66725.9us
I20260709 13:02:47.518662  8064 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.519145  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.496670  7886 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.520637  8391 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:47.520566  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.521171  8391 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.521665  8391 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.520941  7614 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:47.500118  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3153) took 3200 ms (client timeout 2124 ms). Trace:
W20260709 13:02:47.525811  1604 rpcz_store.cc:269] 0709 13:02:44.289229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.289372 (+   143us) service_pool.cc:224] Handling call
0709 13:02:47.477151 (+3187779us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b540029bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:47.489224 (+ 12073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6979758848}
I20260709 13:02:47.497205  8069 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:47.534955  1426 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 14, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.521924  8178 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:47.533664  7614 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:47.536526  8321 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:02:47.536463  8236 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:47.549186  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.548943  8291 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.536811  8222 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.550027  8227 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:47.551499  8222 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.551648  1528 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:47.553081  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.551949  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:47.556705  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.454648  2260 rpcz_store.cc:276] 0709 13:02:46.253910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.254028 (+   118us) service_pool.cc:224] Handling call
0709 13:02:46.254354 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.256564 (+  2210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.256594 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.260428 (+  3834us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.958667 (+698239us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003c3640. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:02:47.043465 (+ 84798us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b48000cc0d8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:02:47.260596 (+217131us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:47.359975 (+ 99379us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.453789 (+ 93814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.453897 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.453937 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:47.453950 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.454061 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122149,"prepare.queue_time_us":92822,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"raft.queue_time_us":89489,"raft.run_cpu_time_us":9002,"raft.run_wall_time_us":781752,"spinlock_wait_cycles":21609088,"thread_start_us":192562,"threads_started":1,"wal-append.queue_time_us":1111849}
I20260709 13:02:47.461047  2261 rpcz_store.cc:276] 0709 13:02:46.250701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.250820 (+   119us) service_pool.cc:224] Handling call
0709 13:02:46.251187 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.253033 (+  1846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.253063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:46.253622 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 13:02:46.596542 (+342920us) spinlock_profiling.cc:243] Waited 950 us on lock 0x7b18000664c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:02:46.941294 (+344752us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:47.196148 (+254854us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.357416 (+161268us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.453142 (+ 95726us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18000664c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:02:47.453324 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.453430 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.453464 (+    34us) raft_consensus.cc:1685] finished
0709 13:02:47.453474 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.453598 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62232,"prepare.queue_time_us":275536,"prepare.run_cpu_time_us":6380,"prepare.run_wall_time_us":25966,"raft.queue_time_us":116250,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":11639,"spinlock_wait_cycles":5561856,"thread_start_us":594777,"threads_started":2,"wal-append.queue_time_us":553792}
W20260709 13:02:47.565016  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 138279us
I20260709 13:02:47.473937  8161 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.573489  8233 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.567473  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.569607  2251 tablet_service.cc:1558] Processing DeleteTablet for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 with delete_type TABLET_DATA_TOMBSTONED (TS 9b6586a864a94c019cae2d8e2987a7af not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:51320
I20260709 13:02:47.570696  7886 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.572023  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.572665  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.572844  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.574611  8161 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.576881  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.577484  1527 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:47.577634  1678 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:02:47.579731  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.579876  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.560683  1426 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 14 to 15, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 15 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.567118  1526 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:47.589836  1678 pending_rounds.cc:85] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 12
I20260709 13:02:47.592442  1534 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:47.592877  1678 pending_rounds.cc:107] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:02:47.594871  1678 raft_consensus.cc:2889] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.576733  8347 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.593778  1675 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:02:47.608412  1604 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:47.608701  8320 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:47.609479  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.610309  8136 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:47.610725  8136 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:47.611709  8136 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.615259  8347 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:47.617372  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.617609  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.618204  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.618784  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.619026  2259 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:47.619995  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.620338  2258 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:47.620863  1683 raft_consensus.cc:2410] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:02:47.622165  8250 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:47.593024  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.593195  1529 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:47.596536  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.642051  1601 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:47.597322  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.598398  1649 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.600419  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.601289  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.602375  1600 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:47.602890  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:47.591462  8249 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.605779  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:47.622665  8387 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.624068  1424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 362) took 6536 ms. Trace:
I20260709 13:02:47.600034  8119 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.625941  8136 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:47.627504  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.630117  1606 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:47.580852  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.561094  7614 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:47.635854  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63994.7us
I20260709 13:02:47.643921  1674 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:47.635637  8268 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.650370  1681 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:47.651676  8429 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
W20260709 13:02:47.652065  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53795.3us
I20260709 13:02:47.652817  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.656455  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:47.658062  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 101261us
I20260709 13:02:47.636025  8385 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.594331  8321 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:02:47.663902  1529 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:47.668527  8067 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:47.669212  2258 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:47.669847  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.673895  2226 leader_election.cc:400] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18.
I20260709 13:02:47.678406  2226 leader_election.cc:403] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.644980  8393 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.658798  1530 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:47.675119  1531 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:47.672482  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.681402  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.681945  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.675782  8062 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:47.684526  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.684988  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:47.685276  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.657075  7614 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:47.689965  8064 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.690392  7975 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:47.687626  8236 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:02:47.644847  8391 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.691478  8372 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.691802  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.692008  8283 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:47.692364  8262 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:47.693641  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.670313  7886 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:47.657713  8387 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.698197  8306 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.685611  8178 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.677541  8249 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:47.701238  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44921.4us
W20260709 13:02:47.702998  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75713us
I20260709 13:02:47.690840  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.705530  1534 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:02:47.706915  8430 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:02:47.703611  8385 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.701335  8067 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:47.695248  1605 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:47.696585  8347 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.762009  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:47.700826  7975 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.779843  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:47.752956  2259 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:47.755870  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.758503  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.696655  7614 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.703649  8119 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.759516  2252 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:47.746881  1681 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:47.722306  8247 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:47.738677  8222 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:47.646157  1424 rpcz_store.cc:276] 0709 13:02:41.091058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.092633 (+  1575us) service_pool.cc:224] Handling call
0709 13:02:47.623465 (+6530832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:44.520567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:44.521214 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:44.521250 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:44.521264 (+    14us) tablet.cc:662] Decoding operations
0709 13:02:44.569512 (+ 48248us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:44.569587 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:44.569620 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:44.570731 (+  1111us) tablet.cc:701] Row locks acquired
0709 13:02:44.570748 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:44.570916 (+   168us) write_op.cc:270] Start()
0709 13:02:44.571437 (+   521us) write_op.cc:276] Timestamp: P: 1783602164570871 usec, L: 0
0709 13:02:44.571468 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:02:44.586561 (+ 15093us) log.cc:844] Serialized 6243 byte log entry
0709 13:02:45.499376 (+912815us) op_driver.cc:464] REPLICATION: finished
0709 13:02:45.968276 (+468900us) write_op.cc:301] APPLY: starting
0709 13:02:45.972558 (+  4282us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:46.475438 (+502880us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:46.477499 (+  2061us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:46.748813 (+271314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:46.789574 (+ 40761us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:02:46.797364 (+  7790us) write_op.cc:312] APPLY: finished
0709 13:02:46.806256 (+  8892us) log.cc:844] Serialized 139 byte log entry
0709 13:02:46.806496 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:46.806707 (+   211us) write_op.cc:454] Released schema lock
0709 13:02:46.806779 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:46.807327 (+   548us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:46.807359 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":578761,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":404842,"apply.run_cpu_time_us":24993,"apply.run_wall_time_us":843147,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66977,"num_ops":15,"prepare.queue_time_us":265759,"prepare.run_cpu_time_us":56529,"prepare.run_wall_time_us":187929,"raft.queue_time_us":394853,"raft.run_cpu_time_us":14248,"raft.run_wall_time_us":343559,"replication_time_us":898060,"thread_start_us":1398331,"threads_started":4,"wal-append.queue_time_us":238711}]]}
I20260709 13:02:47.765172  8268 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:47.748807  8227 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:02:47.767437  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76687.2us
I20260709 13:02:47.748980  7886 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:47.767611  1604 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:47.768178  1608 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:47.768453  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:47.769302  8306 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.770431  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.771620  8249 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.771991  8313 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:02:47.773984  8387 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:47.774616  8384 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:47.777297  8161 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:47.691841  8070 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:02:47.781567  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.791415  1603 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:47.796561  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.800014  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.830873  1527 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:47.833495  8391 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.794632  8262 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:47.834618  8370 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:47.834967  1607 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.835440  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.836614  8064 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:47.837361  1526 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:47.811444  7886 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.802420  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:47.789434  7975 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:47.789657  8347 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.813592  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:47.817440  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 55510.6us
I20260709 13:02:47.824469  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.848410  1607 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:47.801805  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:47.840869  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:47.841925  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:47.808825  8222 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:47.843608  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:47.843680  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47975us
I20260709 13:02:47.808452  8247 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:47.812186  2227 leader_election.cc:400] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 15 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16.
I20260709 13:02:47.825330  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.828604  8384 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:47.854535  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:47.830853  8161 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:47.864343  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.847455  8070 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:47.886667  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 118345us
I20260709 13:02:47.894380  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.893617  1528 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:47.895064  2252 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:02:47.920074  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.900398  8070 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.922295  8070 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:47.923012  8062 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.924207  8291 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:47.924806  8291 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.925820  8372 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18.
W20260709 13:02:47.887269  8436 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:02:47.927902  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:47.928472  2255 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:47.922224  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:47.932614  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 120573us
I20260709 13:02:47.928666  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:47.933447  2227 leader_election.cc:400] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:02:47.932793  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.835134  8069 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:47.893939  8387 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.927093  8291 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.937518  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:47.885162  8161 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.939348  1528 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:47.886358  8178 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:47.927191  8247 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.945731  1527 raft_consensus.cc:1240] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:02:47.884198  8119 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:02:47.939069  8387 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.989439  8387 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.989867  8157 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:47.991829  8437 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:02:47.947346  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:47.978154  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 91935.1us
I20260709 13:02:47.920326  8067 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:47.993331  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49984.8us
I20260709 13:02:48.024925  8069 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.993597  8291 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.992238  8157 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:47.992739  8140 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:47.984685  8249 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:48.087311  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.089763  1676 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:48.091193  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 241527us
W20260709 13:02:48.082278  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.095160  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:48.094787  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.094060  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.000823  8178 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.100207  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:48.104951  1674 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:48.105094  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.107460  1682 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:48.107682  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.109022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.114696  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.111495  1683 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:48.118146  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:48.141217  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.103942  8157 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:48.119400  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.015s	sys 0.046s
W20260709 13:02:48.155731  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.015s	sys 0.046s
I20260709 13:02:48.150465  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:47.985847  8222 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.116197  8283 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.157856  1607 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:48.082433  8249 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:47.987587  8384 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.116637  8134 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:48.167044  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.167809  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.119179  8119 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:48.177294  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 92548.1us
I20260709 13:02:48.180076  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.181233  2259 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:48.157009  8140 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:48.144882  2251 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.007s	sys 0.018s
I20260709 13:02:48.160095  8157 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:48.188265  1605 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:48.193248  1605 pending_rounds.cc:85] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 9
I20260709 13:02:48.193552  1605 pending_rounds.cc:107] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:48.165126  8347 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.193780  1605 raft_consensus.cc:2889] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:48.169946  8370 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:48.174206  8134 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:48.195446  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.199044  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.171860  8283 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.186894  8250 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:48.222131  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 393467us
I20260709 13:02:48.223194  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.198650  8157 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.223374  7787 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.224835  7787 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.226986  7787 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.227527  7787 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.229713  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:48.227942  7787 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.231958  8157 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:48.199529  2251 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.019s
I20260709 13:02:48.234937  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.206450  8134 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:48.242254  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.218214  8230 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:48.293804  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70661.1us
I20260709 13:02:48.204497  8391 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:48.216914  8119 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:48.239370  8347 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:48.298405  8242 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:48.302719  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.300009  8268 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.322723  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 446455us
I20260709 13:02:48.322564  8283 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:48.323482  8283 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:48.323997  8283 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.324542  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.326537  8249 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.327111  8320 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.327466  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:48.326771  8283 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.328500  8136 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:48.330025  8136 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:48.331530  8136 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:48.333149  8451 tablet_replica.cc:333] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
W20260709 13:02:48.334477  8442 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:02:48.336023  8306 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:48.336493  8306 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:48.337023  8306 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.336428  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:48.339195  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 153292us
I20260709 13:02:48.304059  8384 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.305168  8372 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:48.346822  1533 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:02:48.348649  8443 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:48.348539  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.349571  8370 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:48.327313  8313 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:48.379431  8313 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.379922  8313 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:48.353055  8441 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:02:48.344336  8264 consensus_queue.cc:1059] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 13:02:48.349571  8447 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:02:48.359836  1600 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:48.360641  7787 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.360474  8230 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:48.360885  1527 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:48.361519  8325 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.364046  8227 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:48.370062  8070 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.308502  8385 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:48.388252  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 362521us
I20260709 13:02:48.390280  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.391683  1534 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:02:48.322482  8392 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:48.377740  8370 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:48.321506  8268 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.338449  8119 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.395705  8178 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.396136  8227 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:48.402153  7787 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:48.400951  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 312292us
I20260709 13:02:48.385203  8372 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.441738  1600 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:02:48.430974  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 129341us
I20260709 13:02:48.447561  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.464630  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.404978  8264 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:02:48.431275  8457 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:48.482164  8451 raft_consensus.cc:2243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: Raft consensus shutting down.
I20260709 13:02:48.482949  8451 pending_rounds.cc:70] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Trying to abort 2 pending ops.
I20260709 13:02:48.483254  8451 pending_rounds.cc:77] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Aborting op as it isn't in flight: id { term: 19 index: 13 } timestamp: 7305634447001767936 op_type: NO_OP noop_request { }
I20260709 13:02:48.483660  8451 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:48.483986  8451 pending_rounds.cc:77] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Aborting op as it isn't in flight: id { term: 17 index: 12 } timestamp: 7305634400876355584 op_type: NO_OP noop_request { }
I20260709 13:02:48.484375  8451 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:48.484792  8451 raft_consensus.cc:2272] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEARNER]: Raft consensus is shut down!
I20260709 13:02:48.485828  8291 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.442744  8306 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:48.488148  8450 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:48.488725  8306 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.489001  8451 ts_tablet_manager.cc:1916] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:48.489240  8134 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.446431  8387 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.415189  8385 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.492479  8134 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.492871  8387 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:48.494065  8385 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.401890  8325 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.433125  8372 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.498209  8119 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.498605  8062 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.433352  8452 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:02:48.456013  7787 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:48.501266  8452 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:48.438761  8268 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.501936  8452 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:48.448764  8070 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:48.498605  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51154us
I20260709 13:02:48.504417  8347 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:48.504733  8320 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:48.504850  8227 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.505911  1574 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:48.506825  8347 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:48.507302  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:48.508081  1607 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
W20260709 13:02:48.508610  7975 consensus_meta.cc:287] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.002s
I20260709 13:02:48.509079  7975 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.509423  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.509999  1600 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.510231  1601 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:48.511440  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.446635  8455 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:02:48.521601  7975 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:48.522074  7614 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.002s
I20260709 13:02:48.428704  8370 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.522509  7614 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.523620  8370 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:48.524457  8134 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:48.525807  8309 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:48.527714  8309 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:48.480656  8136 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:48.498386  8325 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:48.512492  8062 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.532895  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.534504  8062 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.503551  8452 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.536007  8347 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:48.536996  8062 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:48.537415  8062 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:48.501991  7787 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:48.538532  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:02:48.538968  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2832a231368f4f5dbf9972f28f64f60e already in progress
W20260709 13:02:48.539245  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2832a231368f4f5dbf9972f28f64f60e already in progress
I20260709 13:02:48.538206  1608 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:02:48.541303  1608 pending_rounds.cc:85] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 7
I20260709 13:02:48.541568  1608 pending_rounds.cc:107] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:48.541810  1608 raft_consensus.cc:2889] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:48.536105  8452 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:48.543171  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 78665.3us
I20260709 13:02:48.544171  1600 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
W20260709 13:02:48.542794  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.018s	sys 0.016s
W20260709 13:02:48.544992  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.018s	sys 0.016s
I20260709 13:02:48.545433  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.545984  1647 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.430604  8161 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.549118  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:48.549546  8157 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.554119  7975 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:48.554549  8455 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:48.555029  8455 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:48.555745  7886 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.003s
I20260709 13:02:48.555974  8249 raft_consensus.cc:3055] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:48.556406  8249 raft_consensus.cc:740] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:48.557345  8249 consensus_queue.cc:260] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.558579  8249 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:48.558904  8461 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:48.559926  8134 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:48.560642  8134 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:48.561295  7886 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:48.561852  8134 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:48.565941  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 107966us
I20260709 13:02:48.567173  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.569795  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:48.575516  8325 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:48.577668  8157 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.578404  8157 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.577481  8468 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:48.594283  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:48.595849  1604 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:48.596639  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52491.6us
I20260709 13:02:48.564157  8313 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:48.597501  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48503.9us
I20260709 13:02:48.560465  7614 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.538190  8062 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.609330  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:48.622943  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.639067  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.581085  8468 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:48.651325  1534 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:48.602806  8070 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:48.660073  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65884.4us
I20260709 13:02:48.607031  8140 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:48.595398  8460 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:48.652751  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:48.613313  8310 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:48.668025  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.658757  8070 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:48.668987  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60882.4us
I20260709 13:02:48.671052  8070 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.657194  1606 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:48.672565  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63359us
I20260709 13:02:48.673362  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.670799  1532 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:48.656245  8468 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.676815  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.685220  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1595) took 1030 ms. Trace:
I20260709 13:02:48.685813  2260 rpcz_store.cc:276] 0709 13:02:47.655300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.661686 (+  6386us) service_pool.cc:224] Handling call
0709 13:02:48.677846 (+1016160us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540040bfd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:48.685143 (+  7297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051836800}
I20260709 13:02:48.655435  7886 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:48.555989  8455 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:48.669828  8464 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:48.668700  8236 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:48.669674  8387 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.700547  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:48.671892  8062 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:48.707945  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.670153  8460 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.672179  8310 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:48.718222  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 390794us
I20260709 13:02:48.719048  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:48.720367  8460 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:48.728960  8448 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.318s	user 0.002s	sys 0.002s
I20260709 13:02:48.731509  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1249) took 1131 ms. Trace:
I20260709 13:02:48.733249  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:48.734659  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61377.1us
I20260709 13:02:48.735563  1647 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.736723  8385 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.737322  8385 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.739862  8067 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:48.740351  8067 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:48.744426  8453 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:02:48.745891  8456 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:48.746523  8456 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.699357  8157 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.700673  8236 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.749431  8236 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.752704  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:48.753060  1606 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:48.715018  8387 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.707603  8467 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:48.754398  8467 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.766117  8455 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:48.767122  7886 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:48.721179  8310 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.720786  8384 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.780987  8384 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:48.783290  8384 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:48.784847  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:48.785677  1608 raft_consensus.cc:2368] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21.
I20260709 13:02:48.786815  1600 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:48.787303  2256 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:48.731904  1679 rpcz_store.cc:276] 0709 13:02:47.600561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.602951 (+  2390us) service_pool.cc:224] Handling call
0709 13:02:47.603248 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.603647 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.603677 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.604217 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.156190 (+551973us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:48.182087 (+ 25897us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.182309 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.182383 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.728041 (+545658us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:48.731168 (+  3127us) raft_consensus.cc:1685] finished
0709 13:02:48.731273 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.731423 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27285,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":135794,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":54987,"spinlock_wait_cycles":4957952,"thread_start_us":548606,"threads_started":1,"wal-append.queue_time_us":792822}
W20260709 13:02:48.794824  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73113.1us
W20260709 13:02:48.797017  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 78035.6us
I20260709 13:02:48.798295  1532 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:48.808523  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:48.809365  1600 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
W20260709 13:02:48.824098  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.801657  8347 raft_consensus.cc:2764] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:02:48.833259  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44370.4us
W20260709 13:02:48.833992  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 98521.7us
I20260709 13:02:48.723723  8178 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.103s
I20260709 13:02:48.844854  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:48.849195  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:48.851419  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:48.852047  2260 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:48.818236  8467 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.860267  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3068) took 1014 ms. Trace:
W20260709 13:02:48.860957  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 168263us
I20260709 13:02:48.862345  1649 leader_election.cc:400] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21.
I20260709 13:02:48.864475  1649 leader_election.cc:403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.826406  8461 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:48.868106  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.876181  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.877671  2259 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:02:48.880152  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.882078  1600 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:48.884359  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:48.860880  8264 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:48.895744  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46625.5us
W20260709 13:02:48.901126  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52428.7us
I20260709 13:02:48.906009  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.872852  8456 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.911988  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:48.870570  8161 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:48.915097  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:48.866667  7886 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:02:48.865195  1530 rpcz_store.cc:276] 0709 13:02:47.846028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.846172 (+   144us) service_pool.cc:224] Handling call
0709 13:02:47.855611 (+  9439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.935052 (+ 79441us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:48.572621 (+637569us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.849029 (+276408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.849503 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.850608 (+  1105us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:48.850644 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.850713 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.859987 (+  9274us) raft_consensus.cc:1685] finished
0709 13:02:48.860006 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.860128 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33425,"prepare.queue_time_us":731789,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":52826,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":5211,"thread_start_us":827259,"threads_started":2,"wal-append.queue_time_us":252213}
I20260709 13:02:48.879711  8242 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:48.866375  8254 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:48.897540  8262 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:48.912873  8347 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:48.922580  8242 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:48.865032  7787 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:02:48.913247  8467 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:48.874655  8306 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:02:48.945803  8393 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:48.950616  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:48.911052  8313 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:48.952395  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:48.953192  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:48.954000  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.954711  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:48.955901  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:48.910890  8457 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:48.911454  8264 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:48.966619  1677 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
W20260709 13:02:48.977821  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 101713us
I20260709 13:02:48.916869  8461 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:02:48.978627  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 3063) took 1149 ms. Trace:
I20260709 13:02:48.983186  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:48.983186  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:48.918231  8384 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:48.984202  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:48.996796  1532 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:48.987403  1529 rpcz_store.cc:276] 0709 13:02:47.817131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.817261 (+   130us) service_pool.cc:224] Handling call
0709 13:02:48.965855 (+1148594us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002a8354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:48.965979 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244241152}
I20260709 13:02:49.003178  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.003715  8242 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.004273  8242 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.004709  8242 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.006572  8242 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.010788  1679 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:02:49.014238  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.015520  8384 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:49.015977  8384 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:49.017014  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.018272  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:49.018448  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:49.018796  1529 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:49.020859  8485 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:49.020804  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:49.024848  8384 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.026135  8384 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.981176  7886 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.038394  7886 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.041886  1532 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:49.050068  1532 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:49.053735  1531 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:49.056946  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:48.979128  8393 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.040447  7886 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:49.053004  8466 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.560s	user 0.000s	sys 0.004s
I20260709 13:02:49.048696  7614 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.989689  8236 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.084796  1527 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:49.089480  7614 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:02:49.072001  8452 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.003s
I20260709 13:02:49.101255  1680 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:49.077227  8069 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:49.108830  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3596) took 1342 ms (client timeout 1694 ms). Trace:
W20260709 13:02:49.109395  1601 rpcz_store.cc:269] 0709 13:02:47.766109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.770142 (+  4033us) service_pool.cc:224] Handling call
0709 13:02:49.108589 (+1338447us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540034b2d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:49.108765 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601682176}
I20260709 13:02:49.063984  8310 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.111809  8310 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.112619  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3600) took 1024 ms. Trace:
I20260709 13:02:49.113010  1604 rpcz_store.cc:276] 0709 13:02:48.088604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.088856 (+   252us) service_pool.cc:224] Handling call
0709 13:02:48.101039 (+ 12183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.602774 (+501735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.112386 (+509612us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54003c5d54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:49.112561 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137448320}
I20260709 13:02:49.117393  8473 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:49.117998  8473 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.119712  8498 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:49.120137  8473 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:49.117408  2226 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.588s (SENT)
I20260709 13:02:49.121176  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:49.109758  8393 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:49.122546  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3067) took 1282 ms. Trace:
I20260709 13:02:49.122958  1526 rpcz_store.cc:276] 0709 13:02:47.839807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.839933 (+   126us) service_pool.cc:224] Handling call
0709 13:02:47.850391 (+ 10458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.896857 (+ 46466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.896888 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.933134 (+ 36246us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.385931 (+452797us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:48.388908 (+  2977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.389325 (+   417us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.036102 (+646777us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:49.122250 (+ 86148us) raft_consensus.cc:1685] finished
0709 13:02:49.122272 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.122488 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5953,"raft.queue_time_us":41659,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":31277,"spinlock_wait_cycles":49968896,"thread_start_us":400437,"threads_started":1,"wal-append.queue_time_us":546521}
I20260709 13:02:49.124929  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.125626  1529 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:49.126744  1526 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:49.130481  8070 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.133291  8460 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.133889  8067 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.102945  8262 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:49.137063  8385 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.137765  8236 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.121490  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.146364  8070 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.147039  8470 raft_consensus.cc:993] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:49.147568  8470 raft_consensus.cc:1081] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:02:49.149791  1678 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:49.153009  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:49.171096  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.149887  8453 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:49.137728  8385 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:49.120214  8498 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:49.159752  7787 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.175364  8453 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:49.170276  8473 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:49.093168  8264 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.187559  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:49.205207  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 293277us
I20260709 13:02:49.205982  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.168872  8468 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.204460  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:49.206856  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.209764  1604 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:49.186641  8393 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:49.196717  8473 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:49.186951  8498 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:49.181831  8325 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:49.250615  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.212699  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.209234  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:49.197695  8460 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:49.254835  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45679.2us
W20260709 13:02:49.250926  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45015.5us
I20260709 13:02:49.254220  2252 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:49.209921  8069 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:49.210613  8242 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.213141  8140 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:49.252851  8473 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:49.282691  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:49.198557  7787 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.289712  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:49.258174  8470 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:49.257968  8497 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:49.264279  8309 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.304678  8309 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.293816  2258 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:49.282859  8242 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.295171  1609 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:49.286288  8140 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:49.277623  8461 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:02:49.263631  8069 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.296932  8316 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.297015  2252 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:49.298107  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:49.300884  7787 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.302052  8475 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:49.303359  1675 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:49.304405   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.254550  8451 ts_tablet_manager.cc:1929] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:02:49.256434  8393 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.315234  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:49.321091  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:49.321722  1530 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.318410  1602 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:49.302907  8470 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.317598  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.382300  8242 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.373960  7886 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.405946  8313 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.375751  8309 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.403203  8393 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:49.408051  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.377657  8140 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:49.338712  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49412.7us
I20260709 13:02:49.425509  1530 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:49.385943  8461 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.329795  8470 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:49.312981  8069 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:49.406337  1683 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:49.326803  8391 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:49.408147  8488 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.369215  7787 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.402348  8454 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.309332  8460 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.386034  8508 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:02:49.153357  8134 consensus_queue.cc:1175] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 17 status { last_received { term: 15 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.14-16.14]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:49.323875  8475 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.317922  8316 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.328905  8497 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 13 to 16, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:49.319473  8457 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21.
I20260709 13:02:49.331697  8451 log.cc:1199] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Deleting WAL directory at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0/minicluster-data/ts-3-root/wals/5293a667c8bb4fdbb1fa97aaeba1cfc1
I20260709 13:02:49.398612  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.409247  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.396821  8387 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.407459  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.337734  8468 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.468950  8262 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.499502  1674 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:49.515175  7787 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.534967  8460 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.540663  7787 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:49.542428  8460 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.535106  8454 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.545254  8454 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.545368  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.547159  8451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51320 (request call id 3) took 2012 ms. Trace:
I20260709 13:02:49.549626  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.550310  8262 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:49.553090  8309 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.559890  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:49.560820  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 162314us
I20260709 13:02:49.561619  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.562230  8498 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.564205  8309 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:49.503463  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 185929us
I20260709 13:02:49.565860  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:49.500797  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:49.567535  8247 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:49.568186  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 67470.1us
I20260709 13:02:49.471306  8236 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.568358  8509 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:49.482015  8070 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:49.498122  7886 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.532563  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.568904  8236 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.569492  8509 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:49.570230  8509 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:49.570597  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.571604  8236 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.572743  7886 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.574477  1683 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:49.575661  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:49.576893  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.577482  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.578969  8325 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:49.579473  8325 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.579900  8325 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.580209  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.589862  1681 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:49.510020  8391 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.592840  1601 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:49.509622  8393 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:49.530879  8316 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:49.605163  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.534504  8475 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.498117  8313 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.609233  1601 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:49.594769  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:49.578356  8498 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:49.547541  8451 rpcz_store.cc:276] 0709 13:02:47.534743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.569328 (+ 34585us) service_pool.cc:224] Handling call
0709 13:02:48.332573 (+763245us) ts_tablet_manager.cc:1151] Deleting tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1
0709 13:02:48.332680 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:48.773925 (+441245us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:49.211843 (+437918us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:49.547054 (+335211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134925,"tablet-delete.queue_time_us":701888,"thread_start_us":625563,"threads_started":1}
I20260709 13:02:49.603411  8391 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:49.592525  7975 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:49.625196  1674 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:49.513851  8488 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.626281  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.626950  1601 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
I20260709 13:02:49.511005  8461 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.595443  8321 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:49.635475  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.592849  8468 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:02:49.620857  8161 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:49.636659  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:49.610515  8393 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.645638  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:49.647670  1534 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:49.652875  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65107.9us
I20260709 13:02:49.663000  2226 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:49.641645  7975 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:49.686514  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.670806  1609 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:49.676550  1675 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:49.663051  1601 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 13 to 16, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:49.710474  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.710721  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.711306  1677 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.715574  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.716853  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.718979  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.719543  1675 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:49.721294  1603 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:49.662637  7787 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:02:49.722348  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:49.722860  1607 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.723223  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.724236  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:49.726373  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.726939  2259 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 12.
W20260709 13:02:49.728767  8517 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:02:49.730127  1607 raft_consensus.cc:2410] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:49.731420  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.732228  1607 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:49.734308  8393 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.735477  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.720811  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.736565  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.737860  1606 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:49.737782  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.741384  1608 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:49.711853  8247 raft_consensus.cc:2804] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:49.742969  8247 raft_consensus.cc:697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:49.743125  8453 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.743995  8247 consensus_queue.cc:237] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.745036  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.712895  8236 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.746412  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.746650  8236 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.763988  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.764838  1675 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:49.659682  8140 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:02:49.767385  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:49.772724  7975 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:49.775058  8527 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.775588  8527 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.718537  8320 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.782433  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:49.767400  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.780153  1677 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:49.715083  8497 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:02:49.787303  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.752673  8518 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.793637  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:49.794207  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.801508  1677 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:49.719442  8473 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:49.828538  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 191725us
I20260709 13:02:49.831741  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.786770  8475 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:49.835668  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:49.836985  1679 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:49.835595  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:49.855867  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:49.856380  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.857488  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.751744  8470 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:49.783593  8325 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.853199  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.866668  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.871745  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.872192  2260 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:49.882611  1677 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:02:49.800693  8527 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:49.883816  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.781644  8233 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:02:49.889478  1677 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:49.890599  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.835314  8230 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.893426  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.894136  1678 raft_consensus.cc:2368] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19.
I20260709 13:02:49.895037  1604 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:49.854889  8475 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:49.897495  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.901294  2259 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:49.902661  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.904780  1677 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:49.904568  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:49.901743  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.904568  2260 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:49.905835  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.913012  1677 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:49.920689  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.922042  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:49.923244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:49.918761  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 254066us
I20260709 13:02:49.802142  8320 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.926074  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.941896  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:49.943931  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.893627  8161 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:49.802211  8518 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:49.978664  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.978153  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:49.998450  1677 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:49.999318  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:49.890717  8520 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:02:50.000653  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.861280  8509 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.024905  1607 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 11.
I20260709 13:02:49.922763  8527 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:49.942718  8454 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:49.924261  8497 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:50.030568  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:49.945390  8468 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:50.040055  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 204523us
I20260709 13:02:50.021317  8313 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.988453  8531 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:50.022351  8488 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:49.918346  8222 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:49.910322  8528 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.050985  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:49.923859  8230 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.044082  1500 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.033238  8527 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.050894  8393 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.912271  8233 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 13:02:50.035432  8457 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.053342  8385 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.054932  8533 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:50.109054  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 253260us
I20260709 13:02:50.128955  1499 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:50.104839  8524 log.cc:927] Time spent T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
W20260709 13:02:50.130908  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 208913us
I20260709 13:02:50.105587  8527 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:50.139263  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.034680  8475 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:50.142946  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.108052  8457 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:50.141994  2227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.871s (SENT) [suppressed 6 similar messages]
W20260709 13:02:50.163528  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 119535us
W20260709 13:02:50.166244  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 224423us
I20260709 13:02:50.170202  8230 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.177224  8518 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:50.170336  8534 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:02:50.108271  8393 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.214301  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:50.147652  8069 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.005s
I20260709 13:02:50.146782  8473 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.161113  8457 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.213801  8222 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.130975  8385 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.228740  7787 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.216660  8325 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:50.228772  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 99905.1us
I20260709 13:02:50.271389  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:50.230526  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 66128.5us
I20260709 13:02:50.231181  8543 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:50.217571  8532 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:02:50.258351  8320 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.179072  8535 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:50.223488  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:50.229360  8520 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:50.215325  8470 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:50.222254  8475 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.132938  8533 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:50.272809  2257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.008s
W20260709 13:02:50.289620  2257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.008s
I20260709 13:02:50.275269  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:50.241299  8069 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.293507  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:50.271051  8262 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.000s
I20260709 13:02:50.280581  8233 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.266762  7787 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.285883  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.169340  8161 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.286561  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3075) took 1402 ms. Trace:
I20260709 13:02:50.299618  1532 rpcz_store.cc:276] 0709 13:02:48.884459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.050841 (+166382us) service_pool.cc:224] Handling call
0709 13:02:49.060059 (+  9218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.086204 (+ 26145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.086270 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.086336 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:49.086397 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.286348 (+1199951us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54003430d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:50.286394 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.286508 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59440896}
I20260709 13:02:50.286549  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.302413  1600 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:50.268211  8222 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:50.292781  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.282009  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.265937  8527 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.303035  1602 raft_consensus.cc:2410] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:02:50.281066  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.028s
I20260709 13:02:50.296401  8262 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.305310  1608 raft_consensus.cc:2368] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:02:50.306859  8230 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.307334  8551 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:02:50.294618  8528 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.312764  1525 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:50.315979  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.008s	sys 0.028s
I20260709 13:02:50.297695  8509 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.297075  8520 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:50.301184  7787 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.323617  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.287344  8535 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.324510  1600 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:50.318143  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:50.325455  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:50.326049  1532 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:50.326447  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.327901  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.329146  1602 raft_consensus.cc:2410] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:50.319025  8230 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.332044  8527 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.332867  8230 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.319242  8528 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:50.333685  8528 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.326680  8062 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:50.336764  8062 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.339008  8062 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.326390  8140 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:50.339398  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3183) took 1388 ms. Trace:
I20260709 13:02:50.339804  1676 rpcz_store.cc:276] 0709 13:02:48.950495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.955123 (+  4628us) service_pool.cc:224] Handling call
0709 13:02:48.955431 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.991138 (+ 35707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.991173 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.011664 (+ 20491us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.096105 (+ 84441us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:49.096146 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.096560 (+   414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.337569 (+1241009us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b240022b038. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a82fb0 00007f7e636f9488 00007f7e636f9be8 00007f7e636d1398 00007f7e636cc76a 00007f7e636cbbb6
0709 13:02:50.339071 (+  1502us) raft_consensus.cc:1685] finished
0709 13:02:50.339094 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.339320 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28003,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":18928,"spinlock_wait_cycles":144217856,"thread_start_us":73134,"threads_started":2,"wal-append.queue_time_us":36374}
I20260709 13:02:50.341711  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:50.342370  1676 raft_consensus.cc:606] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.343103  8528 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.326777  8518 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:50.344270  8518 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.345139  1674 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:50.346392  8518 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.346658  1674 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:50.347816  1674 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:50.348896  8520 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.339766  8140 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.351367  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:02:50.353235  1533 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.353571  1533 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:50.354058  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.354758  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:50.355234  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.355526  1528 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:50.356155  8069 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.354234  8509 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:50.357929  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:50.316578  8233 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:50.354899  8140 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.354839  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:50.358907  1600 raft_consensus.cc:2410] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:50.359508  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.356518  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.362138  1528 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:50.361634  1529 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:50.363813  1600 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:50.366817  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:50.367563  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.360587  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:50.349854  8222 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.371557  2227 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.349699  8283 raft_consensus.cc:3055] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:50.351083  8528 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.373003  8325 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:50.384702  8325 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.385082  8325 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:50.390306  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 296699us
I20260709 13:02:50.372768  8488 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:50.360252  8262 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:50.450739  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3178) took 1446 ms (client timeout 1887 ms). Trace:
I20260709 13:02:50.383544  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:50.377619  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.453841  2254 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:50.359980  8247 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.383864  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:50.374662  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 49311.2us
I20260709 13:02:50.360266  8509 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:50.450591  1533 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:50.451120  1681 rpcz_store.cc:269] 0709 13:02:48.949189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.952962 (+  3773us) service_pool.cc:224] Handling call
0709 13:02:50.395548 (+1442586us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540024a4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:50.395676 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351447808}
I20260709 13:02:50.468442  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.468822  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3153) took 1059 ms. Trace:
I20260709 13:02:50.469175  1679 rpcz_store.cc:276] 0709 13:02:49.409290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.027359 (+618069us) service_pool.cc:224] Handling call
0709 13:02:50.027694 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.036256 (+  8562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.036289 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.055402 (+ 19113us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.306447 (+251045us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:50.306473 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.306518 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.468619 (+162101us) raft_consensus.cc:1685] finished
0709 13:02:50.468639 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.468767 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8155,"raft.queue_time_us":23210,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4985,"thread_start_us":197893,"threads_started":1,"wal-append.queue_time_us":233067}
I20260709 13:02:50.374055  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.449735  8545 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:50.377357  8062 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.456880  1605 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:50.453974  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.383927  8473 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.458248  1674 raft_consensus.cc:1240] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:02:50.458307  1602 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:50.456120  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.462157  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:50.465031  1532 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
W20260709 13:02:50.473281  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 99271.6us
I20260709 13:02:50.467715  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.480022  1528 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:50.377070  8283 raft_consensus.cc:740] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:50.483639  8062 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.487412  1534 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:50.492810  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:50.495757  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.498427  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.500631  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:50.501300  1674 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:50.501394  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:50.502027  1681 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
W20260709 13:02:50.505019  8391 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
I20260709 13:02:50.472087  8140 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:50.505539  8391 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.506181  8140 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:50.506929  8385 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:50.507930  8533 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.509413  8535 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.474936  8545 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.510125  8545 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.475060  8316 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:50.474689  8525 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:50.513612  8525 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.514331  8391 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.514988  1527 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:50.516518  1679 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:50.516937  1674 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:02:50.518362  8457 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.520866  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.522365  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.523600  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.532169  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.532886  1532 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:50.471750  8064 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.536558  1528 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:50.540030  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.543419  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.545908  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:50.550313  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:50.549340  1604 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:50.552618  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:50.553189  1604 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:50.376787  8233 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.553977  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.554010  1500 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.558233  1602 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:50.557000  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:50.527451  8230 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.559815  8230 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.560348  1674 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:50.560859  8527 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:50.561370  8527 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.561707  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:50.562384  1674 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.563432  8136 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:02:50.564647  8457 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.565796  8230 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.561755  8527 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:50.572096  1674 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:50.577212  8509 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.578366  8509 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:50.474525  8247 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.581122  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:50.581768  1679 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:50.582572  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:50.583086  1679 raft_consensus.cc:606] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.583441  1679 raft_consensus.cc:614] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:50.586366  1601 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:50.500696  8393 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.485520  8488 consensus_queue.cc:1059] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
W20260709 13:02:50.592008  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 93670.7us
I20260709 13:02:50.593124  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.594686  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.506613  8140 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:50.597249  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57827.1us
I20260709 13:02:50.553241  8549 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:50.606061  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119544us
I20260709 13:02:50.605290  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.607734  1499 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:50.610399  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:50.611238  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 128766us
I20260709 13:02:50.612665  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.583307  8535 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.616079  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:50.548226  8391 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:02:50.618366  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:02:50.674849  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64568.9us
I20260709 13:02:50.620996  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.557565  8064 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.675879  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.599875  8502 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.599568  8470 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.681412  1602 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:50.690814  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3181) took 1740 ms. Trace:
I20260709 13:02:50.614286  8531 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:50.672648  1679 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
W20260709 13:02:50.682286  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61370.9us
I20260709 13:02:50.616993  7787 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.607718  8457 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.601372  8533 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:50.677600  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:50.601105  8552 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:50.607386  8497 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.689761  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1250) took 1277 ms. Trace:
W20260709 13:02:50.681993  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63714us
I20260709 13:02:50.671907  8316 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.669888  8161 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:50.705675  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.676175  8528 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:50.700413  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c802947c11486798c253f6688083e7"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:50.676379  8393 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:50.689083  8535 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.692196  1682 rpcz_store.cc:276] 0709 13:02:48.949977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.960514 (+ 10537us) service_pool.cc:224] Handling call
0709 13:02:48.960811 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.998014 (+ 37203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.998044 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.012475 (+ 14431us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.140164 (+127689us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b48001b0258. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:02:49.171121 (+ 30957us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:49.507671 (+336550us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.507975 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.690526 (+1182551us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540024aed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:50.690580 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.690622 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:50.690633 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.690760 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7997,"prepare.queue_time_us":453580,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":924,"raft.queue_time_us":18993,"raft.run_cpu_time_us":2102,"raft.run_wall_time_us":158338,"spinlock_wait_cycles":69844608,"thread_start_us":434919,"threads_started":2,"wal-append.queue_time_us":159421,"wal-append.run_cpu_time_us":21945,"wal-append.run_wall_time_us":1459432}
I20260709 13:02:50.621207  8549 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.703356  8502 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:50.683171  1600 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:50.728250  8568 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.728730  8568 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.699353  8457 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.729382  8457 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.702333  8552 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:02:50.732406  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.723479  8518 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.724575  8558 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:02:50.724938  8559 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:50.728055  8528 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.708138  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:50.720361  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.711305  1676 rpcz_store.cc:276] 0709 13:02:49.411868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.343325 (+931457us) service_pool.cc:224] Handling call
0709 13:02:50.343630 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.374601 (+ 30971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.374634 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.442056 (+ 67422us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.549902 (+107846us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:50.552149 (+  2247us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.688835 (+136686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.689502 (+   667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.689547 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:50.689561 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.689701 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107451,"prepare.queue_time_us":1226,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":196411,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":29354,"thread_start_us":154729,"threads_started":2,"wal-append.queue_time_us":81807}
I20260709 13:02:50.730360  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.714529  8393 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.729082  8568 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.726441  8563 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:50.709694  8497 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.739876  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:50.733641  1604 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:50.744504  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:50.734189  8502 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:50.748893  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:50.746366  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.744081  8250 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:50.750080  8119 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:50.750550  8119 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.750890  8119 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.752622  1682 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:50.705457  8140 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.750169  8250 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:50.757776  7787 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.758023  8064 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:50.759148  8526 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.910s	user 0.000s	sys 0.014s
I20260709 13:02:50.759680  8563 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.760223  8563 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.762982  8393 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.764251  8563 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:50.758334  8250 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.775633  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:50.767640  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.776136  8325 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.763949  8502 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.743388  8531 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.741940  8233 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.781735  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:50.757170  8543 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:50.773139  8119 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.737404  8518 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.704990  8520 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:50.785045  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 179850us
W20260709 13:02:50.771093  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.786815  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:50.793993  8535 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:50.794363  2261 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:50.799963  1525 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:50.788734  8309 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:50.789574  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:50.822329  2260 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.790868  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:50.792174  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:50.822988  2255 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:02:50.793162  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:50.792062  8518 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.786892  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:50.801610  2261 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:50.803176  8527 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.804175  8140 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.804742  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:50.805945  8119 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.780014  8552 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.780763  8531 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.807947  8535 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.808702  8545 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.810002  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:50.806130  8457 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.817869  8543 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:50.787669  8247 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.824730  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:50.843114  2255 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:50.823122  2253 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 12.
I20260709 13:02:50.843875  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:50.793098  2256 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 13 to 16, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:50.834820  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:50.824911  8452 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.826784  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.846802  1525 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:50.849717  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:50.837577  8518 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.851279  1679 raft_consensus.cc:606] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:50.850914  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:50.852667  1681 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:50.854046  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.854911  1525 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:50.838223  8316 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.838564  8531 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.858328  2255 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:02:50.844692  8552 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.864647  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.868758  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:50.894870  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.853400  8320 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:50.861656  8161 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.841763  8535 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.898002  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:50.854637  8518 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:50.897083  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:50.850886  8247 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:50.858943  8452 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.896229  8563 raft_consensus.cc:2764] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:02:50.916163  8572 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:02:50.917622  8545 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.891783  8325 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.923599  8325 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:50.924019  8325 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:50.924392  8325 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:50.897766  8161 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.928525  8161 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.935956  8161 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.945220  8535 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:02:50.945708  8452 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.953006  8457 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:50.865679  8316 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.951989  2260 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:50.900664  8518 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.963657  8227 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.940253  8574 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:50.968672  8575 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:50.969312  8393 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:50.969825  8393 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:50.918200  8543 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.972601  8393 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:50.969309  8575 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:50.977824  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.959908  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62890.2us
I20260709 13:02:50.980443  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:50.993429  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:50.994342  8580 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.995272  8580 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.997761  8580 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:50.867755  8230 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:50.999799  8563 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:51.006631  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.007740  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.008095  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.012470  8563 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:51.004293  8247 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:51.007144  8320 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:51.023360  8572 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:51.035179  8572 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.037356  8572 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:51.037988  8575 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:51.040294  8230 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:51.024125  8247 consensus_queue.cc:1059] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:02:51.015435  8325 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.069711  8161 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:51.073045  8586 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:51.045580  8316 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:51.075179  8586 raft_consensus.cc:3055] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:51.075677  8586 raft_consensus.cc:740] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:51.078155  8325 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:51.084363  8222 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.084002  8568 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:51.087392  8568 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:51.085177  8586 consensus_queue.cc:260] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.044198  8531 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:51.099561  8531 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:51.085007  8222 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.323844  8320 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.604206  8563 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:51.619518  8316 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:51.653542  8518 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:02:51.640317  8563 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.641050  8316 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:51.668288  8583 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.666s
I20260709 13:02:51.668146  8518 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:51.971020  8582 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:52.014994  8384 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:52.016047  8582 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:52.016701  8384 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:52.017654  8384 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:52.018644  8384 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.020601  8518 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:52.021237  8563 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:52.020067  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3161) took 2608 ms (client timeout 1516 ms). Trace:
W20260709 13:02:52.022122  1683 rpcz_store.cc:269] 0709 13:02:49.411395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.510661 (+ 99266us) service_pool.cc:224] Handling call
0709 13:02:52.019839 (+2509178us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54000ec9d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:52.019974 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31443712}
I20260709 13:02:52.024996  8316 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:52.022472  8530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.019s	sys 0.047s
W20260709 13:02:52.031291  8530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.869s	user 0.019s	sys 0.047s
I20260709 13:02:52.035344  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:52.037137  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 165437us
I20260709 13:02:52.037772  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3171) took 1267 ms. Trace:
I20260709 13:02:52.038645  1683 rpcz_store.cc:276] 0709 13:02:50.770352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.026493 (+1256141us) service_pool.cc:224] Handling call
0709 13:02:52.037688 (+ 11195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.039872  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:52.040711  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3172) took 1270 ms. Trace:
I20260709 13:02:52.041036  1683 rpcz_store.cc:276] 0709 13:02:50.770677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.039552 (+1268875us) service_pool.cc:224] Handling call
0709 13:02:52.040639 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.041975  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:52.042912  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3204) took 1179 ms. Trace:
I20260709 13:02:52.043265  1683 rpcz_store.cc:276] 0709 13:02:50.863425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.041702 (+1178277us) service_pool.cc:224] Handling call
0709 13:02:52.042852 (+  1150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.044292  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:52.045042  1683 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:52.044816  8461 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:52.034556  8316 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.053648  8582 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:52.052129  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1270) took 1303 ms. Trace:
I20260709 13:02:52.054035  8316 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:52.054584  1683 rpcz_store.cc:276] 0709 13:02:50.749089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.043887 (+1294798us) service_pool.cc:224] Handling call
0709 13:02:52.052040 (+  8153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.055586  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:52.056195  1683 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:52.056886  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3206) took 1037 ms. Trace:
I20260709 13:02:52.057410  8316 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:52.057200  1683 rpcz_store.cc:276] 0709 13:02:51.019052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.055320 (+1036268us) service_pool.cc:224] Handling call
0709 13:02:52.056832 (+  1512us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:52.066256  2226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.008s	sys 0.000s
W20260709 13:02:52.066906  2226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.009s	sys 0.000s
W20260709 13:02:52.067199  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 1.04942e+06us
I20260709 13:02:52.066514  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1268) took 1318 ms. Trace:
I20260709 13:02:52.069052  1683 rpcz_store.cc:276] 0709 13:02:50.747982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.065066 (+1317084us) service_pool.cc:224] Handling call
0709 13:02:52.065415 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.065584 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.065607 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:52.065646 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:52.065680 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.065728 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.065839 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.366922  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:52.367872  2260 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:52.369890  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:52.370834  2255 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:52.452777  2260 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:02:52.455355  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 126758us
I20260709 13:02:52.613188  8453 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:52.770855  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:52.771646  2252 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:52.782886  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 511550us
I20260709 13:02:52.866003  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:52.895094  8595 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:52.913106  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:52.913722  8595 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:52.948589  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:52.981197  2227 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.970s (SENT)
W20260709 13:02:52.999600  2227 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 2.152s (SENT)
I20260709 13:02:53.000105  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:53.402602  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:53.403749  2261 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:53.424870  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.024s	sys 0.071s
W20260709 13:02:53.425556  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.024s	sys 0.072s
W20260709 13:02:53.436592  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.015s	sys 0.052s
W20260709 13:02:53.437055  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.015s	sys 0.052s
W20260709 13:02:53.437606  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.438418  2256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.030s	sys 0.037s
W20260709 13:02:53.438776  2256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.030s	sys 0.037s
W20260709 13:02:53.441028  8453 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.827s	user 0.009s	sys 0.000s
I20260709 13:02:53.445123  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:53.445809  2254 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.449247  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:53.450662  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:53.451313  2261 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:53.453727  8595 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:53.455101  2254 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:53.456879  8595 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.460476  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:53.466985  8472 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:53.467723  8236 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:53.469563  8595 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:53.474313  8601 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:53.473480  2226 connection.cc:256] RPC call timeout handler was delayed by -1.3325014080000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:02:53.495667  8600 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:53.496356  8600 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:53.497582  8525 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:53.498700  8600 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:53.499300  8600 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:53.500350  8600 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:53.501165  8597 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:53.501742  8597 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:53.502673  8600 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:53.503875  8597 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:53.504029  8586 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:53.495246  2226 connection.cc:256] RPC call timeout handler was delayed by -1.3325014080000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:02:53.505350  2226 connection.cc:256] RPC call timeout handler was delayed by -1.2074014080000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:02:53.473081  8595 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:53.502641  8283 consensus_queue.cc:260] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:53.525957  1648 connection.cc:256] RPC call timeout handler was delayed by -1.5020340160000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31610000000000005s for a response
I20260709 13:02:53.527834  8283 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:53.515049  2260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.005s
W20260709 13:02:53.610299  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.006s
I20260709 13:02:53.613858  8593 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.214401  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.011s	sys 0.006s
I20260709 13:02:54.214671  8593 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:53.739074  1649 connection.cc:256] RPC call timeout handler was delayed by -2.6134205980000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:02:54.215554  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3201) took 3354 ms. Trace:
W20260709 13:02:54.216068  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.217237  1649 connection.cc:256] RPC call timeout handler was delayed by -2.4045305949999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:02:54.216063  1683 rpcz_store.cc:276] 0709 13:02:50.860892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.679138 (+1818246us) service_pool.cc:224] Handling call
0709 13:02:52.679511 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.679741 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:52.950733 (+270992us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.215107 (+1264374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.215173 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:54.215229 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.215307 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.215487 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":815194,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":1534435,"threads_started":2,"wal-append.queue_time_us":662976}
I20260709 13:02:54.218572  1683 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:54.219249  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3202) took 3358 ms. Trace:
I20260709 13:02:54.219635  1683 rpcz_store.cc:276] 0709 13:02:50.861136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.218022 (+3356886us) service_pool.cc:224] Handling call
0709 13:02:54.218388 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.218995 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.219190 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:54.224992  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3205) took 3210 ms. Trace:
I20260709 13:02:54.225696  1676 rpcz_store.cc:276] 0709 13:02:51.014403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.223569 (+3209166us) service_pool.cc:224] Handling call
0709 13:02:54.224172 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.224618 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.224644 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.224691 (+    47us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:54.224731 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.224783 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.224925 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:54.231648  2260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.009s	sys 0.009s
I20260709 13:02:54.113214  1680 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:54.338883  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1522) took 1878 ms. Trace:
I20260709 13:02:54.339346  2260 rpcz_store.cc:276] 0709 13:02:52.460502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.460708 (+   206us) service_pool.cc:224] Handling call
0709 13:02:52.528400 (+ 67692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.951751 (+423351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.951784 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.952382 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.338445 (+1386063us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:54.338497 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.338581 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.338635 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:54.338647 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.338808 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118794,"raft.queue_time_us":927947,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":63,"thread_start_us":1689644,"threads_started":2,"wal-append.queue_time_us":575666}
I20260709 13:02:54.578655  8618 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.579526  8618 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:54.582734  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3203) took 3721 ms. Trace:
I20260709 13:02:54.583292  1683 rpcz_store.cc:276] 0709 13:02:50.861311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.220439 (+3359128us) service_pool.cc:224] Handling call
0709 13:02:54.220746 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.220948 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:54.358707 (+137759us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.582182 (+223475us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.582360 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.582405 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:54.582472 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.582541 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.582674 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":137187,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"thread_start_us":359860,"threads_started":3,"wal-append.queue_time_us":44214}
W20260709 13:02:54.598469  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 3295) took 4244 ms (client timeout 3161 ms). Trace:
W20260709 13:02:54.599097  1527 rpcz_store.cc:269] 0709 13:02:50.353689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.353803 (+   114us) service_pool.cc:224] Handling call
0709 13:02:54.598142 (+4244339us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002ce054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:54.598342 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368216448}
I20260709 13:02:54.600186  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50480 (request call id 44) took 3900 ms. Trace:
W20260709 13:02:54.600495  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 3096) took 3589 ms (client timeout 2299 ms). Trace:
W20260709 13:02:54.626576  1527 rpcz_store.cc:269] 0709 13:02:51.011439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.600265 (+3588826us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:54.600410 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:54.608057  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6720 after lost signal to thread 431
W20260709 13:02:54.993055  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003550a0 after lost signal to thread 434
I20260709 13:02:54.716202  8618 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:54.993347  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 3095) took 3983 ms (client timeout 3005 ms). Trace:
W20260709 13:02:54.741719  2225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.011s	sys 0.002s
W20260709 13:02:54.994210  2225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.556s	user 0.011s	sys 0.002s
I20260709 13:02:54.743201  8062 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:54.600778  1679 rpcz_store.cc:276] 0709 13:02:50.700053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.700246 (+   193us) service_pool.cc:224] Handling call
0709 13:02:54.599981 (+3899735us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003566d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2b853 00007f7e68af960a 00007f7e6207f7d4 00007f7e6207f762 00007f7e6207f691 00007f7e6207f60c 00007f7e6207e8c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:54.600090 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322886016}
I20260709 13:02:54.995478  1530 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:54.779862  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.812s	user 0.026s	sys 0.050s
W20260709 13:02:54.996248  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.029s	user 0.026s	sys 0.050s
I20260709 13:02:54.788791  8622 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.997452  8622 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:54.999799  8622 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:54.834569  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.000725  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.001514  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.002591  8622 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:54.837904  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.018s	sys 0.021s
I20260709 13:02:55.002933  8618 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:55.003350  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.018s	sys 0.022s
W20260709 13:02:55.003692  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.003496  8618 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:55.004125  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.004492  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.856119  8453 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:55.005569  8453 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.006453  8618 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.007004  8618 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.007665  8453 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.007433  8618 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:54.922894  8473 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:54.923568  8385 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.008519  8622 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.008855  8385 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.010908  8622 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.008214  8453 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.011119  8473 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.010916  8385 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.012629  8385 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.013139  8385 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.015322  8385 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:55.015808  8385 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.016268  8385 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.018411  8385 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:54.774497  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3571865460000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:02:55.011709  8453 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.030025  8538 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.030715  8453 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.019873  8618 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.021633  8473 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:54.969187  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.006s	sys 0.004s
W20260709 13:02:55.033064  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.006s	sys 0.004s
W20260709 13:02:55.033696  1649 connection.cc:256] RPC call timeout handler was delayed by -1.8872767279999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:02:55.034251  1649 connection.cc:256] RPC call timeout handler was delayed by -1.5166871249999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2271s for a response
W20260709 13:02:55.034608  1649 connection.cc:256] RPC call timeout handler was delayed by -1.4507873069999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:02:55.034950  1649 connection.cc:256] RPC call timeout handler was delayed by -1.4119205979999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30350000000000005s for a response
W20260709 13:02:55.035279  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3929518399999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:02:54.968709  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 357125us
W20260709 13:02:55.035606  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3918371629999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:02:55.073652  1649 connection.cc:256] RPC call timeout handler was delayed by -1.1689205979999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3305s for a response
I20260709 13:02:55.043366  8622 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.074661  8622 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.076122  8630 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.082222  8630 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.047933  8236 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.032895  8593 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:55.072275  8453 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.083491  8236 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.077035  8628 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.036887  8618 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.090013  8618 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.090835  8236 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:54.993785  1527 rpcz_store.cc:269] 0709 13:02:51.009680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.993104 (+3983424us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:54.993283 (+   179us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:55.092237  8618 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.092110  8628 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:55.079694  2255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.322s	user 0.015s	sys 0.009s
I20260709 13:02:55.079854  8622 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.080680  8615 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.095803  8316 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:55.081321  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800377660 after lost signal to thread 1417
I20260709 13:02:55.096190  8615 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:55.074097  1649 connection.cc:256] RPC call timeout handler was delayed by -1.160751839999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:02:55.081473  8391 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.052841  1531 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:54.996483  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3086) took 4523 ms. Trace:
I20260709 13:02:55.099116  8391 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.099575  1530 rpcz_store.cc:276] 0709 13:02:50.473545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.994887 (+4521342us) service_pool.cc:224] Handling call
0709 13:02:54.995287 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.996194 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.996425 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.100922  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.101286  8391 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.102185  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.103432  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.103952  8391 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.104406  1530 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:55.104600  8391 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.084431  8453 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:55.087459  8283 consensus_meta.cc:287] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 1.559s	user 0.007s	sys 0.008s
I20260709 13:02:55.092547  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:55.106720  1527 raft_consensus.cc:2376] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16. Re-sending same reply.
I20260709 13:02:55.083670  8542 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.030678  8538 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:50.057785  1417 catalog_manager.cc:5028] TS 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 (table test-workload [id=3db9e625d24344f697ace3b984e6ad1e]) successfully deleted
W20260709 13:02:55.078871  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52840.8us
W20260709 13:02:55.094135  2255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.336s	user 0.015s	sys 0.010s
I20260709 13:02:55.096242  8316 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:55.107795  1417 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 5.052e+06us
I20260709 13:02:55.105264  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:55.172503  1649 connection.cc:256] RPC call timeout handler was delayed by -1.1250969970000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2919s for a response
W20260709 13:02:55.173033  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0220625979999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:02:55.164623  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.111819  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.174824  1532 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
W20260709 13:02:55.147594  1525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.132s	user 0.067s	sys 0.084s
W20260709 13:02:55.177385  1525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.162s	user 0.068s	sys 0.089s
W20260709 13:02:55.181449  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.539s (SENT) [suppressed 30 similar messages]
I20260709 13:02:55.187031  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3085) took 4707 ms. Trace:
I20260709 13:02:55.187517  1525 rpcz_store.cc:276] 0709 13:02:50.473131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.903360 (+430229us) service_pool.cc:224] Handling call
0709 13:02:50.903664 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.959056 (+ 55392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.959093 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.992105 (+ 33012us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.179989 (+4187884us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:55.180020 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.180071 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.180101 (+    30us) raft_consensus.cc:1685] finished
0709 13:02:55.180108 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.180207 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":38048,"thread_start_us":4164839,"threads_started":1,"wal-append.queue_time_us":709187,"wal-append.run_cpu_time_us":2041,"wal-append.run_wall_time_us":1303870}
I20260709 13:02:55.189886  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.190801  1525 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:02:55.191203  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.192796  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.193706  1532 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:55.180732  8592 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.194533  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.194983  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.195220  1532 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:55.195593  2226 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.688s (SENT)
I20260709 13:02:55.195694  7614 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:55.196043  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:55.197791  1647 connection.cc:256] RPC call timeout handler was delayed by -4.0926192539999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:02:55.198896  8527 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.199200  8622 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.199673  8622 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.200671  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.200913  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.201512  1525 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:55.201898  8622 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.202090  1527 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:55.199740  8592 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.196053  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.202615  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3093) took 4598 ms. Trace:
I20260709 13:02:55.203018  1527 rpcz_store.cc:276] 0709 13:02:50.604354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.201534 (+4597180us) service_pool.cc:224] Handling call
0709 13:02:55.201783 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.202405 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.202564 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.203960  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1520) took 4443 ms. Trace:
I20260709 13:02:55.166199  8391 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.111933  8615 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.144234  8453 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.113379  8236 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.220729  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.326s	user 0.107s	sys 0.107s
I20260709 13:02:55.204236  1527 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 17. Ops: [15.13-15.13]
I20260709 13:02:55.231031  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1523) took 2494 ms. Trace:
I20260709 13:02:55.236958  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3219) took 4759 ms. Trace:
I20260709 13:02:55.118546  8627 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.216184  2252 raft_consensus.cc:2410] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:02:55.218034  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3168) took 4672 ms (client timeout 1676 ms). Trace:
W20260709 13:02:55.252931  1681 rpcz_store.cc:269] 0709 13:02:50.545652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.550021 (+  4369us) service_pool.cc:224] Handling call
0709 13:02:55.217722 (+4667701us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.217908 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693225344}
I20260709 13:02:55.208196  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:55.232354  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33608 (request call id 3082) took 5596 ms (client timeout 1549 ms). Trace:
W20260709 13:02:55.230991  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1383) took 5511 ms (client timeout 2477 ms). Trace:
W20260709 13:02:55.246729  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51149.7us
I20260709 13:02:55.204335  1532 rpcz_store.cc:276] 0709 13:02:50.760489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.203251 (+4442762us) service_pool.cc:224] Handling call
0709 13:02:55.203523 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.203681 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.203706 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.203750 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:55.203780 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.203827 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.203911 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:55.249864  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.355s	user 0.107s	sys 0.109s
I20260709 13:02:55.254503  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1521) took 4493 ms. Trace:
I20260709 13:02:55.254068  1530 raft_consensus.cc:2410] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:55.257452  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3217) took 4790 ms. Trace:
W20260709 13:02:55.254287  1531 rpcz_store.cc:269] 0709 13:02:49.636213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.636408 (+   195us) service_pool.cc:224] Handling call
0709 13:02:55.232132 (+5595724us) spinlock_profiling.cc:243] Waited 5.41 s on lock 0x7b54000b4ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.232253 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12440664960}
I20260709 13:02:55.250705  2255 rpcz_store.cc:276] 0709 13:02:52.736708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.736918 (+   210us) service_pool.cc:224] Handling call
0709 13:02:52.737320 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.737588 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:02:55.176855 (+2439267us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.230625 (+ 53770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.230683 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:55.230737 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.230804 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.230942 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33455,"prepare.queue_time_us":874229,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":33810,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":2435901,"threads_started":2}
I20260709 13:02:55.258708  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:55.259320  2260 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.259578  1531 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:55.095808  8628 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:55.257921  1600 rpcz_store.cc:276] 0709 13:02:50.466694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.731744 (+265050us) service_pool.cc:224] Handling call
0709 13:02:50.737830 (+  6086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.738032 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:50.845344 (+107312us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.257011 (+4411667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.257077 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:55.257127 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.257271 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.257398 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181288,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":76927,"spinlock_wait_cycles":18745088,"thread_start_us":4506904,"threads_started":3,"wal-append.queue_time_us":115470,"wal-append.run_cpu_time_us":1108,"wal-append.run_wall_time_us":1018785}
I20260709 13:02:55.260152  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3097) took 4243 ms. Trace:
I20260709 13:02:55.257068  1527 rpcz_store.cc:276] 0709 13:02:50.760783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.203739 (+4442956us) service_pool.cc:224] Handling call
0709 13:02:55.204028 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.254204 (+ 50176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.254443 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.280072  1531 rpcz_store.cc:276] 0709 13:02:51.017260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.258989 (+4241729us) service_pool.cc:224] Handling call
0709 13:02:55.259259 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.259907 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.260098 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.281759  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.282176  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.282763  2255 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:55.284181  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:55.285005  2255 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.294824  2253 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:02:55.281795  1607 rpcz_store.cc:269] 0709 13:02:49.719657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.746026 (+ 26369us) service_pool.cc:224] Handling call
0709 13:02:55.230729 (+5484703us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.230875 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638953728}
I20260709 13:02:55.296103  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.296485  1532 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:55.297065  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1522) took 4536 ms. Trace:
I20260709 13:02:55.297415  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:55.297423  1532 rpcz_store.cc:276] 0709 13:02:50.761042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.255967 (+4494925us) service_pool.cc:224] Handling call
0709 13:02:55.296156 (+ 40189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.296853 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.297017 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.298143  2255 raft_consensus.cc:2376] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13. Re-sending same reply.
I20260709 13:02:55.234746  1432 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.298887  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.299017  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.254807  1602 rpcz_store.cc:276] 0709 13:02:50.477061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.753654 (+276593us) service_pool.cc:224] Handling call
0709 13:02:50.754020 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.815602 (+ 61582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.815630 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.816209 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.858801 (+ 42592us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:50.858846 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.236435 (+4377589us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54001bd5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:55.236515 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.236575 (+    60us) raft_consensus.cc:1685] finished
0709 13:02:55.236587 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.236867 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":140634880,"thread_start_us":25974,"threads_started":1,"wal-append.queue_time_us":48021,"wal-append.run_cpu_time_us":1859,"wal-append.run_wall_time_us":1102973}
I20260709 13:02:55.299649  2254 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:55.199119  8630 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.258440  8291 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.304639  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:55.306120  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003546e0 after lost signal to thread 1466
I20260709 13:02:55.307494  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.308152  2255 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:55.310150  1533 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.310701  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33602 (request call id 3291) took 4959 ms. Trace:
I20260709 13:02:55.311017  1533 rpcz_store.cc:276] 0709 13:02:50.351095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.351215 (+   120us) service_pool.cc:224] Handling call
0709 13:02:55.309322 (+4958107us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b4c0019e340. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e61dfda20 00007f7e61e0ea29 00007f7e61e0f13f 00007f7e61dd32ab 00007f7e61e00f3c 00007f7e61e013fe 00007f7e6208e88b 00007f7e63a8d495 00007f7e63ade30f 00007f7e63b28a55 00007f7e68af8cd0
0709 13:02:55.310585 (+  1263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90914560}
I20260709 13:02:55.311679  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:55.313025  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.314091  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:55.314086  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.315416  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:55.315721  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:55.316327  8247 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:55.316705  2226 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:55.316847  8247 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:55.317346  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1387) took 5421 ms (client timeout 1970 ms). Trace:
I20260709 13:02:55.199862  8618 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.223047  8222 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.321431  2257 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:55.318933  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.318974  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:55.317770  1608 rpcz_store.cc:269] 0709 13:02:49.896237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.898454 (+  2217us) service_pool.cc:224] Handling call
0709 13:02:55.317121 (+5418667us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400026f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.317268 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876861824}
I20260709 13:02:55.281059  8622 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.260489  8310 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:55.317816  8247 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.327951  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.330108  2260 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:55.331240  2259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1782) took 5579 ms (client timeout 2039 ms). Trace:
W20260709 13:02:55.332487  2259 rpcz_store.cc:269] 0709 13:02:49.741959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.742092 (+   133us) service_pool.cc:224] Handling call
0709 13:02:55.320983 (+5578891us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.321131 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268875136}
I20260709 13:02:55.206245  8316 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.341251  8316 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:55.331352  8618 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:55.345978  8347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.810s	user 0.002s	sys 0.012s
W20260709 13:02:55.346592  8347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.811s	user 0.002s	sys 0.012s
I20260709 13:02:55.347489  8618 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.318575  8626 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:55.358439  2253 raft_consensus.cc:2410] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:55.331679  8628 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:55.112049  8538 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.360594  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.284983  8627 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.284798  8236 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:55.270892  8542 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.366096  8627 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.366407  8542 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.333473  8629 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:55.337337  8310 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.367574  8629 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:55.368055  8629 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.370931  8310 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.371747  8580 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.335373  8622 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.372407  8580 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.359243  8626 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.373356  8626 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:55.373870  8622 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.374554  8580 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:55.374951  2227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.368s	user 0.018s	sys 0.022s
W20260709 13:02:55.375401  2227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.368s	user 0.019s	sys 0.022s
W20260709 13:02:55.362325  1647 connection.cc:256] RPC call timeout handler was delayed by -3.1423151249999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:02:55.376482  1647 connection.cc:256] RPC call timeout handler was delayed by -2.9317654199999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:02:55.376839  1647 connection.cc:256] RPC call timeout handler was delayed by -2.7760654199999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:02:55.377135  1647 connection.cc:256] RPC call timeout handler was delayed by -2.7409654199999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:02:55.377406  1647 connection.cc:256] RPC call timeout handler was delayed by -2.7346151250000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:02:55.377722  1647 connection.cc:256] RPC call timeout handler was delayed by -2.6608654199999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:02:55.378012  1647 connection.cc:256] RPC call timeout handler was delayed by -2.5267026490000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2332s for a response
W20260709 13:02:55.378293  1647 connection.cc:256] RPC call timeout handler was delayed by -2.474920037000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2411s for a response
W20260709 13:02:55.359795  2226 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.855s (SENT)
W20260709 13:02:55.376008  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 2.37625e+06us
W20260709 13:02:55.367681  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.346s	user 0.029s	sys 0.071s
I20260709 13:02:55.380474  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:55.381186  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.378579  1647 connection.cc:256] RPC call timeout handler was delayed by -2.4673654199999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:02:55.382133  1647 connection.cc:256] RPC call timeout handler was delayed by -2.413365419999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260709 13:02:55.382458  1647 connection.cc:256] RPC call timeout handler was delayed by -2.3827654199999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22519999999999998s for a response
W20260709 13:02:55.382776  1647 connection.cc:256] RPC call timeout handler was delayed by -2.203665419999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2451s for a response
I20260709 13:02:55.383437  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.384639  1674 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.386240  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.387638  8236 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.389424  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.390165  1675 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:55.390209  8592 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:02:55.393368  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.372s	user 0.030s	sys 0.071s
I20260709 13:02:55.395012  8067 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:55.399421  1674 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
W20260709 13:02:55.400218  2227 connection.cc:256] RPC call timeout handler was delayed by -2.173802008999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2788s for a response
I20260709 13:02:55.402704  8575 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:55.408728  2227 connection.cc:256] RPC call timeout handler was delayed by -2.1538362089999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:02:55.409220  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.408877  8575 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:55.409673  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.410687  2227 connection.cc:256] RPC call timeout handler was delayed by -1.5104117519999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2477s for a response
I20260709 13:02:55.412992  8592 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:55.413103  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3149) took 6004 ms (client timeout 1783 ms). Trace:
I20260709 13:02:55.413523  8592 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.414942  1677 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:55.404929  2259 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.415598  2259 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:55.384119  1647 connection.cc:256] RPC call timeout handler was delayed by -2.1856654199999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24710000000000001s for a response
W20260709 13:02:55.407667  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.408537  2256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.894s	user 0.013s	sys 0.011s
W20260709 13:02:55.416402  1647 connection.cc:256] RPC call timeout handler was delayed by -2.107365419999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25579999999999997s for a response
W20260709 13:02:55.416977  1647 connection.cc:256] RPC call timeout handler was delayed by -1.884165419999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2806s for a response
W20260709 13:02:55.417271  1647 connection.cc:256] RPC call timeout handler was delayed by -1.0894654199999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3689s for a response
W20260709 13:02:55.417665  2256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.903s	user 0.013s	sys 0.011s
I20260709 13:02:55.418260  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:55.418690  1678 rpcz_store.cc:269] 0709 13:02:49.408215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.570321 (+162106us) service_pool.cc:224] Handling call
0709 13:02:55.412873 (+5842552us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54003575d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.413028 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742155136}
I20260709 13:02:55.419517  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.420521  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3162) took 6008 ms. Trace:
I20260709 13:02:55.420265  1675 raft_consensus.cc:2368] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18.
I20260709 13:02:55.416524  2259 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.420928  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.421694  1679 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.421563  1682 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:55.421852  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.422770  8592 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:55.423290  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.421980  1677 rpcz_store.cc:276] 0709 13:02:49.411632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.272552 (+860920us) service_pool.cc:224] Handling call
0709 13:02:55.414754 (+5142202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.415372 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.420263 (+  4891us) spinlock_profiling.cc:243] Waited 5.13 s on lock 0x7b54003575d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.420435 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11803345792}
I20260709 13:02:55.424026  1682 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:02:55.423014  1678 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.397778  8538 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.429739  1682 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:55.431020  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3080) took 5796 ms. Trace:
I20260709 13:02:55.431649  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.421492  2259 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.432276  1682 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:55.432981  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.433779  2255 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 21: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:55.435210  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.437090  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.437922  1683 raft_consensus.cc:2410] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:02:55.446099  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.447616  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.448550  1677 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.449848  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.450663  1677 raft_consensus.cc:2368] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17.
I20260709 13:02:55.451913  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.452679  1674 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:55.451398  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.454623  1677 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:55.431460  1526 rpcz_store.cc:276] 0709 13:02:49.634551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.634675 (+   124us) service_pool.cc:224] Handling call
0709 13:02:49.641385 (+  6710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.669038 (+ 27653us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:49.669314 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.021521 (+1352207us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18003b44c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:02:55.393809 (+4372288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.393863 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:55.393907 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.430776 (+ 36869us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b54000b5ed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:55.430833 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.430956 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":18485,"raft.queue_time_us":98621,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":103590016,"thread_start_us":4372154,"threads_started":1}
I20260709 13:02:55.436053  1678 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:55.459610  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.460927  2259 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:55.462031  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.462607  2259 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:55.463440  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.381901  8291 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.464883  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.469365  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.410959  8575 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:55.451893  8629 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.485402  8385 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:55.638242  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:55.545703  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 335) took 15627 ms (client timeout 15000 ms). Trace:
W20260709 13:02:55.523733  1499 connection.cc:256] RPC call timeout handler was delayed by -3.1836647350000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:02:55.598013  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1517) took 4854 ms. Trace:
I20260709 13:02:55.600420  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1608) took 5236 ms. Trace:
I20260709 13:02:55.547266  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:55.620779  1648 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 2.091s (SENT)
W20260709 13:02:55.587211  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080027aec0 after lost signal to thread 1558
W20260709 13:02:55.561631  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.672152  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.634605  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:55.485107  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.626821  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3224) took 5098 ms. Trace:
I20260709 13:02:55.639235  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:55.620100  2252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1525) took 2754 ms (client timeout 2680 ms). Trace:
I20260709 13:02:55.522833  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:55.573701  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.555300  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.638841  1609 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:55.737499  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3220) took 5255 ms. Trace:
W20260709 13:02:55.549593  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.491441  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.842082  7614 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.627879  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.598536  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1399) took 5278 ms (client timeout 2134 ms). Trace:
I20260709 13:02:55.479995  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.488672  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.630039  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:55.555657  1682 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
W20260709 13:02:55.840844  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.604707  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:55.616801  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:55.839898  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080027ade0 after lost signal to thread 1559
I20260709 13:02:55.480957  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1518) took 3412 ms. Trace:
I20260709 13:02:55.632946  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:55.568905  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:55.843334  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 320554us
I20260709 13:02:55.544009  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.845742  1681 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:55.518671  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:55.841850  1499 connection.cc:256] RPC call timeout handler was delayed by -2.8649140730000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:02:55.524945  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.843897  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:55.479715  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.840167  1525 rpcz_store.cc:276] 0709 13:02:50.743989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.202059 (+4458070us) service_pool.cc:224] Handling call
0709 13:02:55.202306 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.367122 (+164816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.367153 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.367197 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:55.367232 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.597703 (+230471us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540042dbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:55.597758 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.597940 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378598272}
I20260709 13:02:55.848819  1605 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:55.627630  2227 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 2.477s (SENT)
I20260709 13:02:55.797859  2259 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:55.849756  1602 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
W20260709 13:02:55.847920  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003c78a0 after lost signal to thread 1633
I20260709 13:02:55.526754  1533 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:55.525934  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:55.845531  1601 rpcz_store.cc:269] 0709 13:02:50.320623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.330259 (+  9636us) service_pool.cc:224] Handling call
0709 13:02:55.598353 (+5268094us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54004380d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.598460 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475590016}
I20260709 13:02:55.846592  1531 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
W20260709 13:02:55.814610  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 441032us
I20260709 13:02:55.838263  1679 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.854861  1534 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:55.850185  1676 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:55.844137  7614 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.511353  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:55.588552  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1252) took 6112 ms (client timeout 1688 ms). Trace:
W20260709 13:02:55.591789  8554 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 5.238s	user 0.015s	sys 0.032s
I20260709 13:02:55.533473  1432 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 18 to 20, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.837720  2257 rpcz_store.cc:276] 0709 13:02:50.364000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.364116 (+   116us) service_pool.cc:224] Handling call
0709 13:02:55.321236 (+4957120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.322075 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.600146 (+278071us) spinlock_profiling.cc:243] Waited 4.94 s on lock 0x7b54002369d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.600301 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11360931072}
I20260709 13:02:55.875458  1683 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.876596  1675 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:55.676098  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 117334us
W20260709 13:02:55.858649  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 237911us
W20260709 13:02:55.845968  2252 rpcz_store.cc:269] 0709 13:02:52.865525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.865679 (+   154us) service_pool.cc:224] Handling call
0709 13:02:55.619770 (+2754091us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540040bfd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.619983 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5402102528}
I20260709 13:02:55.877669  2260 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:55.547950  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3299) took 5191 ms. Trace:
I20260709 13:02:55.878161  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:55.839249  2255 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:02:55.571945  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.847976  1678 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:02:55.851043  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.633126  8475 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.632537  8321 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.839891  1603 rpcz_store.cc:276] 0709 13:02:50.528708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.086794 (+3558086us) service_pool.cc:224] Handling call
0709 13:02:54.087215 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.087442 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:54.551396 (+463954us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.626443 (+1075047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.626500 (+    57us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:55.626557 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.626630 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.626746 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1041783,"prepare.queue_time_us":463929,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1042292,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":496418,"threads_started":2,"wal-append.queue_time_us":31835,"wal-append.run_cpu_time_us":1099,"wal-append.run_wall_time_us":1001113}
I20260709 13:02:55.843346  1606 rpcz_store.cc:276] 0709 13:02:50.482167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.032237 (+3550070us) service_pool.cc:224] Handling call
0709 13:02:54.032743 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.626123 (+1593380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.626162 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.626727 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.729300 (+102573us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:55.729364 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.729487 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.737175 (+  7688us) raft_consensus.cc:1685] finished
0709 13:02:55.737202 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.737413 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1592937,"raft.queue_time_us":1593057,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":102036,"threads_started":1,"wal-append.queue_time_us":102527}
W20260709 13:02:55.859360  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 290539us
I20260709 13:02:55.528481  8222 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:02:55.898279  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.895071  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.856042  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800291a60 after lost signal to thread 1707
W20260709 13:02:55.850826  1499 connection.cc:256] RPC call timeout handler was delayed by -2.6851895260000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:02:55.880517  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.893494  1530 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:55.883796  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.858111  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:55.875980  1680 rpcz_store.cc:269] 0709 13:02:49.476675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.549373 (+ 72698us) service_pool.cc:224] Handling call
0709 13:02:55.588273 (+6038900us) spinlock_profiling.cc:243] Waited 4.56 s on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:55.588477 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10491833600}
I20260709 13:02:55.904799  1677 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:55.879787  1681 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.846657  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.876111  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.902489  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.910502  2252 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:55.877367  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 249773us
I20260709 13:02:55.909884  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.886739  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:55.904330  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf2e0 after lost signal to thread 1708
W20260709 13:02:55.847690  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 217659us
I20260709 13:02:55.523070  8178 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.913282  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:55.534299  8549 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:55.913928  1600 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
W20260709 13:02:55.914063  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7c00 after lost signal to thread 2285
I20260709 13:02:55.519981  8570 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.925450  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003b69e0 after lost signal to thread 2286
I20260709 13:02:55.904601  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:55.523917  8233 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.909245  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:55.909695  2259 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:55.905423  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:55.856575  8306 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.878571  1529 rpcz_store.cc:276] 0709 13:02:50.356098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.362873 (+  6775us) service_pool.cc:224] Handling call
0709 13:02:50.363074 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.363225 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:50.370283 (+  7058us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.157034 (+4786751us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b180005c740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:02:55.252575 (+ 95541us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.366594 (+114019us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b180005c740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:02:55.519737 (+153143us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b180005c740. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:02:55.519959 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.520026 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:55.520082 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.520156 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.520295 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231805,"prepare.queue_time_us":6278,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":12043,"raft.queue_time_us":274781,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":15416,"spinlock_wait_cycles":99637632,"thread_start_us":94750,"threads_started":1,"wal-append.queue_time_us":4934143}
I20260709 13:02:55.944998  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.945690  1529 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:55.946585  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.510915  8533 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.880131  1674 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.632486  8347 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.904467  1499 connection.cc:256] RPC call timeout handler was delayed by -2.6606140730000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:02:55.668396  8488 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.247s
I20260709 13:02:55.527066  8631 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.879602  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.861430  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:55.907938  1682 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:55.913450  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:55.910959  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:55.915732  2253 raft_consensus.cc:2410] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:02:55.917049  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.847283  2256 rpcz_store.cc:276] 0709 13:02:52.068487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.523780 (+455293us) service_pool.cc:224] Handling call
0709 13:02:52.524247 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.439102 (+914855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.439133 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.439629 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.514565 (+ 74936us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:55.418105 (+1903540us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.480597 (+ 62492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.480681 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.480725 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:55.480737 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.480892 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122606,"prepare.queue_time_us":97496,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":932135,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":2845,"thread_start_us":2831272,"threads_started":4,"wal-append.queue_time_us":164320,"wal-append.run_cpu_time_us":2087,"wal-append.run_wall_time_us":1002116}
I20260709 13:02:55.917640  1683 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:55.856349  8538 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.629046  8140 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.527470  8542 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.527318  8632 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:55.629443  7975 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.526185  8391 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.524488  8527 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:55.902794  8475 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:55.936903  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:55.869176  8472 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:55.856603  8320 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.938301  1677 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:55.940023  7614 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.174840  7614 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:56.175226  7614 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:56.140398  8631 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.175948  7614 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.177803  8631 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.181315  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.182305  1603 raft_consensus.cc:2410] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:56.183316  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.183925  1603 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:02:55.528198  8525 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.912535  8321 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.017400  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.180053  2252 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:55.535410  8626 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.951340  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.152678  8549 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:55.954102  1676 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 22 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:55.629993  8521 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.306s
I20260709 13:02:55.902667  8161 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.902931  8511 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:56.018904  1573 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:56.206619  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:56.207195  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 188343us
I20260709 13:02:56.022024  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.076182  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.208061  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.208925  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.209045  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.085538  1680 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:55.909210  8636 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:55.912981  8627 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.083596  2255 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:56.132238  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.131151  2261 raft_consensus.cc:2410] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:56.028009  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:56.130069  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.130820  1679 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 15: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:56.133502  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.084547  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.027333  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.028690  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.029182  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.029631  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.145663  1432 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 15 to 17, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.856689  8385 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.586512  8497 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.162295  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:56.074790  8306 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.165858  7975 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.162526  8632 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.167408  8527 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.016659  8533 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:56.172873  8472 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:56.156898  8542 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:56.189540  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 331490us
W20260709 13:02:55.835597  1426 rpcz_store.cc:269] 0709 13:02:39.918640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.919236 (+   596us) service_pool.cc:224] Handling call
0709 13:02:55.545572 (+15626336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.155441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.327612 (+172171us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.327665 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:02:48.327679 (+    14us) tablet.cc:662] Decoding operations
0709 13:02:48.328406 (+   727us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.328489 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.328516 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:48.328990 (+   474us) tablet.cc:701] Row locks acquired
0709 13:02:48.329038 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:48.329209 (+   171us) write_op.cc:270] Start()
0709 13:02:48.329357 (+   148us) write_op.cc:276] Timestamp: P: 1783602168329134 usec, L: 0
0709 13:02:48.329380 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:48.330069 (+   689us) log.cc:844] Serialized 1692 byte log entry
0709 13:02:48.923574 (+593505us) op_driver.cc:464] REPLICATION: finished
0709 13:02:49.106806 (+183232us) write_op.cc:301] APPLY: starting
0709 13:02:49.136684 (+ 29878us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:49.139921 (+  3237us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:49.140039 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:49.198637 (+ 58598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:49.306959 (+108322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:02:49.313415 (+  6456us) write_op.cc:312] APPLY: finished
0709 13:02:49.378228 (+ 64813us) log.cc:844] Serialized 49 byte log entry
0709 13:02:49.397264 (+ 19036us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.397392 (+   128us) write_op.cc:454] Released schema lock
0709 13:02:49.397469 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:49.397950 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.397981 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2351478,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":153181,"apply.run_cpu_time_us":9066,"apply.run_wall_time_us":305782,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20887,"num_ops":4,"prepare.queue_time_us":478841,"prepare.run_cpu_time_us":35400,"prepare.run_wall_time_us":559807,"raft.queue_time_us":164203,"raft.run_cpu_time_us":12517,"raft.run_wall_time_us":53977,"replication_time_us":594030,"thread_start_us":803882,"threads_started":4,"wal-append.queue_time_us":426302,"wal-append.run_cpu_time_us":24139,"wal-append.run_wall_time_us":1630443}]]}
W20260709 13:02:56.016896  1499 connection.cc:256] RPC call timeout handler was delayed by -2.624889526000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:02:56.259351  1499 connection.cc:256] RPC call timeout handler was delayed by -2.4979895260000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:02:55.902904  8325 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:55.949761  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:56.184612  8593 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.059s	sys 0.081s
I20260709 13:02:55.912714  8178 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.209075  1603 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.211393  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.208089  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:56.214300  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.266099  1602 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:55.914354  8222 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.259271  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:56.215507  8572 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:56.026700  8347 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:56.243141  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 215199us
W20260709 13:02:56.243836  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 81596.1us
I20260709 13:02:56.273128  1525 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:56.023111  8233 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.240478  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:56.250562  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.242879  8518 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:56.275420  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.252859  1526 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.241628  1601 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 12.
I20260709 13:02:56.172531  8391 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.951879  8570 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:55.941166  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.216692  8549 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:56.160210  8140 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.291230  1530 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 11.
W20260709 13:02:56.261540  1499 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.516s (SENT)
I20260709 13:02:56.254783  8636 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:56.270285  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.160056  8538 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.215934  8161 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.216063  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.257645  8472 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:56.256294  1574 connection.cc:256] RPC call timeout handler was delayed by -3.5929196660000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:02:56.257529  8067 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.302179  2258 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:56.260221  8521 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.285365  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.285225  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.308873  1534 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:02:56.271396  8593 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.059s	sys 0.082s
I20260709 13:02:56.291168  1527 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:56.291771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.310824  1604 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:56.318943  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.297487  8572 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.293227  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.296041  1531 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.268097  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:56.274187  8631 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:56.300235  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.243904  8627 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.327121  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.325462  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.329669  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.309808  8320 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:56.277171  8518 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:56.305941  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.336259  1604 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:56.331909  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.306030  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.204001  8525 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.333094  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.356395  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.357081  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:56.341975  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 398353us
I20260709 13:02:56.320070  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.310143  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.358620  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:56.322634  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.322158  1600 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:56.359093  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.359858  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.360116  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.358742  1533 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.272557  8325 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.361519  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:56.324764  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 56782.9us
I20260709 13:02:56.362995  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:56.363497  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.364019  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:56.364995  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.365726  1608 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.303360  1432 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 9 to 11, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 11 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.365479  1532 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.367367  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.367079  1432 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 16 to 17, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.368876  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:56.369433  1432 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 14, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 14 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.370376  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:56.323410  1525 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 15: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.371997  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.371562  1432 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 14 to 17, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.372618  1525 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:56.373464  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.365362  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:56.373145  1432 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 16 to 20, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.374500  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.375195  1525 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.375110  1432 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 14 to 15, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.365763  1600 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:02:56.377385  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.378419  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.379479  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.380483  1532 raft_consensus.cc:2410] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:56.331223  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.355180  1607 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.308228  8067 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:56.357612  8320 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.357426  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.388587  8067 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.389436  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.390194  1602 raft_consensus.cc:2368] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:56.391070  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.391585  1602 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:56.392426  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.393501  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.394061  1602 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:56.395005  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.397089  8320 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.398159  8067 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:56.400985  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.401229  1607 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:56.405099  1606 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:56.405198  8650 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:56.427181  8650 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.295017  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.426528  8629 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:56.376065  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.430328  1525 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:56.431566  1525 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:56.331943  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.423059  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:56.427548  8650 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:56.432830  8636 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.435642  1602 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:56.443832  8650 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:56.446338  8650 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:56.447053  1432 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 12 to 13, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 13 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.447017  8650 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:56.449618  8650 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:56.450901  8650 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:56.451493  8650 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:56.455247  8627 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.432293  1608 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:56.455998  8627 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.457465  1608 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:56.459316  1432 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.460767  8161 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.465282  8222 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.539448  8222 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.539916  8222 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:56.540289  8222 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.466153  8518 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.545440  8518 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.467312  1529 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.467981  8527 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.549942  8527 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.550380  8527 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.550715  8527 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.327828  8572 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.553910  1609 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:56.469138  8321 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.469663  8475 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.556686  8475 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.557180  8475 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.559449  8475 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.556032  8321 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.561164  8321 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.563602  8321 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.471105  8632 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.564996  8632 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:56.565544  8632 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:56.566571  8632 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.325347  8631 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.471917  8320 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.568573  8631 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.569193  1600 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:56.570271  8320 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.473404  8306 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.473838  8549 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.318818  8521 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.582154  8521 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.329425  8649 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.475212  8650 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.584753  8650 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.476573  8233 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.308358  8533 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:56.586225  8572 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.586323  8533 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.478241  8140 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.488654  8570 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:56.492884  8347 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.495692  8626 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:56.499547  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1800) took 1086 ms. Trace:
I20260709 13:02:56.603178  2259 rpcz_store.cc:276] 0709 13:02:55.412996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.942063 (+529067us) service_pool.cc:224] Handling call
0709 13:02:55.942365 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.362782 (+420417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.362813 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.362867 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:56.362905 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.499305 (+136400us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400408654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:56.499351 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.499485 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966355712}
W20260709 13:02:56.500469  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1527) took 3567 ms (client timeout 3088 ms). Trace:
W20260709 13:02:56.604882  2258 rpcz_store.cc:269] 0709 13:02:52.933570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.933727 (+   157us) service_pool.cc:224] Handling call
0709 13:02:56.500272 (+3566545us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b54002dc154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:56.500396 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7710678272}
W20260709 13:02:56.505976  8648 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:02:56.508431  8385 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:56.509934  8325 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:56.526922  2226 leader_election.cc:336] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.524s (SENT)
W20260709 13:02:56.610333  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 83457.7us
I20260709 13:02:56.623049  1432 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 14 to 16, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.626820  1432 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.630613  1432 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 14 to 16, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 16 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:56.636193  1605 consensus_meta.cc:287] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.000s
I20260709 13:02:56.637233  1605 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:56.637876  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3636) took 1005 ms. Trace:
I20260709 13:02:56.530787  1603 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:56.645781  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44446 (request call id 3646) took 1010 ms. Trace:
I20260709 13:02:56.646451  1603 rpcz_store.cc:276] 0709 13:02:55.635454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.205892 (+570438us) service_pool.cc:224] Handling call
0709 13:02:56.645692 (+439800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:56.527704  7975 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.532671  8627 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:02:56.663012  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.022s
W20260709 13:02:56.670786  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.010s	sys 0.022s
I20260709 13:02:56.638284  1605 rpcz_store.cc:276] 0709 13:02:55.632879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.638995 (+  6116us) service_pool.cc:224] Handling call
0709 13:02:56.637785 (+998790us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:56.680946  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.669525  8627 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:56.682171  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.032s	sys 0.032s
W20260709 13:02:56.693580  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.032s	sys 0.032s
W20260709 13:02:56.694470  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.706629  7614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.030s	sys 0.080s
W20260709 13:02:56.709264  7614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.030s	sys 0.080s
I20260709 13:02:56.717415  7614 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.718034  7614 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:56.721673  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.681867  8385 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.679304  8391 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:56.725260  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 517207us
I20260709 13:02:56.735550  1573 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:56.619786  8527 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.724390  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:56.737036  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.011s	sys 0.058s
W20260709 13:02:56.739207  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.011s	sys 0.058s
W20260709 13:02:56.739622  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 721271us
I20260709 13:02:56.740492  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:56.727689  8309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.016s
I20260709 13:02:56.755064  7614 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:56.758292  7614 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:56.761286  7614 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.753888  8309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.017s
I20260709 13:02:56.765154  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:56.765580  2226 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.539s (SENT)
I20260709 13:02:56.770975  8538 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.761659  7614 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:56.777302  1559 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:41741 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:41741 timed out after 15.000s (SENT)
I20260709 13:02:56.781014  8654 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.781584  8654 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.781911  8654 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.785847  8067 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:56.790155  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.787889  8627 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:56.798561  1499 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.015s
I20260709 13:02:56.754303  7975 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.729789  8385 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:56.799425  1499 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.017s	sys 0.015s
W20260709 13:02:56.800699  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 506299us
W20260709 13:02:56.802173  1499 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.783s (SENT)
W20260709 13:02:56.805637  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 440411us
I20260709 13:02:56.807142  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:56.800103  7975 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:56.807794  1574 connection.cc:256] RPC call timeout handler was delayed by -3.2518196659999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:02:56.810449  1574 connection.cc:256] RPC call timeout handler was delayed by -3.1547647449999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:02:56.810760  1574 connection.cc:256] RPC call timeout handler was delayed by -2.9212949019999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:02:56.811046  1574 connection.cc:256] RPC call timeout handler was delayed by -2.7219889389999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 13:02:56.815603  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:56.808048  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 64142us
W20260709 13:02:56.807713  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 437377us
I20260709 13:02:56.818269  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:56.811336  1574 connection.cc:256] RPC call timeout handler was delayed by -2.7219889389999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:02:56.820834  1574 connection.cc:256] RPC call timeout handler was delayed by -2.2936569400000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2299s for a response
I20260709 13:02:56.816766  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:56.821651  1574 connection.cc:256] RPC call timeout handler was delayed by -2.2936569400000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2299s for a response
I20260709 13:02:56.823982  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:02:56.830273  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.852793  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.832610  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.637s (SENT)
W20260709 13:02:56.822938  1574 connection.cc:256] RPC call timeout handler was delayed by -1.6582569400000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3005s for a response
I20260709 13:02:56.854934  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:02:56.865862  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48217.8us
I20260709 13:02:56.867513  7614 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:56.871673  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.872458  2258 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:02:56.873526  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.874250  2259 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:56.875020  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.876200  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:56.877166  8325 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:56.811431  7975 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:56.883252  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.542s (SENT)
W20260709 13:02:56.883894  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 67205.7us
W20260709 13:02:56.884188  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 66004.4us
I20260709 13:02:56.807722  8651 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:56.891911  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 151466us
I20260709 13:02:56.895025  7614 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:56.896291  2259 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:56.808871  8627 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:56.897471  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73540.7us
I20260709 13:02:56.898368  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:56.814352  8649 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:56.899216  1574 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:56.899350  2259 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:56.900504  1574 leader_election.cc:403] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:56.903340  2258 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:56.903076  8233 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:56.911341  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.911481  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.912139  2252 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:56.912972  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.913704  2259 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:56.912191  2253 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:02:56.918017  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.920637  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:56.923455  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.924136  2261 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:56.866106  8511 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.918980  2257 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:56.925370  2253 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.903335  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3186) took 1337 ms. Trace:
W20260709 13:02:56.934924  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44788.9us
I20260709 13:02:56.936636  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.937492  2256 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:56.939144  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:56.935768  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:56.948532  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3226) took 1102 ms. Trace:
I20260709 13:02:56.949020  1602 rpcz_store.cc:276] 0709 13:02:55.845874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.436870 (+590996us) service_pool.cc:224] Handling call
0709 13:02:56.437130 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.449082 (+ 11952us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:02:56.799975 (+350893us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.948133 (+148158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.948189 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:56.948235 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.948298 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.948471 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14420,"thread_start_us":483405,"threads_started":2}
I20260709 13:02:56.903092  1500 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:02:56.951617  7614 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:56.952073  7614 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:56.897706  8538 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:56.888602  8651 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.953826  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.974555  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.953826  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.955019  1603 raft_consensus.cc:3060] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:56.956544  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 152649us
I20260709 13:02:56.960345  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.961097  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.976155  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:56.973590  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.977270  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:56.961620  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.962210  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.965560  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:56.966037  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 63014.1us
I20260709 13:02:56.959024  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.967489  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.967828  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:56.982609  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:56.896683  8653 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:56.969048  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.969236  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:56.899928  8549 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:56.997438  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.998011  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.934815  1675 rpcz_store.cc:276] 0709 13:02:55.565743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.911313 (+345570us) service_pool.cc:224] Handling call
0709 13:02:55.940938 (+ 29625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.941176 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:56.531706 (+590530us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.901387 (+369681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.901443 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:56.901504 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.903151 (+  1647us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.903277 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":819904,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1641,"raft.queue_time_us":150,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":100,"thread_start_us":766888,"threads_started":2}
I20260709 13:02:56.975270  2256 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:02:56.980844  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:56.966955  8636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.010s
I20260709 13:02:56.933419  8511 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:56.986388  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.986562  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:57.016114  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:57.016515  1680 raft_consensus.cc:606] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:56.980571  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:56.953363  8347 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:56.988517  2261 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:56.916813  8652 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.024955  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.997331  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.974258  1601 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:57.000382  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:56.983419  1534 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:56.993820  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 91670.6us
I20260709 13:02:57.107096  1498 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.103166  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3174) took 1601 ms. Trace:
I20260709 13:02:57.001147  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:02:57.003435  2227 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.539s (SENT)
I20260709 13:02:57.003614  1607 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:57.004652  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.110648  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.005410  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:56.968672  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.004949  2256 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:57.007292  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3307) took 1396 ms. Trace:
I20260709 13:02:57.007388  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:57.008467  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.111671  1531 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:57.112283  1682 raft_consensus.cc:2393] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:57.013264  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.113822  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.111943  1532 rpcz_store.cc:276] 0709 13:02:55.610764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.382343 (+771579us) service_pool.cc:224] Handling call
0709 13:02:56.382746 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.382908 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:56.805082 (+422174us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.006913 (+201831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.007016 (+   103us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:57.007061 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.007120 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.007234 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19146,"prepare.queue_time_us":514282,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":60797,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":12488,"thread_start_us":600343,"threads_started":2}
I20260709 13:02:57.114924  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.115026  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.014458  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.116072  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:56.952749  8650 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:56.988996  7614 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.117154  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.117709  1602 raft_consensus.cc:2376] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17. Re-sending same reply.
I20260709 13:02:57.118705  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.119385  1602 raft_consensus.cc:2393] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.120121  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.017270  1680 raft_consensus.cc:614] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:57.018424  1603 raft_consensus.cc:1275] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:57.016700  1677 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:57.020253  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3237) took 1111 ms. Trace:
I20260709 13:02:56.973651  8501 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.981277  8533 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.025338  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:56.923277  8657 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.112s
I20260709 13:02:57.135982  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1542) took 1613 ms. Trace:
I20260709 13:02:56.982081  8651 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:57.005407  8636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.010s
I20260709 13:02:56.970278  8325 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:02:56.988036  8653 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:57.054881  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.015650  8309 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:57.017956  8511 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.127619  8649 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:57.059219  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.021142  8552 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:57.026528  8542 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.131891  8067 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:57.132071  8673 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:57.019588  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 124090us
I20260709 13:02:57.054078  8527 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:57.082873  8658 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:02:57.068226  8525 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.063961  8627 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.093650  8385 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.009155  8538 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:02:57.096906  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.100483  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 155858us
I20260709 13:02:57.009112  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:56.987470  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 51783.8us
I20260709 13:02:57.121757  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.163784  1601 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:02:57.121814  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:57.163800  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Timed out: RequestConsensusVote RPC to 127.0.107.193:36133 timed out after 1.660s (SENT)
I20260709 13:02:57.164803  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:57.166497  1573 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.167229  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.167302  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.167958  1608 raft_consensus.cc:3060] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.168109  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.121165  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.170187  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.146739  8653 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:57.122413  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.120477  1681 raft_consensus.cc:2376] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21. Re-sending same reply.
I20260709 13:02:57.122781  1604 rpcz_store.cc:276] 0709 13:02:55.909306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.497859 (+588553us) service_pool.cc:224] Handling call
0709 13:02:56.498189 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.498403 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:56.802432 (+304029us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.019929 (+217497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.019980 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:57.020029 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.020094 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.020199 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":526292,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":1944,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":510279,"threads_started":2}
I20260709 13:02:57.121692  1677 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:57.124580  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 123509us
I20260709 13:02:57.179214  1607 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.156626  8667 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:57.180373  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.180455  8347 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:57.180382  8667 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:57.179641  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.180826  1677 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.125200  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:57.123713  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 120392us
I20260709 13:02:57.183307  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.183743  8667 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.184408  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.185002  1609 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:57.185856  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:57.186697  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:57.185230  8667 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.108403  1678 rpcz_store.cc:276] 0709 13:02:55.501472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.879907 (+378435us) service_pool.cc:224] Handling call
0709 13:02:55.880212 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.184820 (+304608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.184864 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.185326 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.728060 (+542734us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:56.728107 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.728210 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.093633 (+365423us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:57.095540 (+  1907us) raft_consensus.cc:1685] finished
0709 13:02:57.095561 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.103076 (+  7515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17037,"raft.queue_time_us":45705,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":59691,"spinlock_wait_cycles":6991616,"thread_start_us":726085,"threads_started":2,"wal-append.queue_time_us":700070}
I20260709 13:02:57.185012  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:57.189177  1678 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.189417  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.186621  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:57.190196  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:57.190346  2255 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:02:57.189280  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.189307  2253 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
W20260709 13:02:57.191193  8678 log.cc:927] Time spent T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:02:57.132849  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:57.105645  8472 consensus_meta.cc:287] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.001s
I20260709 13:02:57.192678  8525 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.192296  8472 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.192914  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.193200  8233 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:57.138183  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.146832  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.194638  8472 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.052263  1600 raft_consensus.cc:2410] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:57.027182  8549 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:57.195537  8549 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.195941  8549 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:57.198076  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.199270  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.150309  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.159623  8649 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:57.200848  1683 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:57.201155  8521 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:57.146855  8631 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:02:57.194653  8233 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:57.202179  1534 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.195891  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.202819  1600 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
W20260709 13:02:57.157315  8518 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 13:02:57.169484  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.203171  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.203619  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.204663  1600 raft_consensus.cc:2410] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:57.205291  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.136610  1528 rpcz_store.cc:276] 0709 13:02:55.522378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.525060 (+  2682us) service_pool.cc:224] Handling call
0709 13:02:55.525455 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.299402 (+773947us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:56.717323 (+417921us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.913496 (+196173us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.913679 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.913721 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:56.913813 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.135740 (+221927us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400343ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:02:57.135785 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.135925 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":577932,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":5088,"raft.queue_time_us":377,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":1794102400,"thread_start_us":558418,"threads_started":2,"wal-append.queue_time_us":256327}
I20260709 13:02:57.205511  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.175632  1526 raft_consensus.cc:2368] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:02:57.208236  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.200994  8572 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:57.182842  1677 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.188005  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:02:57.099187  8222 consensus_meta.cc:287] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:02:57.209846  7975 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.191355  8069 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.210369  2261 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:02:57.210915  8069 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:57.211421  8069 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.181197  8636 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.189787  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:57.212982  2259 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:57.189616  8662 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:02:57.214381  8662 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:57.214700  8662 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:57.206459  1600 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.215430  8662 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.202925  8178 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.202042  8631 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.191517  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.217803  8518 raft_consensus.cc:2764] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:02:57.217485  1533 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.156535  8552 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.219722  1605 raft_consensus.cc:2410] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:57.220388  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33602 (request call id 3310) took 1608 ms. Trace:
I20260709 13:02:57.210439  8222 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.220873  1533 rpcz_store.cc:276] 0709 13:02:55.611576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.361283 (+749707us) service_pool.cc:224] Handling call
0709 13:02:57.220176 (+858893us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54003a7ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:57.220332 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966895872}
I20260709 13:02:57.222781  1529 raft_consensus.cc:1240] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.161554  8627 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.216521  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.223852  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.225255  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.226655  1533 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:57.227504  8222 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.228286  1525 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.228849  1609 raft_consensus.cc:2468] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 12.
I20260709 13:02:57.228992  1600 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.206441  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.203800  1601 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:57.156158  8309 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:57.231138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.231484  8309 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.217526  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.220796  8533 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:57.120435  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.232829  8533 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.233434  1532 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:57.182173  1604 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 12: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:57.233621  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.234596  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.218416  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.232996  8475 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:57.235589  1526 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.235780  8475 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:57.236207  8475 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.236629  8521 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.236997  8521 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:57.236057  1573 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:02:57.237630  8681 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:57.223762  8627 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.238389  8161 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:57.239193  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.239449  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.230577  1528 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.170974  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.239867  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:02:57.240540  1682 raft_consensus.cc:606] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.240899  1682 raft_consensus.cc:614] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:57.107086  8654 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.243192  1607 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:57.273219  1533 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:57.273741  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.235595  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.204223  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.245776  1608 raft_consensus.cc:2468] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:02:57.275766  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.212046  7975 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:57.111745  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 129206us
I20260709 13:02:57.232749  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.178848  1530 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:02:57.239475  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.248200  1600 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:57.239763  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.171551  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.271461  1677 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:57.272604  1602 raft_consensus.cc:2393] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 13: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:57.242115  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:57.274853  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.282388  1607 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:57.282642  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:57.284926  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 113427us
I20260709 13:02:57.285264  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:57.285892  1604 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:57.285439  1602 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:57.283182  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.286036  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.288549  1608 raft_consensus.cc:1240] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 15. Current term is 17. Ops: [15.13-15.13]
W20260709 13:02:57.288877  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49478.8us
I20260709 13:02:57.289826  1608 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:57.283537  1607 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.290361  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.286914  1604 raft_consensus.cc:1240] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:57.210326  8572 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:57.287952  8347 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.238862  8161 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.295111  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.300657  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.303326  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.301520  7614 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:57.295789  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.304477  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.304800  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.298861  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:57.296322  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 123856us
I20260709 13:02:57.296950  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.218473  8631 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.274684  8521 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.305656  1525 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.306387  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.307798  1600 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 21: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:57.306103  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:57.315361  1532 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:57.315696  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.316228  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.292133  8572 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:57.294799  8497 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.295172  8665 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.320562  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.321890  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.322891  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.323802  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.322969  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.331260  1683 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:57.316881  1532 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:57.294502  8347 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.325927  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.331171  1675 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:57.332098  1677 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:57.331334  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:57.333133  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.322924  8686 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.334422  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.324736  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.345436  1682 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:02:57.299065  8178 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:57.308780  8679 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:02:57.301856  8161 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.298955  8636 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.340519  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:57.334766  8675 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:57.295498  8672 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:57.352380  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46329.3us
I20260709 13:02:57.303726  8525 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.483367   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:57.334861  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:57.489121  1534 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:57.493081  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 254286us
I20260709 13:02:57.351254  1607 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:57.512954  8533 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.347936  1674 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:57.523609  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.525159  1602 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:57.348675  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:57.347733  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.530517  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:57.531574  1680 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:57.495369  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3229) took 1648 ms. Trace:
I20260709 13:02:57.362851  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:57.401571  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:57.493491  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:57.542814  1680 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:57.401046  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:57.430804  8069 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:57.499974  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 217241us
I20260709 13:02:57.502485  1499 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.302170  7975 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:57.609177  7975 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.323956  8222 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:57.346288  8347 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.313508  8472 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.402616  8325 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.617995  1525 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:57.329664  8497 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:57.620803  8497 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.287878  8518 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:57.623659  8518 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:57.624095  8518 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:57.533622  1606 rpcz_store.cc:276] 0709 13:02:55.846659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.444755 (+598096us) service_pool.cc:224] Handling call
0709 13:02:56.445083 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.801949 (+356866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.801980 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.815630 (+ 13650us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.969499 (+153869us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:56.969548 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.970307 (+   759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.452574 (+482267us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:02:57.494470 (+ 41896us) raft_consensus.cc:1685] finished
0709 13:02:57.494553 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.495036 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114948,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":16761216,"thread_start_us":455666,"threads_started":2,"wal-append.queue_time_us":444536}
I20260709 13:02:57.308377  8538 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.449290  8549 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.546259  8542 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:02:57.455440  8572 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.201175  8649 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.328706  8652 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:57.454849  8653 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.456920  8651 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.313114  8684 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:02:57.348181  8686 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.350176  8693 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:57.350314  8689 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.433502  8698 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.556403  1677 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:57.576989  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 229561us
I20260709 13:02:57.552632  8552 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.580658  8533 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.625594  8518 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.312922  8527 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.639856  1681 raft_consensus.cc:2368] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22.
W20260709 13:02:57.652722  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.639799  8549 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:57.650956  1603 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:02:57.751335  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.752460  1679 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:57.752977  8653 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.670886  8069 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.646128  8659 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:02:57.637578  7975 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:57.652935  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 151074us
W20260709 13:02:57.672174  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 394718us
I20260709 13:02:57.755848  8654 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:57.640600  8538 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.645536  8472 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:57.669080  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 268078us
I20260709 13:02:57.757169  8693 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:02:57.757622  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.644847  8667 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.113s
W20260709 13:02:57.771716  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.644240  1574 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:57.669776  8697 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:57.765138  1609 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:57.659215  8385 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:57.774941  8572 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:57.775401  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 278641us
I20260709 13:02:57.775612  1678 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:57.672482  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.779884  8698 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:57.834911  8698 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.780462  8518 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.782451  8651 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:57.782279  8542 consensus_queue.cc:1059] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:57.842109  8542 raft_consensus.cc:3055] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:57.842633  8542 raft_consensus.cc:740] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:57.783102  8527 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:57.784083  8652 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.785941  1675 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:57.787009  8693 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.788602  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:57.792855  8650 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:57.793964  1534 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:57.645247  8700 consensus_queue.cc:1048] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:02:57.778914  8385 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:57.772498  8472 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.796051  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.769143  8686 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.770138  8178 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:57.803718  1680 raft_consensus.cc:1240] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:57.810146   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:57.811818  1649 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.814364  1606 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:57.795727  8662 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:57.816809  1601 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:57.777727  8697 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.820935  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.824514  8521 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.829098  8067 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:57.830312  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 158065us
I20260709 13:02:57.642206  8140 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.135s
I20260709 13:02:57.844194  1607 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:57.886480  1603 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.906608  8684 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:57.899366  8497 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.907696  8233 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:57.908042  8233 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:57.908672  8511 consensus_meta.cc:287] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.011s
I20260709 13:02:57.909119  8233 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.909320  8511 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.910449  8233 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.909165  8497 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:57.911669  8511 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:57.891244  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 114946us
I20260709 13:02:57.912614  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.915122  8391 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:57.915465  8521 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.899235  8705 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.916277  8705 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:57.916774  8705 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.917541  1603 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:57.899780  8708 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:57.920765  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:57.900327  8385 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.914691  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:57.923211  8385 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.923889  8708 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:57.924645  8708 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:02:57.925114  8708 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.903520  8654 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:57.776548  8538 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.902494  1606 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:57.897150  8178 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.929039  8067 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.929750  8067 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.921955  7614 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:57.915521  8391 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:57.897166  8161 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.932219  7614 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:57.843855  8542 consensus_queue.cc:260] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.934528  8542 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.932567  8391 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:57.935397  8161 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.912711  1676 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:57.891727  8697 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:57.938197  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.939723  8654 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:57.925009  8627 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.012s
I20260709 13:02:57.940654  8627 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.942414  1683 raft_consensus.cc:2368] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:02:57.942023  8347 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.942664  1499 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.944187  8656 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:57.934152  7614 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:57.944741  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 300861us
W20260709 13:02:57.885139  8475 consensus_meta.cc:287] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.015s
I20260709 13:02:57.843910  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:57.921756  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:57.914728  8472 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:57.964516  1607 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:57.964931  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 153202us
I20260709 13:02:57.944727  8656 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:57.932228  8067 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:57.972950  8347 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.982575  8511 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.984659  8511 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:02:57.985054  8511 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.966141  8475 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:57.982805  8649 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:57.987879  8475 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:57.971004  8700 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:57.989068  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 145449us
I20260709 13:02:57.967021  8538 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:57.991369  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 170503us
I20260709 13:02:57.967689  8651 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.972623  8222 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:57.983805  8627 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:57.975081  8178 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:58.018966  1574 leader_election.cc:400] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:02:58.019306  1574 leader_election.cc:403] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.030464  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.014163  8705 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:58.035620  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 113996us
I20260709 13:02:58.014329  8691 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:58.039316  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66832.3us
I20260709 13:02:58.063457  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.039795  1600 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:58.065011  8673 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.065971  7614 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:58.067128  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.040853  8472 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.072424  8325 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.072232  8069 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:58.073331  8069 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:58.041004  1532 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 19. Ops: []
I20260709 13:02:58.074141  1499 leader_election.cc:400] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:02:58.074519  1499 leader_election.cc:403] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.074342  8069 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.040608  1649 leader_election.cc:400] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
I20260709 13:02:58.075698  8069 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.042482  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.043999  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.044606  8475 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:02:58.076397  1609 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.046733  8140 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.077086  8140 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.079149  8140 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:58.041664  8657 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.080575  8657 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.082973  8657 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:58.083592  8657 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.085381  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.049206  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3192) took 1029 ms. Trace:
I20260709 13:02:58.086890  1678 rpcz_store.cc:276] 0709 13:02:57.019744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.194371 (+174627us) service_pool.cc:224] Handling call
0709 13:02:57.775204 (+580833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.788535 (+ 13331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.048975 (+260440us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540007dad0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:58.049131 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334951168}
I20260709 13:02:58.050693  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.085397  2227 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.089205  8325 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.049630  8538 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.056461  8653 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.088243  1604 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.018162  8178 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.062197  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.069157  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.070179  7614 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:58.072028  8707 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.055298  8391 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.075981  1649 leader_election.cc:403] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.090807  2227 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.057662  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1299) took 1097 ms. Trace:
I20260709 13:02:58.089704  8656 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.099123  8651 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:58.099538  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:58.100025  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.100409  8325 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.102320  8511 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.104517  8706 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.106861  8178 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.110208  8708 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.111486  7614 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:58.113097  1676 rpcz_store.cc:276] 0709 13:02:56.961884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.961999 (+   115us) service_pool.cc:224] Handling call
0709 13:02:58.057407 (+1095408us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540024b3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:02:58.057587 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147501440}
I20260709 13:02:58.119211  1609 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:58.126549  7614 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:58.127936  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.129351  8665 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.125278  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:58.139837  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:58.142242  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80174.6us
W20260709 13:02:58.139220  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49409us
I20260709 13:02:58.140841  1607 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:02:58.122256  8684 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:02:58.143146  8653 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18.
W20260709 13:02:58.156898  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71653us
I20260709 13:02:58.144538  8385 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:58.158432  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.160993  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.154405  8178 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:58.167080  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 93095.5us
I20260709 13:02:58.097760  8698 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.170221  7614 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:58.176383  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76884.8us
W20260709 13:02:58.244331  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.244983  8385 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:58.246538  8698 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:58.251636  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.168615  8707 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.259459  8708 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:58.260408  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 104610us
I20260709 13:02:58.261334  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.262806  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.216039  8475 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.257714  8707 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:58.264657  8325 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.255717  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.267467  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.268675  7614 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:58.257396  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 225304us
I20260709 13:02:58.273612  1604 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
W20260709 13:02:58.272028  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 102268us
I20260709 13:02:58.255434  8178 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.264819  8707 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.273212  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:02:58.278537  8717 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:58.281203  8391 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:58.282529  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.285394  1648 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.285846  8651 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.286624  8665 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:58.287154  8665 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:58.288187  8665 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:58.289436  8705 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:58.291126  1499 leader_election.cc:400] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22.
I20260709 13:02:58.291440  1499 leader_election.cc:403] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.292531  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.293445  8651 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:58.293884  8651 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.294209  8673 consensus_queue.cc:1059] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:58.295269  8673 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:58.296084  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:58.276269  7975 raft_consensus.cc:2764] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:58.275377  8325 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.315093  8657 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:58.315728  8708 raft_consensus.cc:3055] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:58.294258  8651 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:58.271956  8653 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:02:58.296212  8549 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:58.274684  8697 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.335602  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.338088  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.318750  8693 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:58.331307  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.309509  8472 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:02:58.317912  8708 raft_consensus.cc:740] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:58.342299  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.341811  8497 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:58.345444  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88554us
I20260709 13:02:58.348740  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:58.355041  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.356177  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.357304  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.358021  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.358152  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.358579  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.361449  8697 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.368894  8708 consensus_queue.cc:260] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.371937  8686 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.339915  8511 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:58.356088  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:58.376569  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.380023  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 61741.3us
I20260709 13:02:58.373260  8656 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.375870  8497 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.398680  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.399686  1678 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:58.400570  1681 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:02:58.411763  8686 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:58.409751  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.412698  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.415534  1679 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.416659  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.417402  1683 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.414326  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.421103  1530 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:58.422863  8708 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.380682  8178 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.430989  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.431489  1526 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.401516  8497 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:58.434779  1679 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:58.443804  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.444532  1680 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.448118  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:58.451298  1604 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:58.440444  8706 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 12. Current term is 13.
I20260709 13:02:58.458392  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.468726  1532 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:58.452076  8697 consensus_queue.cc:1059] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:02:58.470947  1678 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:58.470912  1683 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:58.473294  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:02:58.474292  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 71107.5us
I20260709 13:02:58.474766  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:02:58.476711  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.480296  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:58.480687  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.481350  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.481701  8697 raft_consensus.cc:3055] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:58.486997  1683 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.485843  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:58.487663  8720 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:02:58.487884  8698 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:58.488407  8698 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:58.488258  8697 raft_consensus.cc:740] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:58.489385  8698 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.489710  8697 consensus_queue.cc:260] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.497730  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.492686  8697 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.503800  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.505023  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.505600  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:58.506903  8716 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.004s
I20260709 13:02:58.516494  8707 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.516836  8657 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.492861  7975 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.518043  1531 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:58.519497  8549 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:58.531837  8549 consensus_queue.cc:1243] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:58.532094  7975 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.532634  8549 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:58.533063  8549 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:58.533658  1675 raft_consensus.cc:1240] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:58.534066  8549 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.534575  7975 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.534911  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.535581  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.535755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.536499  8693 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:58.531674  8657 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.537192  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.536459  1531 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:02:58.541278  1529 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:58.542762  1526 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:02:58.520187  8497 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.524098  1527 raft_consensus.cc:2393] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 12: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:58.507634  8233 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:58.528168  1680 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:58.549932  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53137.1us
I20260709 13:02:58.550817  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.500022  8686 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.553678  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.552883  1528 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:02:58.553947  8233 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.556079  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.556581  8178 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:58.556830  1674 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:02:58.557129  8178 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.557685  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.558244  8178 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.558992  2227 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.559360  8325 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:58.559832  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.560611  1531 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.560964  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.559839  8325 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:02:58.561631  8325 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.562876  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.564831  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.564374  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.535250  8549 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.566220  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.559262  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.567113  1601 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:58.568718  1530 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:58.569536  1606 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:58.570134  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:02:58.571076  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.573046  1679 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:58.573824  1604 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.574172  8233 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.575147  8233 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:58.544498  8673 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22.
W20260709 13:02:58.577227  8719 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 13:02:58.577466  1525 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:58.578795  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.579939  1679 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 22: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.570410  1529 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:58.570364  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.583623  1674 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 19. Ops: []
I20260709 13:02:58.586714  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.602662  1681 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:58.604496  1526 raft_consensus.cc:2393] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:58.609711  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.578717  8657 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:58.621905  1533 raft_consensus.cc:2410] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:58.624822  1604 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 13.
I20260709 13:02:58.632333  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:58.633260  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74329.3us
I20260709 13:02:58.634356  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.635147  1603 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:58.630939  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.636719  1683 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:58.636219  1529 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.637415  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.639045  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.642601  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.610615  8385 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.647670  1681 raft_consensus.cc:2393] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:58.653157  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.654076  1533 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:02:58.677692  8497 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:02:58.681795  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.683525  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 124720us
I20260709 13:02:58.685427  8673 consensus_queue.cc:1059] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:58.686559  8673 raft_consensus.cc:3055] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:58.686913  8673 raft_consensus.cc:740] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:02:58.689216  8721 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 13:02:58.687785  8673 consensus_queue.cc:260] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.690858  8673 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.698045  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.701154  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.702095  8708 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:58.702639  8708 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.705165  8706 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:58.707296  1499 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.703681  8708 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.709108  8656 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:58.709623  8656 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.710474  8656 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.711982  1525 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:58.713203  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:02:58.713572  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.713821  1532 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:02:58.716948  1534 raft_consensus.cc:2410] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:58.717068  1683 raft_consensus.cc:1240] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:58.685670  8707 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:58.664036  1526 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:58.719532  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.728003  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.728478  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.728677  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.729269  1674 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:02:58.729508  1678 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:58.729851  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.730626  1676 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.731748  1679 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:58.734124  1601 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:58.737584  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:58.746245  1529 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:58.743407  2227 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:02:58.728109  1424 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 21, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.748802  1528 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [17.12-21.14]
I20260709 13:02:58.756729  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.757424  1679 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:02:58.758529  1678 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:02:58.762434  1680 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:58.721473  8391 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:58.765244  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:02:58.767990  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 69411.9us
I20260709 13:02:58.769986  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:58.780663  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.781594  1679 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:02:58.782990  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.788905  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.790261  1533 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:02:58.793390  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.798959  1603 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:58.795680  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.810441  1678 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:58.784584  8391 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:58.820356  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.824790  1603 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.823642  1601 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:58.819535  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:58.791653  8698 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.848047  8705 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:58.855270  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:58.857012  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:58.858505  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:58.859944  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:58.860702  2255 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:02:58.862586  1678 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.826045  8511 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.869386  1604 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:02:58.889503  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.817266  8736 raft_consensus.cc:2804] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:58.832238  8653 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:58.905447  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 79464.9us
W20260709 13:02:58.905449  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.838510  8651 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.908617  1677 raft_consensus.cc:1240] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:02:58.912503  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:02:58.914379  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 96287us
W20260709 13:02:58.913617  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 143739us
I20260709 13:02:58.915284  1574 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15.
I20260709 13:02:58.912699  8497 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:58.904160  8511 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:58.919368  8497 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:58.919651  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 63944.6us
W20260709 13:02:58.920958  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.922986  8651 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:58.912446  8736 raft_consensus.cc:697] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:58.925388  8736 consensus_queue.cc:237] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.928223  8391 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.923621  8325 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:58.936412  1603 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:02:58.941669  1678 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.955225  1679 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.959118  1603 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:58.956436  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.962077  1681 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:58.954308  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.963140  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.931932  8497 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:58.905926   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:58.966079  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.919615  8693 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:58.965519  1601 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:58.971372  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 137397us
I20260709 13:02:58.972082  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.975363  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.975961  1600 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:02:58.977284  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.977941  1681 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.977999  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:58.978698  2253 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.977461  1609 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.980923  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:58.981693  1678 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.980070  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:58.984445  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.960675  8657 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.989300  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.988394  8653 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:58.991156  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:58.993080  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:58.993801  1678 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 22: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:02:58.994967  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:02:58.919555  8511 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:58.993484  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:58.977324  8665 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.000532  1605 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:59.001199  2261 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:59.000851  8497 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:59.005144  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 90009.5us
I20260709 13:02:59.006904  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:59.007409  1678 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:59.010365  2259 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:59.012081  1601 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:02:59.014528  1679 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:58.995841  8233 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.027168  1680 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:59.028098  1678 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:59.029652  8497 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.030136  1528 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:59.037667  1682 raft_consensus.cc:2410] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:59.039973  1683 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:02:58.995985  8656 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
W20260709 13:02:59.040982  8735 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:59.044979  8385 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.049063  2253 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:58.990938  8649 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:02:59.050115  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.050374  8653 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.051719  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:59.008337  8665 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.051745  8325 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.055195  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.060191  1683 pending_rounds.cc:85] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 11
I20260709 13:02:59.060468  1681 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:02:59.016108  8745 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.090107  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.090991  2253 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:59.085039  1683 pending_rounds.cc:107] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:02:59.096174  8742 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:59.024866  8657 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.105195  8657 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.105674  8665 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.105897  8657 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.106715  8542 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:59.107291  8542 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.084831  8651 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:02:59.109431  8542 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.064078  8233 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:59.097275  1683 raft_consensus.cc:2889] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.097867  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:02:59.096589  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.111649  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.121407  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.122041  8549 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.122545  8665 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:02:59.143379  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45640.2us
I20260709 13:02:59.149187  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.153421  1674 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:59.117070  8746 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:59.165614  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.168612  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.169899  2253 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:02:59.174597  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.165385  8549 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.145618  8542 consensus_queue.cc:1059] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:59.163359  8746 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.194494  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73165.9us
I20260709 13:02:59.112864  8745 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:59.203332  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 148233us
I20260709 13:02:59.189319  8385 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:59.204861  1574 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:59.205775  8747 log.cc:927] Time spent T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:02:59.206035  8698 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:59.191287  1534 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:59.209028  8549 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:02:59.220593  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 343) took 16865 ms (client timeout 15000 ms). Trace:
I20260709 13:02:59.198936  8325 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.198776  8746 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.223095  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.223806  8745 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.239399  1676 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:02:59.241588  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:59.242785  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.243839  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:02:59.245899  2258 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:59.246325  2252 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:02:59.246714  2252 pending_rounds.cc:85] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 12
I20260709 13:02:59.247014  2252 pending_rounds.cc:107] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:02:59.247336  2252 raft_consensus.cc:2889] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.248708  8549 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.250586  2255 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:59.224967  1424 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:59.226629  8649 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.227262  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.252503  8649 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.227507  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:02:59.256425  8649 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.215648  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:59.221917  2261 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
W20260709 13:02:59.257943  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.228399  2260 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:02:59.256588  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51808us
I20260709 13:02:59.257108  8758 raft_consensus.cc:2804] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.259907  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.247210  1675 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:59.257207  1674 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:02:59.260725  1424 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 18 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.209388  8708 raft_consensus.cc:3055] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:59.209190  8385 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.273047  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 68060us
I20260709 13:02:59.274477  1604 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:59.275136  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.285041  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.285952  7614 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:59.286264  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.208910  8233 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.297933  8549 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:59.300724  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:59.301538  1675 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:59.304522  1424 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 20, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.306003  1424 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.307581  1424 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.310581  1424 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 16 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.312013  1424 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 15 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.279938  8756 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:59.318126  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 143596us
I20260709 13:02:59.317879  1424 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 8 to 10, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 10 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.260675  8542 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:59.288594  8760 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:59.326779  8760 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:59.323220  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.296289  8653 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:02:59.337472  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.279938  8708 raft_consensus.cc:740] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:02:59.340988  1424 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.344868  8760 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:02:59.236467  1432 rpcz_store.cc:269] 0709 13:02:42.354681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.354966 (+   285us) service_pool.cc:224] Handling call
0709 13:02:59.220345 (+16865379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:57.071606 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:57.078980 (+  7374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:57.079023 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:02:57.079041 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:57.080382 (+  1341us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:57.080442 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:57.080476 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:57.081639 (+  1163us) tablet.cc:701] Row locks acquired
0709 13:02:57.081660 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:57.081843 (+   183us) write_op.cc:270] Start()
0709 13:02:57.081972 (+   129us) write_op.cc:276] Timestamp: P: 1783602177081780 usec, L: 0
0709 13:02:57.081992 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:57.184197 (+102205us) log.cc:844] Serialized 5541 byte log entry
0709 13:02:57.437704 (+253507us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2ce28 00007f7e67567581 00007f7e67566d58 00007f7e6756b9f1 00007f7e6756b9a9 00007f7e6756b939 00007f7e6756b901 00007f7e6756ab2d 000000000038f354 000000000038f199
0709 13:02:57.458116 (+ 20412us) op_driver.cc:464] REPLICATION: finished
0709 13:02:57.459846 (+  1730us) write_op.cc:301] APPLY: starting
0709 13:02:57.459930 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:58.073824 (+613894us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:58.073900 (+    76us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:58.173788 (+ 99888us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:58.338900 (+165112us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:02:58.347987 (+  9087us) write_op.cc:312] APPLY: finished
0709 13:02:58.407639 (+ 59652us) log.cc:844] Serialized 129 byte log entry
0709 13:02:58.407933 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:58.408465 (+   532us) write_op.cc:454] Released schema lock
0709 13:02:58.408564 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:58.409132 (+   568us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:58.409162 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3419152,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":1524,"apply.run_cpu_time_us":32075,"apply.run_wall_time_us":949219,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62787,"num_ops":14,"prepare.queue_time_us":265766,"prepare.run_cpu_time_us":17730,"prepare.run_wall_time_us":380867,"raft.queue_time_us":27526,"raft.run_cpu_time_us":1491,"raft.run_wall_time_us":1715,"replication_time_us":375995,"spinlock_wait_cycles":99332480,"thread_start_us":249861,"threads_started":4,"wal-append.queue_time_us":177345}]]}
I20260709 13:02:59.362462  1424 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 15 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:02:59.364485  8649 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:59.279976  8758 raft_consensus.cc:697] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:59.369302  8758 consensus_queue.cc:237] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.292680  8391 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:59.373189  8391 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:59.373612  8391 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.374290  8653 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:59.375286  8653 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:59.375595  8653 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:59.252053  8325 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.376798  8745 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:59.288749  8385 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:59.377202  8745 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:59.346237  1683 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:02:59.377704  8708 consensus_queue.cc:260] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.378046  8745 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.379186  8745 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:59.341420  8549 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:59.284209  8742 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:02:59.399513  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.400199  1606 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:02:59.363319  8756 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.381794  8740 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.382499  8542 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.407868  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.408767  1601 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:59.412043  1601 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:59.412166  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.392776  8708 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:59.413304  1601 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:02:59.414599  1601 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:59.321012  8657 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
W20260709 13:02:59.418998  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.421567  1683 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:59.431720  1607 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:02:59.411499  8740 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.435067  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.425309  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:59.402647  8673 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.020s
I20260709 13:02:59.443542  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:59.432231  8736 raft_consensus.cc:3060] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:59.448444  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.439319  8740 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.417318  8542 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.446218  8651 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:59.468947  8770 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.418661  8756 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.477237  1601 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:02:59.479417  1601 pending_rounds.cc:85] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 13
I20260709 13:02:59.455233  8656 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:02:59.416348  8653 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:59.486712  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.487943  1601 pending_rounds.cc:107] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:02:59.460732  8686 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:59.493134  1601 raft_consensus.cc:2889] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.493245  8686 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.493789  8686 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:59.502462  8653 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:59.509173  1683 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:59.472724  8651 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.478645  8325 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.515331  8773 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:02:59.521281  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.502594  8763 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:02:59.533269  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:02:59.488590  8770 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.523541  8651 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:59.579372  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 296192us
W20260709 13:02:59.580560  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.501718  8686 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.585932  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:02:59.589259  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.566263  7614 raft_consensus.cc:2955] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Committing config change with OpId 20.16: config changed from index 13 to 16, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:02:59.609297  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.599651  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.558429  8770 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.583616  8233 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.613399  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 101852us
I20260709 13:02:59.536944  8497 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:02:59.607980  8781 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.622139  8781 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.624471  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:02:59.546634  8472 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:02:59.601635  8759 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:02:59.601900  8726 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:59.610020  8782 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.547751  8773 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.627271  8777 raft_consensus.cc:2764] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:02:59.616243  8657 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:02:59.654335  8706 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:02:59.659044  8761 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:59.676852  1603 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:59.677320  1603 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:59.663199  8325 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.637107  8233 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.656503  8782 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.684736  8693 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:59.689700  8549 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.706859  8769 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:02:59.744084  8698 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:59.744993  2257 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:59.746073  1603 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.747632  1603 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.718964  8385 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.750200  8782 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.729053  8693 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:02:59.734153  8549 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.761176  8693 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.762419  8549 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:59.750507  8385 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:59.777151  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:59.781155  1534 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:59.777921  1530 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:59.784530  1603 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:59.786339  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:02:59.755724  8391 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.790970  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.797643  1609 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
W20260709 13:02:59.794230  8789 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:02:59.787036  1528 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:59.739313  8542 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.783995  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.755590  8736 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.705475  8706 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.805011  1602 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:59.795204  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:02:59.806491  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.760155  8746 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.783787  8686 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.822741  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.823243  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:02:59.821918  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:59.827615  1608 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:59.822691  8756 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.833758  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.843039  8781 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:02:59.844386  8741 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.844889  8741 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.845232  8741 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.855193  8794 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:59.855814  8794 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.856235  8794 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:59.864789  8773 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:02:59.866004  8233 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:02:59.867084  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.867606  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.868165  8651 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.870995  8770 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:59.871444  8770 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.871781  8770 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:59.874289  1606 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:02:59.880708  8787 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:59.881222  8787 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:02:59.882051  8787 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:02:59.883354  8787 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.890411  1608 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:02:59.900048  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.900874  1601 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
W20260709 13:02:59.902545  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.903710  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:02:59.865078  8758 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:02:59.904443  1675 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:02:59.909904  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.874503  8651 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.873798  8391 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.916682  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:59.930043  1681 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:59.917811  1683 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:59.918480  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:02:59.931449  1677 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:02:59.919289  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:02:59.932399  1680 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.912344  8782 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.933069  8782 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:02:59.919782  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.936542  8656 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.936983  8656 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.937322  8656 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.937355  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:59.937994  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:02:59.938275  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:02:59.938686  8796 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:59.939128  8796 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.939448  8796 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.939848  8549 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:59.940397  8549 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:02:59.941241  8549 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.944643  1608 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.918427  8746 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.927227  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:02:59.932101  8686 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:59.914987  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 290578us
W20260709 13:02:59.948576  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 348985us
W20260709 13:02:59.953155  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.948230  1680 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:02:59.935169  8782 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.972672  1529 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:59.972739  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.967514  7614 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:02:59.974880  1604 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:02:59.968456  1608 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:02:59.972874  1602 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:59.974949  7614 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:02:59.978432  7614 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:02:59.979023  1609 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:59.980983  1528 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:59.985927  8775 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.986449  8775 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.986984  8775 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.966730  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:02:59.957232  8708 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:02:59.992359  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.002055  1601 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:59.996284  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:02:59.996163  8511 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:03:00.000494  8799 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
W20260709 13:02:59.995744  8795 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:03:00.005954  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.025318  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.024879  8756 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:59.983930  8794 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:00.028003  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 67824.5us
I20260709 13:03:00.027640  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:00.042739  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.042930  1530 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.028607  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.040395  1529 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:00.050982  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.053741  1601 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:03:00.045287  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.055225  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.027633  8780 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 13:03:00.056670  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.056869  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:00.061144  2257 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:00.029886  8385 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.066323  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.030112  8693 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.068799  1529 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:03:00.073840  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.075229  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.075801  1529 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:00.045287  8698 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:00.081069  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.082063  2261 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:00.081410  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.082932  1680 raft_consensus.cc:2393] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.076390  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.087677  2257 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:00.073203  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2377057909999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:03:00.088564  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2287057909999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 13:03:00.090588  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.090698  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.090583  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.091084  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.069589  8805 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:03:00.096711  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47492.9us
I20260709 13:03:00.096864  1529 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:00.097492  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.102958  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.086700  8706 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.083601  8693 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:00.100612  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.100986  2261 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:03:00.110805  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.101342  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:00.102236  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:00.111159  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1783057910000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:03:00.090233  8806 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.104287  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:00.111583  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0343057910000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:03:00.103794  2253 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:00.102367  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.113523  1606 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:00.100519  8805 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:00.080442  8385 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.117624  2256 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:00.118454  8802 consensus_queue.cc:1059] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:03:00.119596  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.116271  8806 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.086854  8698 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.128744  8741 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.132972  1606 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:00.129958  8796 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.130028  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.136039  1676 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.138969  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:00.139688  1529 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.133286  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.139302  8796 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:00.141921  8741 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.089164  8649 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:00.147007  8794 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.146751  8805 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.147871  8385 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.148941  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.147755  2258 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:03:00.153225  1529 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:03:00.158277  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.158970  8770 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.153033  8787 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.160640  1533 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:00.155575  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:00.161460  1603 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:00.164531  8787 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.165539  8787 consensus_queue.cc:1059] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:00.166164  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.168498  8758 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:00.168927  8773 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:00.169260  8657 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.169788  8773 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:00.170148  8773 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:00.170674  8758 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:00.171057  8758 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:00.170989  8773 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.172703  8773 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:00.172041  8758 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.175536  8758 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.168620  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.168171  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.184739  8774 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:00.190863  8801 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 13:03:00.193166  1601 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:00.193621  8698 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.194267  8698 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:00.193456  1606 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:00.199509  1530 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:00.201081  8806 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.203641  1574 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.131990  8656 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.204497  8774 raft_consensus.cc:2764] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:00.205567  8774 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:00.206682  8656 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.207630  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.208436  8774 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.211081  1534 raft_consensus.cc:2368] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19.
I20260709 13:03:00.221586  2257 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:00.224738  2260 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:00.219108  2259 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:00.183245  8770 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.239948  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.234287  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:00.208470  8385 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.235348  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.240144  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.252003  1604 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:00.226899  8740 consensus_meta.cc:287] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 13:03:00.253417  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.254231  1609 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.253618  2258 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:00.257802  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.258033  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.258842  1605 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.258756  2259 raft_consensus.cc:2376] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24. Re-sending same reply.
I20260709 13:03:00.166461  8787 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
W20260709 13:03:00.254189  1573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 2.169s (SENT) [suppressed 83 similar messages]
I20260709 13:03:00.275558  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.276671  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.277400  2258 raft_consensus.cc:2376] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18. Re-sending same reply.
I20260709 13:03:00.240149  8760 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:00.303342  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 150626us
I20260709 13:03:00.307667  1609 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:00.253816  8656 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:00.303431  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.309028  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.309530  2257 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.309872  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.310501  2259 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:00.234675  8549 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:03:00.313614  1604 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:00.272469  8796 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:00.311477  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.261719  8813 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:00.317212  2257 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:00.317862  2253 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:00.325153  2258 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:00.323817  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.326782  8798 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:03:00.327417  8786 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 13:03:00.329226  8693 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:00.326967  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 209572us
I20260709 13:03:00.331662  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:00.334022  2259 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:00.278352  8649 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:00.262269  8740 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.321015  8813 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.341516  8813 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:00.325817  8796 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:00.345566  8796 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.352555  8740 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.354784  2258 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:00.323530  8741 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:00.314049  8785 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:03:00.358459  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.358358  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.313181  8760 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:00.376595  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 44980.6us
W20260709 13:03:00.377646  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.377961  8760 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:00.378222  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.382073  8325 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:00.382689  8325 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:00.386034  8780 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:00.387032  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.388845  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.364459  8385 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:00.373824  8810 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
W20260709 13:03:00.398451  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.374631  8775 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.392043  1603 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:00.338254  8791 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:00.411423  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.411569  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.411900  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.412650  2258 raft_consensus.cc:3055] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:00.409703  8756 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:00.410907  8325 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.414216  8756 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:00.415570  2258 raft_consensus.cc:740] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:00.416106  8649 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:00.416693  2258 consensus_queue.cc:260] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.406180  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.418154  2252 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:00.393957  2253 raft_consensus.cc:2376] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18. Re-sending same reply.
I20260709 13:03:00.389246  8780 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:00.413040  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:00.368495  8811 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 13:03:00.419802  1607 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.419814  8780 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:00.422195  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.417209  8791 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:00.422581  8707 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:00.423425  8707 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:00.404197  8741 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:00.423849  8791 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.424427  8707 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.398934  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.437253  1675 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:00.420941  2258 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.437427  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.437884  2260 raft_consensus.cc:2368] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:03:00.428062  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.430527  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.412683  2259 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:00.441543  2257 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:00.446525  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.447499  1675 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:00.415271  8325 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:00.450416  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.451476  8706 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:00.452440  8806 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:00.452844  1677 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:00.454819  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.455541  1681 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:00.456575  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:00.457998  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.458756  2256 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.458904  1605 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:00.459925  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.461160  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.461789  2255 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:00.462635  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.463351  2255 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.463994  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.467535  2261 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:00.405143  8798 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.466640  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.468825  2257 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:00.454980  8805 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:00.476620  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.480607  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.429877  8549 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.479692  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.492228  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.493088  1683 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:00.438441  8511 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.505357  1500 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.509111  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.510354  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.496626  2261 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:00.500958  7614 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:00.516898  2226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.522087  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.473894  8805 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:00.528798  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.529891  2259 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:03:00.531040  2259 pending_rounds.cc:85] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 13
I20260709 13:03:00.531307  2259 pending_rounds.cc:107] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:03:00.531543  2259 raft_consensus.cc:2889] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.528740  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.532368  1532 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:03:00.534281  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.536396  7614 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.490929  8802 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.539096  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:00.415324  8756 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:00.540252  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60645.2us
I20260709 13:03:00.538168  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.544193  1530 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:00.547260  1675 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.428530  8385 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.544166  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.518554  8178 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:00.494854  8760 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:03:00.552989  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:00.501713  8783 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:03:00.561728  1675 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:00.554333  8822 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:00.550158  1607 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:03:00.563115  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:00.568599  1676 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.501646  8708 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:03:00.569407  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:00.570179  1681 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:00.513363  8549 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.573690  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:00.512290  8472 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:03:00.581498  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.589393  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:00.551169  8686 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:00.520653  8511 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.592767  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.542970  8693 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:03:00.614295  8549 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.615881  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.616916  2256 raft_consensus.cc:2393] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 23: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.575742  8178 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:00.625326  8821 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:00.629801  2258 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:00.634328  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:00.616335  8823 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:00.640149  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.609789  8736 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:00.653496  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111691us
I20260709 13:03:00.654551  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.641785  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.609171  8686 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:00.647917  1681 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:00.655859  2256 raft_consensus.cc:2376] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24. Re-sending same reply.
I20260709 13:03:00.550535  8741 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:00.665521  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 104918us
W20260709 13:03:00.666287  1647 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.534s (SENT)
I20260709 13:03:00.666697  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:00.674685  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:00.675602  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.642333  8821 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:00.692888  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:00.679518  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 135442us
I20260709 13:03:00.677999  2256 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:00.679502  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.657861  8736 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.705551  2258 raft_consensus.cc:1275] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:00.709741  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.711074  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.663139  8511 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:00.716189  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:00.718142  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:00.710446  2252 raft_consensus.cc:2376] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21. Re-sending same reply.
I20260709 13:03:00.714082  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:00.675841  8742 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:00.720314  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54055us
I20260709 13:03:00.722486  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.723264  1681 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:00.726984  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.608580  8805 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.729955  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.678187  8775 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:00.729081  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.735716  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:00.781432  2255 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.719795  8651 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.751614  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.753576  8806 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.762341  7614 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.768858  1605 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:03:00.705015  8736 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.785065  1680 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 17. Current term is 18. Ops: [16.14-17.15]
I20260709 13:03:00.783047  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:00.786453  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:00.787103  1677 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
W20260709 13:03:00.790107  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.813737  2252 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:00.814535  7614 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:00.814952  7614 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:00.815280  7614 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.678130  8786 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:03:00.823530  1530 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:03:00.829746  1604 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:00.833297  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:00.816629  8789 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:00.714790  8693 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:03:00.866827  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:00.789886  8740 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:00.874943  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:00.868109  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 193486us
I20260709 13:03:00.877308  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:00.881809  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:00.882546  1605 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.894639  1606 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:00.902956  8787 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.903676  8787 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.717149  8178 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:00.903122  8831 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.881314  8800 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:00.813810  8806 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.874714  8740 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.936785  7614 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:00.909801  8773 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.004s
I20260709 13:03:00.963559  2255 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
W20260709 13:03:00.965590  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 88370.1us
I20260709 13:03:00.969774  7614 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:00.906193  8787 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:00.974157  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:00.940336  8740 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:00.972657  7614 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:00.909193  8780 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:03:00.939670  8797 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:00.831775  8686 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.976445  7614 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:00.965109  8790 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.820s	user 0.001s	sys 0.003s
W20260709 13:03:00.969477  8824 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:03:00.908381  8831 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:00.528805  8813 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.015609  8804 raft_consensus.cc:3055] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:01.009865  8843 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:01.014986  1675 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:00.976925  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.067220  7614 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:01.025816  1676 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:00.964247  8742 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.546710  8802 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.013106  1605 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:01.014277  8797 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:01.058531  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:01.027781  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 617430us
I20260709 13:03:01.071720  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:01.067327  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 90558us
I20260709 13:03:01.072412  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:00.897359  8821 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.077231  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:01.066761  8843 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.030063  8782 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.095341  2257 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:01.099800  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.059227  8786 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:01.066963  8804 raft_consensus.cc:740] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:01.029256  8842 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:01.146824  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 74484.1us
I20260709 13:03:01.148584  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:01.149901  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50185.2us
I20260709 13:03:01.153285  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.094307  8847 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:01.103494  8830 ts_tablet_manager.cc:933] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:01.112421  8325 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.002s
I20260709 13:03:01.104955  8843 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.202433  2227 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.078087  8849 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:03:01.206915  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.110273  8844 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:03:01.110518  8829 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:03:01.212742  2260 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:01.149478  8787 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:01.201246  8850 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:03:01.219110  1498 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:01.153682  8773 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:01.151537  8855 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.234328  2254 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:03:01.236052  2227 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.238497  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.198612  8847 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:01.217135  8790 log.cc:927] Time spent T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:01.215430  8844 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:01.147081  8786 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.211767  8806 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:01.246869  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.236225  8863 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:01.185496  8842 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.244150  8787 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:01.325654  8811 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:01.246150  8693 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:01.347836  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 199317us
W20260709 13:03:01.348549  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 195331us
W20260709 13:03:01.356087  8756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.000s
I20260709 13:03:01.326768  8325 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:01.333770  8863 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.327050  8855 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:01.348663  8787 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.220580  8797 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.451618  8756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.000s
I20260709 13:03:01.416442  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.481433  8863 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:01.492106  8787 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:01.508286  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 91901.8us
I20260709 13:03:01.494081  8783 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:01.494194  8813 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.511320  8783 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.514256  1573 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.484903  8844 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.516228  8844 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:01.518410  8783 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:01.489809  8859 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:01.556823  8863 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.567672  8828 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:03:01.568055  8862 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
W20260709 13:03:01.544989  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.012s	sys 0.068s
W20260709 13:03:01.569496  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.012s	sys 0.068s
I20260709 13:03:01.569769  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.318969  8804 consensus_queue.cc:260] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:01.549196  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3246) took 1969 ms. Trace:
W20260709 13:03:01.569734  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 55825.4us
W20260709 13:03:01.577973  1573 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.568s (SENT)
I20260709 13:03:01.578430  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.457355  8849 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
W20260709 13:03:01.579726  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.580449  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3387) took 1142 ms. Trace:
I20260709 13:03:01.494486  8775 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.585167  1528 rpcz_store.cc:276] 0709 13:03:00.428391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.428512 (+   121us) service_pool.cc:224] Handling call
0709 13:03:00.429112 (+   600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.449872 (+ 20760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.449898 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.450375 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.671041 (+220666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:00.671080 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.671148 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.570184 (+899036us) raft_consensus.cc:1685] finished
0709 13:03:01.570201 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.570350 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20388,"raft.queue_time_us":24891,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":220316,"threads_started":1,"wal-append.queue_time_us":436102}
W20260709 13:03:01.590248  8818 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.251s	user 0.004s	sys 0.014s
I20260709 13:03:01.590502  8856 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:01.590806  8866 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:01.593591  8849 raft_consensus.cc:2764] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:03:01.593530  8848 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.490s	user 0.000s	sys 0.001s
I20260709 13:03:01.498710  8870 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.600747  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 354038us
I20260709 13:03:01.549274  8855 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:01.580963  8811 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:01.573482  8773 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:01.499209  8831 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:01.625085  8773 consensus_queue.cc:1048] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:01.625826  8842 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:01.545468  8693 consensus_queue.cc:1175] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "428f0180c2cd487c8b48e91f14dff65d" responder_term: 22 status { last_received { term: 20 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:03:01.627004  8698 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:03:01.495633  8872 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:03:01.628875  8872 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:01.629213  8872 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:01.630113  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1653) took 1121 ms. Trace:
I20260709 13:03:01.630489  2257 rpcz_store.cc:276] 0709 13:03:00.508518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.508811 (+   293us) service_pool.cc:224] Handling call
0709 13:03:01.629925 (+1121114us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54001ed7d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:01.630034 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346411264}
I20260709 13:03:01.632085  8854 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:01.632638  8854 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.634735  8854 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.640070  8385 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:01.599882  8858 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.651104  8855 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:01.652186  8855 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.581307  8844 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:01.618952  8845 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:01.620253  8770 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:01.583171  8756 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:01.576694  1674 rpcz_store.cc:276] 0709 13:02:59.537378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.537529 (+   151us) service_pool.cc:224] Handling call
0709 13:02:59.566750 (+ 29221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.642079 (+ 75329us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:59.642676 (+   597us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.718396 (+ 75720us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.922528 (+204132us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18002d22c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:02:59.922680 (+   152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.923188 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.923333 (+   145us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:59.923365 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.923431 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.513211 (+589780us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:01.507017 (+993806us) raft_consensus.cc:1685] finished
0709 13:03:01.507045 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.507186 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202897,"prepare.queue_time_us":8797,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":229920,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":31415,"spinlock_wait_cycles":69047040,"thread_start_us":141193,"threads_started":2,"wal-append.queue_time_us":161770}
I20260709 13:03:01.598686  8802 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.611456  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:01.653894  8859 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:01.608744  8856 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.617748  8852 log.cc:927] Time spent T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:03:01.656754  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.603195  8804 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:01.668423  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57027.3us
I20260709 13:03:01.679371  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:01.618989  8867 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:03:01.682040  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:01.607295  8775 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:01.688616  1573 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:01.672292  8858 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.691306  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.550092  8847 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.693202  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:01.646363  8787 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.686825  2255 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:03:01.701897  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:01.702163  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:01.702839  1602 raft_consensus.cc:2393] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:01.616215  8870 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:01.688138  8849 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.665880  8844 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.695688  8770 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:01.698907  8796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.012s	sys 0.026s
I20260709 13:03:01.630017  8872 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.738708  8849 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.747260  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.747838  2256 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:01.750653  8830 tablet_copy_client.cc:323] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:36091
I20260709 13:03:01.754557  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3268) took 1199 ms. Trace:
W20260709 13:03:01.759289  8883 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:01.731263  8786 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:01.698196  8843 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.778765  8843 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:01.782321  8736 consensus_meta.cc:287] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.956s	user 0.007s	sys 0.003s
I20260709 13:03:01.786581  8870 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.795759  2255 raft_consensus.cc:1240] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:01.812918  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:01.683233  8756 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.815327  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 235012us
W20260709 13:03:01.741345  8796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.012s	sys 0.026s
I20260709 13:03:01.816170  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.819119  2258 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
W20260709 13:03:01.739131  8874 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:03:01.817303  1608 raft_consensus.cc:2410] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:03:01.782828  8736 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.755100  1679 rpcz_store.cc:276] 0709 13:03:00.555327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.556487 (+  1160us) service_pool.cc:224] Handling call
0709 13:03:00.578120 (+ 21633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.628561 (+ 50441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.628593 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.629118 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.744268 (+115150us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18004943e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:03:00.940031 (+195763us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:00.940077 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.592818 (+652741us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:01.754106 (+161288us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54001d9054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:01.754173 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.754256 (+    83us) raft_consensus.cc:1685] finished
0709 13:03:01.754271 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.754476 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10832,"raft.queue_time_us":17262,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":15529,"spinlock_wait_cycles":204497920,"thread_start_us":155964,"threads_started":1,"wal-append.queue_time_us":386950}
I20260709 13:03:01.817553  1574 leader_election.cc:400] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19.
I20260709 13:03:01.823498  1574 leader_election.cc:403] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:01.697479  8871 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:01.832198  2257 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:01.826722  8858 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.823662  8868 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:01.840668  8819 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:01.841193  8819 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:01.833952  8887 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19.
I20260709 13:03:01.842029  8819 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.843560  8775 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:01.822656  8770 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 13:03:01.843319  8819 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.844873  8787 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:01.835049  8871 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:01.855417  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:01.858529  2259 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.854959  1573 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:01.861321  8887 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:01.861785  8887 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.862118  8887 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.864042  1603 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:03:01.864470  1603 pending_rounds.cc:85] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 14
I20260709 13:03:01.861187  1619 tablet_copy_service.cc:140] P 428f0180c2cd487c8b48e91f14dff65d: Received BeginTabletCopySession request for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:49526)
I20260709 13:03:01.865317  1619 tablet_copy_service.cc:161] P 428f0180c2cd487c8b48e91f14dff65d: Beginning new tablet copy session on tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:49526: session id = 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1
W20260709 13:03:01.869014  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.861202  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:01.864686  1603 pending_rounds.cc:107] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:03:01.871361  1603 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.839766  8868 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:01.876856  8871 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.878387  1619 tablet_copy_source_session.cc:215] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:01.887077  8844 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.858633  8856 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.876219  8868 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.839010  8858 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.894164  2259 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:01.896919  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:01.899194  8756 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:01.893349  8844 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:03:01.901904  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.904230  8756 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:01.906869  8756 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:01.907729  8756 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:01.913378  8740 consensus_meta.cc:287] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.000s
I20260709 13:03:01.914574  8740 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.916119  8736 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:01.914000  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:01.916839  1526 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.919323  8870 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.921731  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:01.923309  1528 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:01.923687  1526 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:03:01.924952  1529 raft_consensus.cc:1275] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:01.929116  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:01.932744  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:01.932368  1499 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:01.934513  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:01.934702  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.935119  2260 raft_consensus.cc:2376] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21. Re-sending same reply.
I20260709 13:03:01.938922  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.939109  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:01.935194  2252 raft_consensus.cc:2376] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23. Re-sending same reply.
I20260709 13:03:01.919799  8870 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.941161  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.947007  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:01.941723  8736 raft_consensus.cc:2764] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:03:01.952050  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:01.953228  8830 ts_tablet_manager.cc:1916] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:03:01.940601  8796 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:01.958052  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:01.958886  1676 raft_consensus.cc:2393] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:01.947293  8791 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:01.960805  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:01.948064  8873 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:01.942116  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:01.994515  1528 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:01.945060  1526 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:01.945403  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:01.995793  1533 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.945067  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:01.945930  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:01.965787  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:01.949477  8866 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:01.976783  2226 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:01.987884  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:02.000800  1676 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:01.915264  8887 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:01.996812  1604 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:01.991250  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:02.007021  1680 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:02.007193  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:01.970901  8890 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:01.956763  8770 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.957993  8796 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:02.016764  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.017899  1680 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:02.020650  1675 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:01.965000  8858 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.022192  1682 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:02.027786  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:02.016426  8873 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:02.036995  1533 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:02.025352  8796 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:02.044924  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:02.042166  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:02.045758  2258 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.993764  8736 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:03:02.023729  8740 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.024509  8843 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:02.024355  8840 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.046223  1675 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:01.999264  8791 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.043182  1528 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:02.024895  8842 consensus_queue.cc:1048] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:02.051916  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:02.053324  1675 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:02.056335  8820 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.706s	user 0.012s	sys 0.002s
I20260709 13:03:02.051735  8878 raft_consensus.cc:2804] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:02.046123  8886 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:03:02.048802  8843 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.068078  8843 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:02.069373  8870 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.069989  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.070277  8805 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:02.052618  8840 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.073017  1607 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:02.078420  8878 raft_consensus.cc:697] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:02.079434  8878 consensus_queue.cc:237] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.081739  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.044839  8887 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.092334  8873 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.095393  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.095579  8887 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.096155  8887 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.096959  1609 raft_consensus.cc:1275] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:02.098171  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.098209  8887 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.099596  8887 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.100046  8887 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.104424  1605 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:02.104755  8887 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.109252  1609 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:02.111797  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.112736  1533 raft_consensus.cc:2410] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:03:02.117017  8897 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:02.118783  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:02.133529  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.135071  2258 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:02.137038  1573 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:02.142604  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:02.135591  8819 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.134171  8840 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.149875  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1"
dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:03:02.153738  1609 raft_consensus.cc:606] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:02.154106  1609 raft_consensus.cc:614] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:02.118139  8843 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.140870  8887 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:02.155002  8706 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.160584  8887 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:02.154814  8819 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.160621  8391 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:03:02.155753  8910 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:02.179265  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.185967  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:02.224351  2254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1589) took 1831 ms. Trace:
I20260709 13:03:02.192693  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:02.226419  2258 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 18: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:02.227375  7614 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:02.230332  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:02.207406  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:02.233374  2257 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:02.216885  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.218020  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.237016  1531 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:03:02.225032  1608 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:02.217716  1533 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:02.215106  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:02.219636  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.224959  2254 rpcz_store.cc:276] 0709 13:03:00.387925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.388386 (+   461us) service_pool.cc:224] Handling call
0709 13:03:00.388744 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.236910 (+848166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.218325 (+981415us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54007602d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:02.219331 (+  1006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899054464}
W20260709 13:03:02.245975  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 107268us
W20260709 13:03:02.217756  8902 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:02.245033  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:02.246551  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2251767619999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
I20260709 13:03:02.246927  2252 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:03:02.217403  1480 auto_rebalancer.cc:893] Removing replace marker failed: Replica 428f0180c2cd487c8b48e91f14dff65d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:02.249562  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:03:02.250103  1647 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.760s (SENT)
W20260709 13:03:02.249728  1480 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:03:02.250222  1526 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:02.165846  1675 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25.
I20260709 13:03:02.170042  8819 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.183182  8872 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:02.278323  1647 leader_election.cc:336] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.779s (SENT)
I20260709 13:03:02.279016  1647 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:02.263273  8706 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.246999  8857 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:03:02.265309  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.280109  1608 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:02.266037  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.266723  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.269565  8847 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.284747  1607 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:02.174121  8843 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.174249  8791 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:02.251267  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:02.273347  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:02.287175  1604 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:02.245301  8770 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:02.289193  8770 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.284685  2227 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:02.273114  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.276798  8873 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:02.295002  2257 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25.
I20260709 13:03:02.297919  1609 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:02.252631  8804 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.300148  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:02.305730  1526 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
W20260709 13:03:02.306378  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.313655  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.313793  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:02.313297  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.315671  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:02.313225  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 170690us
W20260709 13:03:02.316463  1647 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Timed out: RequestConsensusVote RPC to 127.0.107.196:42185 timed out after 1.962s (SENT)
I20260709 13:03:02.325670  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:02.328747  2226 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:03:02.329257  2226 leader_election.cc:403] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.280807  8656 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.301218  8665 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.295517  8843 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:02.300132  8742 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:02.335394  8880 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.338745  2226 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:02.352921  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.339129  1529 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:02.355046  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:02.339326  8842 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:02.296499  8770 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.298245  8873 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.313567  8871 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.167742  8887 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.322122  8787 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:02.364419  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47983.4us
I20260709 13:03:02.358004  8782 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:02.358373  8549 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:02.365880  1529 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:02.368767  8796 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.382572  1647 connection.cc:256] RPC call timeout handler was delayed by -1.0800122090000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:03:02.382972  1647 connection.cc:256] RPC call timeout handler was delayed by -1.0382190599999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:03:02.306862  8907 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.076s
I20260709 13:03:02.358366  8816 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:02.379629  1528 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:02.322696  8804 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.349303  8656 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.358112  8843 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:02.405133  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.363425  8873 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:02.408281  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.433254  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48696.9us
W20260709 13:03:02.430722  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50501.7us
I20260709 13:03:02.437543  1605 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
I20260709 13:03:02.385980  8665 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.398218  8736 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:02.430842  8816 raft_consensus.cc:697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:02.430724  8786 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:02.432297  8868 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:02.386031  8787 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.454067  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:02.409175  8847 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:03:02.379736  8871 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:02.464744  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:02.449808  8782 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:02.473059  2260 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:03:02.538594  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 81984.1us
W20260709 13:03:02.539847  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.541268  8919 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:03:02.539582  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 83319.8us
I20260709 13:03:02.542976  1499 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:02.451753  8497 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:03:02.448460  8665 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.615542  8861 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.507s	user 0.010s	sys 0.010s
I20260709 13:03:02.621012  8770 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.621224  8756 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.621989  8773 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.621718  8770 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.622653  8656 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.624485  8787 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.624184  8770 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.627400  8871 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.460129  8549 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:03:02.629050  8756 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.629536  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 86640.9us
I20260709 13:03:02.631263  8756 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.632505  7614 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:02.633083  7614 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:02.633214  8831 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:02.633862  7614 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.634650  8831 consensus_queue.cc:1048] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:02.637214  8804 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.637873  8913 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.638410  8913 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:02.641076  8913 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.641856  8665 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.642462  8665 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.642954  8665 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.631109  2256 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:03:02.621430  8805 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:02.550710  8843 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.645202  8805 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.647356  8805 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:02.621619  8886 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.650059  8886 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.543256  8798 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:02.621079  8916 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:03:02.462361  8868 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:02.622560  8773 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.644600  2256 pending_rounds.cc:85] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 14
I20260709 13:03:02.657430  2256 pending_rounds.cc:107] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:03:02.657680  2261 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:03:02.658161  2261 pending_rounds.cc:85] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 14
I20260709 13:03:02.658368  2261 pending_rounds.cc:107] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:03:02.658581  2261 raft_consensus.cc:2889] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.459460  8786 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.657677  2256 raft_consensus.cc:2889] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.646859  8816 consensus_queue.cc:237] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:02.687883  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 240456us
I20260709 13:03:02.654742  8868 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:02.803290  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.809129  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.677002  8886 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:02.682885  8805 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:02.925100  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.935086  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.937222  1604 raft_consensus.cc:2410] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:03:02.941632  8922 log.cc:927] Time spent T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 13:03:02.923266  8813 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.974534  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:02.975630  1604 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
W20260709 13:03:02.999150  8929 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:03.002799  8775 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.003448  8775 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.980288  8813 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.921866  8782 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:02.999069  8927 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:03.006389  8872 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.946835  8805 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.010584  8497 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:03.010316  8872 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.011597  8665 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:02.997864  8842 consensus_meta.cc:287] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.005s
I20260709 13:03:03.009181  8927 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:03.013216  8805 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.018509  8842 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
W20260709 13:03:03.030886  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 341791us
I20260709 13:03:03.031869  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.023548  8830 ts_tablet_manager.cc:1929] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 19.13
I20260709 13:03:03.031514  8813 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.034699  8786 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.038257  8931 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.071118  8931 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.047287  8937 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:03.048454  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:03.077725  8926 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:03:03.056046  8936 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.079432  8936 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.057013  8872 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.064975  8775 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.044396  8927 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.082074  8927 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.087432  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1667) took 1357 ms. Trace:
I20260709 13:03:03.064414  8786 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:03.069691  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.088052  2255 rpcz_store.cc:276] 0709 13:03:01.729729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.729914 (+   185us) service_pool.cc:224] Handling call
0709 13:03:01.742424 (+ 12510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.798819 (+ 56395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.087090 (+1288271us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54005131d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:03.087323 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122019584}
I20260709 13:03:03.071559  8796 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.089834  8786 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.090811  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.092195  8936 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.092886  8936 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.094524  1604 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:03.095836  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:03.096670  8873 consensus_meta.cc:287] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.003s
I20260709 13:03:03.097146  8873 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.102142  8863 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:03.106841  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.110981  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.037s	sys 0.064s
W20260709 13:03:03.111409  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.038s	sys 0.064s
I20260709 13:03:03.066635  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1613) took 1038 ms. Trace:
W20260709 13:03:03.111677  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 651469us
I20260709 13:03:03.112494  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:03.113924  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.113884  8707 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:03.114535  8707 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.114913  8707 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:03.115597  8805 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:03:03.116724  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84923us
I20260709 13:03:03.117738  2259 rpcz_store.cc:276] 0709 13:03:02.027714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.028415 (+   701us) service_pool.cc:224] Handling call
0709 13:03:02.028665 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.030578 (+  1913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.030610 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.030651 (+    41us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:02.030683 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.066356 (+1035673us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5400997ad4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:03.066421 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.066571 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3946240}
I20260709 13:03:03.120357  8931 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.114140  8863 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:03:03.124886  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1455) took 1432 ms. Trace:
I20260709 13:03:03.125362  1606 rpcz_store.cc:276] 0709 13:03:01.692377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.692483 (+   106us) service_pool.cc:224] Handling call
0709 13:03:01.702569 (+ 10086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.828164 (+125595us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:01.879399 (+ 51235us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.931460 (+ 52061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.931515 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:01.931559 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.124653 (+1193094us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004547d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:03.124704 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.124826 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57762,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2195,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7688,"spinlock_wait_cycles":288270208,"thread_start_us":98300,"threads_started":2,"wal-append.queue_time_us":72694,"wal-append.run_cpu_time_us":1304,"wal-append.run_wall_time_us":1009777}
I20260709 13:03:03.127225  8796 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:03.127575  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:03.128846  8936 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:03.129261  8936 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.129628  8936 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.131824  8797 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:03.134413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.135362  1683 raft_consensus.cc:2393] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:03.136418  8873 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:03.117642  1647 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.138725  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:03.138962  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.139768  1683 raft_consensus.cc:2393] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:03:03.140082  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.143903  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.139982  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.140406  8775 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.145411  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.144711  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:03.150368  1676 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.151362  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.154785  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.155551  1678 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:03.157202  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.158010  1680 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:03.161164  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.162220  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.168637  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.163128  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:03.165139  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.162439  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.164894  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.170686  1683 raft_consensus.cc:1240] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:03.176260  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.175174  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.179796  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.181574  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.174409  8931 raft_consensus.cc:2764] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 13:03:03.186234  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.186623  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:03.187330  1604 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:03.187996  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:03.187450  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.180558  1678 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:03.192498  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.187932  8840 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.194037  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.193943  8840 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.196581  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:03.197296  1530 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 18: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:03.197710  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:03.198310  8894 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 1.229s	user 0.004s	sys 0.008s
I20260709 13:03:03.198745  8805 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.186278  8796 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:03.199431  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.205196  8938 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:03.205974  1602 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:03.189635  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.206996  1531 raft_consensus.cc:2393] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:03.161477  8863 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:03.207700  1674 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:03.209529  8707 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.211711  8707 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.207808  8863 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.212729  8863 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.213229  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48926 (request call id 1652) took 2754 ms. Trace:
I20260709 13:03:03.213688  8830 rpcz_store.cc:276] 0709 13:03:00.459217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.466221 (+  7004us) service_pool.cc:224] Handling call
0709 13:03:01.209160 (+742939us) ts_tablet_manager.cc:934] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
0709 13:03:01.901673 (+692513us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:02.372372 (+470699us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.019731 (+647359us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.047910 (+ 28179us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 13:03:03.153744 (+105834us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:03.212563 (+ 58819us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:03.213035 (+   472us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:03.213113 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8531,"tablet-copy.queue_time_us":226677,"thread_start_us":188111,"threads_started":2}
I20260709 13:03:03.215282  8830 tablet_copy_client.cc:806] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:03.217106  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.219376  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.203280  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.220606  1604 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:03.220736  1676 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:03.229581  1647 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:03.232033  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.233904  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.228775  8760 raft_consensus.cc:2764] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:03:03.236598  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.236797  8775 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:03.237224  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.238427  1528 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:03.239719  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:03.240731  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55120.1us
I20260709 13:03:03.241657  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.230716  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.196141  8840 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.253944  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.255676  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.232451  8931 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.249020  1647 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.257719  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.258109  1534 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:03.259958  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:03.263165  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.257266  8497 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:03:03.265813  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:03.254004  8830 tablet_copy_client.cc:670] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:03.253448  8756 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:03.257874  8797 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:03.283330  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.287060  1680 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:03.282786  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:03.290220  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.292480  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:03.293599  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.301453  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.303215  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.266067  8906 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:03.308584  1681 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:03.312005  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.312728  1683 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:03.277658  8849 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.259057  8863 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.309912  8797 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:03.329298  8863 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.329492  8797 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.330608  1526 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:03.276260  8871 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:03:03.310268  8906 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.333604  8906 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:03.314169  1500 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:03.317313  8934 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.297011  8868 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:03.308913  8913 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:03.325640  1679 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:03.345598  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:03.346385  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.326020  8756 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:03.342032  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.342506  8740 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:03.349460  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.358147  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.363952  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.366607  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.367326  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
W20260709 13:03:03.349813  8864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.385s	user 0.013s	sys 0.015s
I20260709 13:03:03.369978  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.374472  2261 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:03.372941  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.347707  8868 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.376510  1674 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:03.356925  8871 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.379959  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.377944  2254 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:03.347572  8913 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.360445  8881 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.379190  8864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.013s	sys 0.015s
I20260709 13:03:03.360603  8836 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.368604  8325 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.407699  1679 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:03:03.404563  1683 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:03.369414  8740 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:03.357589  8549 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:03.368767  8857 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.418347  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1671) took 1601 ms. Trace:
I20260709 13:03:03.421752  8866 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:03.384215  8868 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.433131  8325 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:03.433481  2253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1655) took 2841 ms (client timeout 1568 ms). Trace:
I20260709 13:03:03.433739  8549 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:03.434357  8857 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.448048  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.448699  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.448100  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.450043  8857 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:03.431870  2256 rpcz_store.cc:276] 0709 13:03:01.817159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.817296 (+   137us) service_pool.cc:224] Handling call
0709 13:03:01.817571 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.659953 (+842382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.418065 (+758112us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54002369d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:03.418275 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870066944}
I20260709 13:03:03.451642  8740 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.401340  8871 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.454383  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.455574  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.430408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.457286  1683 raft_consensus.cc:3060] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:03.458817  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.457690  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:03.422415  8887 consensus_queue.cc:1059] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:03.391734  8913 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:03.446043  8549 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:03.438067  2253 rpcz_store.cc:269] 0709 13:03:00.592099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.592506 (+   407us) service_pool.cc:224] Handling call
0709 13:03:03.433215 (+2840709us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002dc154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:03.433388 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841151360}
I20260709 13:03:03.460765  1680 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:03.451370  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.470204  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.474040  1679 raft_consensus.cc:2393] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:03.480578  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.416127  8881 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.497324  2259 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:03:03.498034  8881 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.499647  8871 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.432683  8836 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.471103  8906 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.489454  8549 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.503475  8549 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.505472  8798 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:03.508638  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:03.511873  8923 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.574s	user 0.004s	sys 0.004s
I20260709 13:03:03.435969  8866 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:03.480448  8863 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:03.491158  1677 raft_consensus.cc:2368] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:03:03.513182  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3719) took 1241 ms. Trace:
I20260709 13:03:03.514011  8866 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.513583  1609 rpcz_store.cc:276] 0709 13:03:02.271709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.330382 (+ 58673us) service_pool.cc:224] Handling call
0709 13:03:02.356737 (+ 26355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.357123 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:02.357148 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.361237 (+  4089us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.451890 (+ 90653us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:02.451935 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.452013 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.486008 (+1033995us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:03.512818 (+ 26810us) raft_consensus.cc:1685] finished
0709 13:03:03.512837 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.513039 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1325,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7483,"spinlock_wait_cycles":26350464,"thread_start_us":62746,"threads_started":1,"wal-append.queue_time_us":189270}
I20260709 13:03:03.515084  8866 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.515650  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:03.516836  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.517665  8936 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.519392  1674 raft_consensus.cc:2368] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19.
I20260709 13:03:03.517992  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:03.521523  8936 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.522348  8708 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:03.523903  8708 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:03.459965  8707 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:03:03.525167  2257 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:03:03.480047  8758 raft_consensus.cc:3055] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:03.525524  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:03.530597  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:03.525272  1683 raft_consensus.cc:2468] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:03:03.497226  8325 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.513108  8773 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.501854  8836 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:03.551043  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.533998  8758 raft_consensus.cc:740] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:03.556375  2259 raft_consensus.cc:2410] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:03:03.504146  8906 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.559273  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.561219  2259 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:03:03.545809  8887 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:03.565186  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:03.556813  8758 consensus_queue.cc:260] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.567529  8758 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.568411  8868 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.570619  8868 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:03.556972  8940 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.571533  8940 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.573957  8940 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.580211  8773 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.580798  8773 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:03.581393  8706 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:03.584010  1609 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:03.587692  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.547199  8925 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.603703  2259 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:03.604379  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.617200  2261 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:03:03.605762  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.618702  2261 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:03:03.621316  2261 pending_rounds.cc:85] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 15
I20260709 13:03:03.621661  2261 pending_rounds.cc:107] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:03:03.622013  2261 raft_consensus.cc:2889] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:03.599848  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53742.4us
I20260709 13:03:03.624792  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:03.548100  8881 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.626701  8881 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.628607  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.629295  2253 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:03.628885  8881 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:03.639261  2252 raft_consensus.cc:2410] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:03.687094  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:03.704959  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.582727  8887 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.713723  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:03.714124  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 73943.1us
W20260709 13:03:03.714637  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.016s	sys 0.036s
I20260709 13:03:03.554359  8756 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:03:03.599093  8871 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.714416  2255 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:03:03.712661  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 88616.8us
I20260709 13:03:03.729290  1534 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:03.732430  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 438866us
I20260709 13:03:03.734031  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.715799  8887 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:03.745564  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:03.714915  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.016s	sys 0.036s
I20260709 13:03:03.741433  1677 raft_consensus.cc:1275] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:03:03.747633  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.719445  8805 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.765105  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:03.751845  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:03.755090  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:03.769794  1609 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.769987  2261 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.756590  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.757699  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.760512  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.771116  1677 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:03.772568  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.773156  1677 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:03.771026  1679 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:03.774017  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.775350  1680 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:03:03.776170  1681 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:03.783484  2254 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:03:03.786185  1677 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:03.791560  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.823406  2261 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:03.824790  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.825644  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:03.766515  8836 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.768193  8325 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.838685  2255 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
W20260709 13:03:03.839536  2224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.785171  8830 tablet_copy_client.cc:538] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:03.735386  8871 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.772810  8773 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:03.842609  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 95077.9us
I20260709 13:03:03.840054  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:03.846613  1607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.026s
I20260709 13:03:03.846792  2255 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:03.851365  1607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.017s	sys 0.026s
I20260709 13:03:03.839763  2261 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:03.847944  1609 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:03.854044  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:03.790741  8693 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.858510  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.859141  1681 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:03.859714  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:03.858914  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.831182  8931 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:03.866627  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.015s	sys 0.026s
W20260709 13:03:03.866959  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.015s	sys 0.026s
I20260709 13:03:03.875808  2255 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:03.879779  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:03.856268  8758 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:03.851994  8756 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:03.863646  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:03.773964  8805 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.833223  8936 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:03:03.902180  1680 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.901312  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.866406  8934 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.910967  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.861428  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:03.841279  8868 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:03:03.842366  8913 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:03.862382  1606 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.019s	sys 0.040s
I20260709 13:03:03.914935  1681 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:03.893061  8760 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:03.901844  8878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.792s	user 0.028s	sys 0.068s
I20260709 13:03:03.890726  8881 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.845139  8836 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.846287  8325 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.901186  8758 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:03.902395  8665 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
W20260709 13:03:03.929133  8958 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:03.927182  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:03.938854  8760 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:03.918656  8843 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:03.949039  8878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.842s	user 0.028s	sys 0.069s
I20260709 13:03:03.877159  8693 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:03.991137  1680 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
W20260709 13:03:03.971664  1606 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.019s	sys 0.040s
W20260709 13:03:03.978284  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.996577  1602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.019s	sys 0.016s
I20260709 13:03:03.912266  8756 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:04.008002  8756 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:03.974334  8758 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.973862  8707 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:03:04.011375  8951 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:03:04.008950  8325 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:04.018347  8758 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.009554  8756 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:04.019877  8756 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:04.020695  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.016s
I20260709 13:03:03.997017  8847 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:04.023685  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:04.028188  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.028s
I20260709 13:03:04.024469  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:03.999346  8760 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:04.033516  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.028s
I20260709 13:03:04.032656  8325 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:04.047828  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.051507  8693 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:04.027658  8797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.018s	sys 0.049s
W20260709 13:03:04.056646  8797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.018s	sys 0.049s
I20260709 13:03:04.054171  8325 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.069763  8760 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.070806  8325 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:04.073109  8954 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:03:04.072868  8760 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.062413  8886 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:04.089354  1679 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:04.094192  1679 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:04.095376  1679 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.100297  1679 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:04.109185  1649 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:04.111421  1601 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:04.113014  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:04.111775  8936 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:04.117053  8936 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:04.118119  8936 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:04.098989  8952 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:03:04.094281  8871 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.096863  8707 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:04.132476  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 384227us
I20260709 13:03:04.134997  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:04.154353  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.016s	sys 0.026s
W20260709 13:03:04.154796  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.016s	sys 0.026s
W20260709 13:03:04.155404  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 590283us
I20260709 13:03:04.164824  1679 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:03:04.165601  1679 pending_rounds.cc:85] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 15
I20260709 13:03:04.166103  1679 pending_rounds.cc:107] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 21.16
W20260709 13:03:04.132524  8855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.015s	sys 0.055s
I20260709 13:03:04.166463  1679 raft_consensus.cc:2889] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.169824  8863 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:04.171428  8863 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:04.180507  1603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.031s
W20260709 13:03:04.181681  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.014s	sys 0.031s
I20260709 13:03:04.146557  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:04.204290  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 58347.8us
I20260709 13:03:04.205792  1573 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:04.221832  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 310922us
I20260709 13:03:04.146994  8913 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:04.167479  8955 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.160s	user 0.004s	sys 0.000s
W20260709 13:03:04.170629  8855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.015s	sys 0.056s
I20260709 13:03:04.229007  2226 leader_election.cc:400] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 19. Current term is 20.
I20260709 13:03:04.230857  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3413) took 1015 ms. Trace:
W20260709 13:03:04.249125  2259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.017s
W20260709 13:03:04.249627  2259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.017s	sys 0.017s
I20260709 13:03:04.143666  8707 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.258455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:04.259503  1528 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:04.262874  1532 raft_consensus.cc:3060] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:04.179051  8836 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:04.269306  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 405203us
I20260709 13:03:04.270138  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:04.271237  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.271446  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.274966  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.272526  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.231300  1527 rpcz_store.cc:276] 0709 13:03:03.215014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.217209 (+  2195us) service_pool.cc:224] Handling call
0709 13:03:03.217543 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.217941 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.217969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.218519 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.542803 (+324284us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:03.542845 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.542927 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.230589 (+687662us) raft_consensus.cc:1685] finished
0709 13:03:04.230613 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.230781 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":662,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":97,"thread_start_us":323862,"threads_started":1,"wal-append.queue_time_us":682843}
I20260709 13:03:04.224956  8756 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.282068  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.284293  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.224715  8863 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.285444  1534 raft_consensus.cc:2410] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:04.291251  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.265690  8391 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:04.228263  8957 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 13:03:04.301620  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:04.284962  8855 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:04.277056  8969 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:04.290612  8758 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.264426  8819 consensus_queue.cc:1048] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:03:04.284824  8756 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:04.309057  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.019s	sys 0.018s
W20260709 13:03:04.310351  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.019s	sys 0.018s
I20260709 13:03:04.308923  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:04.308775  2253 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.023s
I20260709 13:03:04.299069  8391 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.290009  8760 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
W20260709 13:03:04.304961  8866 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
W20260709 13:03:04.315613  2253 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.023s
W20260709 13:03:04.317117  2256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.029s
I20260709 13:03:04.314293  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:04.318346  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3736) took 1133 ms. Trace:
I20260709 13:03:04.318846  1604 rpcz_store.cc:276] 0709 13:03:03.184886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.221471 (+ 36585us) service_pool.cc:224] Handling call
0709 13:03:03.221796 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.229200 (+  7404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.229238 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.245714 (+ 16476us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.717527 (+471813us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:03.717572 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.717695 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.120057 (+402362us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:04.318033 (+197976us) raft_consensus.cc:1685] finished
0709 13:03:04.318056 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.318275 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6961,"raft.queue_time_us":14372,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":35521408,"thread_start_us":471400,"threads_started":1,"wal-append.queue_time_us":760807}
I20260709 13:03:04.308117  8472 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:03:04.311546  8855 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:04.337205  8855 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.341377  8870 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:04.310917  8969 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:04.311244  8756 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:04.361752  8976 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:03:04.365132  8887 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.003s
I20260709 13:03:04.365715  8887 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.367003  1607 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:04.367854  8830 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:03:04.369369  8887 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.378023  1532 raft_consensus.cc:2468] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:04.382534  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3349) took 2120 ms. Trace:
I20260709 13:03:04.383546  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.386811  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.389658  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.391845  1601 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:04.392575  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:04.394479  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:04.395162  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:04.395592  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:04.401793  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:04.318389  2256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.029s
W20260709 13:03:04.404438  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 90242.2us
I20260709 13:03:04.416559  2255 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:04.432444  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.014s
W20260709 13:03:04.433107  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.014s
I20260709 13:03:04.489708  2254 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:04.343196  8871 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:04.502797  2255 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
W20260709 13:03:04.439513  2258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.014s
W20260709 13:03:04.504215  2258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.007s	sys 0.018s
W20260709 13:03:04.510195  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.023s
W20260709 13:03:04.512903  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 117784us
I20260709 13:03:04.515686  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:04.513055  2224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.019s
W20260709 13:03:04.516799  2224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.008s	sys 0.020s
W20260709 13:03:04.517350  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.024s
I20260709 13:03:04.383101  1600 rpcz_store.cc:276] 0709 13:03:02.261784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.270980 (+  9196us) service_pool.cc:224] Handling call
0709 13:03:02.271310 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.271697 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:02.295605 (+ 23908us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.143156 (+847551us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b180022a080. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a 00007f7e63b3ba2a
0709 13:03:04.265573 (+1122417us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.278258 (+ 12685us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.291110 (+ 12852us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.291150 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.291215 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.382149 (+ 90934us) raft_consensus.cc:1685] finished
0709 13:03:04.382273 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.382440 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25180,"prepare.queue_time_us":22158,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":86002,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":24553,"spinlock_wait_cycles":8790272,"thread_start_us":1099683,"threads_started":2,"wal-append.queue_time_us":1875684}
I20260709 13:03:04.491796  8863 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.522495  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.013s	sys 0.013s
I20260709 13:03:04.524595  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:04.532284  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.561465  2227 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:04.496346  8391 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:04.559878  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.013s	sys 0.013s
W20260709 13:03:04.585325  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 723888us
I20260709 13:03:04.586423  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:04.589166  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1332) took 1141 ms. Trace:
I20260709 13:03:04.589663  1674 rpcz_store.cc:276] 0709 13:03:03.447321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.447861 (+   540us) service_pool.cc:224] Handling call
0709 13:03:04.588904 (+1141043us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54003ab954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:04.589089 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158791040}
I20260709 13:03:04.594820  2253 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:04.595311  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:04.596038  2254 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:04.595690  2255 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:04.522459  8940 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:04.526948  8975 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:04.605195  8977 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:04.629890  8962 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
I20260709 13:03:04.646113  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48924 (request call id 1860) took 1038 ms. Trace:
I20260709 13:03:04.527520  8836 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:04.566691  8866 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:04.664372  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.025s	sys 0.025s
W20260709 13:03:04.673237  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.025s	sys 0.026s
I20260709 13:03:04.581982  8847 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:04.677800  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:04.663686  8976 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:04.620879  8758 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:04.679436  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:04.693581  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.702852  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.563545  8863 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:04.706421  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.022s	sys 0.037s
W20260709 13:03:04.707983  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.022s	sys 0.037s
W20260709 13:03:04.680677  1602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.017s
W20260709 13:03:04.710323  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.018s
W20260709 13:03:04.680059  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.008s	sys 0.015s
W20260709 13:03:04.712800  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.008s	sys 0.015s
W20260709 13:03:04.713258  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 602043us
I20260709 13:03:04.728137  8863 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.731873  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3310) took 1182 ms. Trace:
I20260709 13:03:04.732398  1675 rpcz_store.cc:276] 0709 13:03:03.548965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.549064 (+    99us) service_pool.cc:224] Handling call
0709 13:03:03.549349 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.556100 (+  6751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.556132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:03.556827 (+   695us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.315286 (+758459us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:04.315325 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.315403 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.731631 (+416228us) raft_consensus.cc:1685] finished
0709 13:03:04.731657 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.731807 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":498,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4084,"thread_start_us":629212,"threads_started":1,"wal-append.queue_time_us":1129309}
I20260709 13:03:04.678155  8957 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
W20260709 13:03:04.733577  8968 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
W20260709 13:03:04.680564  8740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.018s
I20260709 13:03:04.742375  8758 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:04.744691  8805 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.745599  8969 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:04.658763  8974 rpcz_store.cc:276] 0709 13:03:03.639581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.694795 (+ 55214us) service_pool.cc:224] Handling call
0709 13:03:04.645959 (+951164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":923872,"thread_start_us":595440,"threads_started":1}
I20260709 13:03:04.747792  2254 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:03:04.719420  8786 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:04.752856  8957 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.659302  8975 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:04.753492  8957 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.755097  8975 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:04.737601  8983 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:04.756063  8957 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.665030  8977 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.757491  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3725) took 2460 ms. Trace:
I20260709 13:03:04.758257  1608 rpcz_store.cc:276] 0709 13:03:02.297029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.079231 (+782202us) service_pool.cc:224] Handling call
0709 13:03:03.079597 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.079952 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:03.357079 (+277127us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.055542 (+698463us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.060915 (+  5373us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.061076 (+   161us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:04.061113 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.061222 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.757243 (+696021us) raft_consensus.cc:1685] finished
0709 13:03:04.757262 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.757421 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18048,"prepare.queue_time_us":311591,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":10703,"raft.queue_time_us":20528,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":1717,"thread_start_us":907752,"threads_started":2,"wal-append.queue_time_us":915726}
W20260709 13:03:04.737636  8740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.018s
I20260709 13:03:04.741950  8906 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:04.752756  8886 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:04.776007  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3741) took 1461 ms. Trace:
I20260709 13:03:04.757484  8549 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:04.809607  1607 rpcz_store.cc:276] 0709 13:03:03.314724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.900771 (+586047us) service_pool.cc:224] Handling call
0709 13:03:03.921790 (+ 21019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.367475 (+445685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.775628 (+408153us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54001bbcd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:04.775897 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023349632}
W20260709 13:03:04.772754  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 477303us
W20260709 13:03:04.720041  8934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.016s
W20260709 13:03:04.816468  8934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.016s
W20260709 13:03:04.804162  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 488038us
I20260709 13:03:04.821656  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3368) took 1574 ms. Trace:
I20260709 13:03:04.821861  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:04.828692  8931 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:04.829360  8931 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.831279  8977 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:04.831923  8980 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:03:04.832948  8707 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.833278  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3740) took 1563 ms. Trace:
I20260709 13:03:04.833652  1609 rpcz_store.cc:276] 0709 13:03:03.270137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.853027 (+582890us) service_pool.cc:224] Handling call
0709 13:03:03.853401 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.853996 (+   595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.854024 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.864525 (+ 10501us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.342642 (+478117us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:04.342707 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.344450 (+  1743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.833041 (+488591us) raft_consensus.cc:1685] finished
0709 13:03:04.833065 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.833211 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338,"raft.queue_time_us":142343,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3155,"thread_start_us":436070,"threads_started":1,"wal-append.queue_time_us":792767}
I20260709 13:03:04.815058  8886 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:04.837574  8886 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.803480  8925 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:03:04.810905  8760 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:04.838984  8760 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:04.839335  8973 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.236s	user 0.000s	sys 0.003s
I20260709 13:03:04.839813  8760 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:04.841128  8965 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
W20260709 13:03:04.846777  8978 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:03:04.826329  1605 rpcz_store.cc:276] 0709 13:03:03.247081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.844402 (+597321us) service_pool.cc:224] Handling call
0709 13:03:03.864468 (+ 20066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.877915 (+ 13447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.877954 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.878001 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:03.878038 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.821393 (+943355us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400337054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:04.821448 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.821599 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30345984}
I20260709 13:03:04.841076  8760 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:04.856871  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1858) took 1250 ms. Trace:
I20260709 13:03:04.849583  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3738) took 1664 ms. Trace:
I20260709 13:03:04.858762  1606 rpcz_store.cc:276] 0709 13:03:03.185491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.222736 (+ 37245us) service_pool.cc:224] Handling call
0709 13:03:03.223074 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.223285 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:04.005104 (+781819us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.849193 (+844089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.849249 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:04.849294 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.849408 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.849519 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211126,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":69061,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":24063,"thread_start_us":1601754,"threads_started":3,"wal-append.queue_time_us":802317}
I20260709 13:03:04.857308  2259 rpcz_store.cc:276] 0709 13:03:03.606721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.617027 (+ 10306us) service_pool.cc:224] Handling call
0709 13:03:03.617436 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.685764 (+ 68328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.685799 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.686318 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.250051 (+563733us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:04.250100 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.250178 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.838729 (+588551us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:04.849244 (+ 10515us) raft_consensus.cc:1685] finished
0709 13:03:04.849266 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.856798 (+  7532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57350,"raft.queue_time_us":82358,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":77508480,"thread_start_us":539038,"threads_started":1,"wal-append.queue_time_us":800561}
I20260709 13:03:04.864253  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1852) took 1262 ms. Trace:
I20260709 13:03:04.864984  2256 rpcz_store.cc:276] 0709 13:03:03.601448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.601580 (+   132us) service_pool.cc:224] Handling call
0709 13:03:03.602754 (+  1174us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.713630 (+110876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.713658 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:03.722861 (+  9203us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.402628 (+679767us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:04.812451 (+409823us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.812909 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.846121 (+ 33212us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:04.846410 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.846505 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.863861 (+ 17356us) raft_consensus.cc:1685] finished
0709 13:03:04.863900 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.864164 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107932,"raft.queue_time_us":108291,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":15248,"spinlock_wait_cycles":177001216,"thread_start_us":930362,"threads_started":2,"wal-append.queue_time_us":885058}
I20260709 13:03:04.831344  8931 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:04.850322  8804 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:04.860457  8936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.017s
I20260709 13:03:04.883695  8847 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:04.895212  8936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.017s
W20260709 13:03:04.895882  8855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.004s	sys 0.014s
W20260709 13:03:05.027630  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.034s	sys 0.052s
W20260709 13:03:05.055408  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.035s	sys 0.052s
I20260709 13:03:05.055665  1530 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:05.057844  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.058692  8984 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:05.060168  8984 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:05.065781  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:05.068017  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:05.070161  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:05.072111  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:04.971153  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.014s
W20260709 13:03:05.073652  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.008s	sys 0.014s
W20260709 13:03:05.054576  8855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.005s	sys 0.014s
I20260709 13:03:05.077155  2254 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:04.930647  8847 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.051522  8986 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.093515  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3269) took 1237 ms. Trace:
W20260709 13:03:05.091895  1676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.021s
W20260709 13:03:05.094877  1676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.009s	sys 0.021s
I20260709 13:03:04.967093  8756 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.089968  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:05.132715  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.133832  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.133510  1674 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:05.135756  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:05.134473  1679 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:05.143165  2254 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:05.145159  1681 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:05.093966  1677 rpcz_store.cc:276] 0709 13:03:03.856274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.856546 (+   272us) service_pool.cc:224] Handling call
0709 13:03:03.856902 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.863135 (+  6233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.863173 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:03.903151 (+ 39978us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.673781 (+770630us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:05.087897 (+414116us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.093123 (+  5226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.093273 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.093311 (+    38us) raft_consensus.cc:1685] finished
0709 13:03:05.093322 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.093457 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7598,"raft.queue_time_us":2851,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14015,"thread_start_us":1118652,"threads_started":2,"wal-append.queue_time_us":907072}
I20260709 13:03:05.146943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:05.149175  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.153059  1681 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:05.180449  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.178685  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.189090  1679 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:05.203619  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:05.204274  1601 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.130472  9004 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:05.200953  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54139.3us
I20260709 13:03:05.210644  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.095854  8797 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:05.194149  8985 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:02.921625   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:05.143203  8977 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.151026  8989 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.095393  8931 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.108s
I20260709 13:03:05.319911  1426 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:05.320065  8989 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.321432  1426 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 13 to 16, term changed from 20 to 21, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:05.323971  8989 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:05.325575  8977 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.323257  1426 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: config changed from index 11 to -1, term changed from 19 to 21, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) evicted, now has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
W20260709 13:03:05.222805  2258 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.002s	sys 0.039s
W20260709 13:03:05.224472  8981 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:03:05.314999  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.015s
I20260709 13:03:05.193068  8934 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.329865  1426 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 19, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:05.330374  8934 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:05.331334  2258 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.002s	sys 0.039s
I20260709 13:03:05.332674  8934 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:05.334523  8934 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:05.334982  8934 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:05.334635  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3293) took 2049 ms. Trace:
W20260709 13:03:05.336129  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.014s	sys 0.015s
I20260709 13:03:05.335899  8934 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.336938  1574 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:05.337396  1601 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:05.337700  8934 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:05.338053  8992 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.372s	user 0.001s	sys 0.009s
I20260709 13:03:05.339824  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:05.341804  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.342499  1607 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:03:05.342651  8819 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.192242  8549 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:05.345533  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.021s	sys 0.009s
W20260709 13:03:05.346283  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.021s	sys 0.009s
I20260709 13:03:05.335793  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1857) took 1730 ms. Trace:
I20260709 13:03:05.338188  1676 rpcz_store.cc:276] 0709 13:03:03.285494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.300215 (+ 14721us) service_pool.cc:224] Handling call
0709 13:03:03.300628 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.313701 (+ 13073us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:03.449276 (+135575us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b48001b0258. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:03:03.875118 (+425842us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.095291 (+1220173us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:05.095854 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:03:05.096061 (+   207us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:05.332256 (+236195us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.334215 (+  1959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.334300 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.334420 (+   120us) raft_consensus.cc:1685] finished
0709 13:03:05.334435 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.334579 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5855,"prepare.queue_time_us":1003583,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":400604,"raft.run_cpu_time_us":2595,"raft.run_wall_time_us":140042,"spinlock_wait_cycles":23783168,"thread_start_us":1942297,"threads_started":4,"wal-append.queue_time_us":802488}
I20260709 13:03:05.206280  8927 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.354271  1676 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:03:05.355360  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:05.356572  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:05.207175  8983 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.357254  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1636) took 1058 ms. Trace:
I20260709 13:03:05.361177  2260 rpcz_store.cc:276] 0709 13:03:04.298384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.298619 (+   235us) service_pool.cc:224] Handling call
0709 13:03:04.298918 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.307201 (+  8283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.307234 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.307854 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.770346 (+462492us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:04.770399 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.770483 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.357051 (+586568us) raft_consensus.cc:1685] finished
0709 13:03:05.357073 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.357198 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7864,"raft.queue_time_us":10148,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1609,"thread_start_us":462153,"threads_started":1,"wal-append.queue_time_us":913999}
I20260709 13:03:05.365547  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.366240  8756 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.343323  8819 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.367159  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3309) took 1818 ms. Trace:
I20260709 13:03:05.368937  8819 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:05.367985  1683 rpcz_store.cc:276] 0709 13:03:03.548665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.548786 (+   121us) service_pool.cc:224] Handling call
0709 13:03:03.550309 (+  1523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.557597 (+  7288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.557628 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.126437 (+568809us) spinlock_profiling.cc:243] Waited 949 us on lock 0x7b2c0012ecf8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:03:04.144415 (+ 17978us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.709551 (+565136us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:04.709596 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.709675 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.366857 (+657182us) raft_consensus.cc:1685] finished
0709 13:03:05.366879 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.367099 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5495,"raft.queue_time_us":7270,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4626,"spinlock_wait_cycles":2182400,"thread_start_us":528325,"threads_started":1,"wal-append.queue_time_us":706705}
I20260709 13:03:05.351230  2258 rpcz_store.cc:276] 0709 13:03:03.605657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.605804 (+   147us) service_pool.cc:224] Handling call
0709 13:03:03.606151 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.691603 (+ 85452us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:03:03.728006 (+ 36403us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.509480 (+781474us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.521514 (+ 12034us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.525987 (+  4473us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:05.333369 (+807382us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.335482 (+  2113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.335571 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.335612 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:05.335623 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.335738 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1236,"prepare.queue_time_us":843046,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":131106,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":31517,"thread_start_us":1543684,"threads_started":3,"wal-append.queue_time_us":500227}
I20260709 13:03:05.367022  8906 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.367137  8773 raft_consensus.cc:2804] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:05.337863  8847 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:05.369978  8990 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.470s	user 0.000s	sys 0.001s
I20260709 13:03:05.367471  8983 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.370203  8773 raft_consensus.cc:697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:05.370790  8991 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:03:05.371198  8773 consensus_queue.cc:237] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.372038  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1472) took 1947 ms. Trace:
I20260709 13:03:05.372438  1602 rpcz_store.cc:276] 0709 13:03:03.424717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.041961 (+617244us) service_pool.cc:224] Handling call
0709 13:03:04.042342 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.060573 (+ 18231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.060609 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.064158 (+  3549us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.711837 (+647679us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:04.711879 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.711945 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.371811 (+659866us) raft_consensus.cc:1685] finished
0709 13:03:05.371832 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.371981 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12909,"raft.queue_time_us":14490,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":14321,"thread_start_us":588626,"threads_started":1,"wal-append.queue_time_us":770292}
I20260709 13:03:05.373953  8906 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.376109  8906 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.352351  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.382550  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.376266  1680 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:05.219997  9011 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:05.340814  8977 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.129976  8986 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.344774  8857 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:05.344925  8760 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.369508  8819 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.372071  8983 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:05.222121  8871 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.164s
I20260709 13:03:05.331379  1426 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 17 to 19, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:05.393774  8989 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:05.234278  9004 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:05.405427  8878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.016s	sys 0.026s
I20260709 13:03:05.381426  8549 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.386210  8927 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:05.435312  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52878.5us
I20260709 13:03:05.405984  9011 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:05.444000  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.459959  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:05.428506  8878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.016s	sys 0.027s
I20260709 13:03:05.406806  8760 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.465255  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.394091  8996 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:05.456463  8983 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:05.416388  8819 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.519912  8819 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:05.468729  8782 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.468991  8871 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:05.471496  8391 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:05.472769  8873 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:05.477116  8472 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.485649  8906 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:05.523831  8999 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
W20260709 13:03:05.499226  9000 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:03:05.499431  8549 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.500770  8986 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:05.504977  8794 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.507251  9008 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:05.510725  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.492410  8840 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:05.492816  8915 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:05.488791  9002 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.487438  9011 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.527876  8886 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:05.560344  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:05.560025  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.679s (SENT) [suppressed 4 similar messages]
I20260709 13:03:05.544164  8977 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.564500  1680 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:05.529853  8782 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.555326  8983 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:05.533134  8391 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.535379  8873 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.537374  8472 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:05.603951  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 189691us
I20260709 13:03:05.594206  8977 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.592322  8871 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:05.609817  8871 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.554268  8794 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.612591  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.613232  1600 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:05.613656  8782 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.614028  8794 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:05.615029  9016 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:05.615556  8391 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.615839  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.602977  8983 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.616457  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.572588  9002 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.627072  9002 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:05.620697  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.628590  8855 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.563917  8915 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.621686  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.618284  8983 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:05.624034  8977 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.624202  1606 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:05.618289  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:05.561664  8840 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.631019  8915 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.631999  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:05.633633  8977 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:05.632896  8840 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.556242  9008 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.634235  8977 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:05.634670  8927 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.636118  8983 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:03:05.636772  9013 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:03:05.563560  9023 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:03:05.581840  8886 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:05.647531  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 166634us
I20260709 13:03:05.660272  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.657135  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:05.664479  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.665612  1680 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:05.667485  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.668195  1679 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:05.672868  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.674903  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.675537  1679 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:05.642576  9004 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:05.750659  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 271926us
I20260709 13:03:05.670065  8840 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.793344  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.677560  8936 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.710394  8983 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.795539  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:05.833139  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 273116us
I20260709 13:03:05.833880  1683 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:03:05.749584  8855 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.893062  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:05.794507  9008 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:05.910514  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 202059us
I20260709 13:03:05.779230  8995 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 13:03:05.789522  8989 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:05.945063  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.945523  8870 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:05.948098  8993 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.948866  8993 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.953222  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "428f0180c2cd487c8b48e91f14dff65d"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:05.954026  1676 raft_consensus.cc:606] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Received request to transfer leadership to TS 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:05.954385  1676 raft_consensus.cc:614] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:05.913578  8855 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:05.956843  9029 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 13:03:05.960793  8886 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:05.961848  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:05.963639  1676 raft_consensus.cc:606] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.843986  8983 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:05.960079  8855 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:05.966364  8983 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:05.795080  8840 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.971146  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c802947c11486798c253f6688083e7"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:05.972612  1676 raft_consensus.cc:606] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:05.973259  1676 raft_consensus.cc:614] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:05.940693  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 139471us
I20260709 13:03:05.975180  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:05.899582  8996 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.901044  9031 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.907151  8849 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:05.990345  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 209431us
W20260709 13:03:05.994105  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 337028us
I20260709 13:03:05.836954  8977 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.989059  9001 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:05.948179  8931 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:06.008896  9027 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.367s	user 0.004s	sys 0.000s
I20260709 13:03:05.845458  8927 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:05.898536  8936 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.913106  8794 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:03:06.046986  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:06.051216  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:06.051988  1675 raft_consensus.cc:606] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.028106  8878 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:05.999810  1574 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.036628  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:06.033128  8873 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.037142  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:06.008625  8849 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:05.999645  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.060643  1606 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:03:06.024875  8693 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:06.026491  9004 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:06.052641  1675 raft_consensus.cc:614] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:06.009039  8985 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.003s
I20260709 13:03:06.028542  8986 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.040263  9001 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:06.055163  1602 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:06.063437  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:06.028702  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:05.911747  8819 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:06.001794  8996 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.062865  1600 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:06.003996  9031 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.060693  8847 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.050837  8989 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:06.054140  9030 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:03:06.054904  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55206.1us
I20260709 13:03:06.082701  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:06.045535  8927 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.083597  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:06.069382  9001 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:06.054972  8840 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.043254  8931 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:06.067785  9025 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:03:06.060997  9015 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:06.047816  8472 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.082206  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:06.081930  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53303.7us
I20260709 13:03:06.069504  9004 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.073829  9043 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:06.091383  1574 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:06.074522  8986 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.060106  8878 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.099715  1680 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:06.077569  8957 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.106684  8957 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.108364  9022 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:06.109297  8957 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.099499  8986 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.111415  8927 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.112145  8878 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.062240  8693 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.112824  8794 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.113407  8794 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.114396  8693 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.099615  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1700) took 1035 ms. Trace:
I20260709 13:03:06.115643  8794 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.112855  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.105775  8849 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.101531  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.115015  2252 rpcz_store.cc:276] 0709 13:03:05.063982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.064088 (+   106us) service_pool.cc:224] Handling call
0709 13:03:05.064389 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.064754 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:05.464738 (+399984us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.656321 (+191583us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.658826 (+  2505us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.663112 (+  4286us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.663309 (+   197us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:05.663342 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.664026 (+   684us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.953603 (+289577us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b18004b91c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:03:05.954454 (+   851us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b18004b91c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a44522 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:03:06.099336 (+144882us) raft_consensus.cc:1685] finished
0709 13:03:06.099364 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.099545 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17083,"prepare.queue_time_us":278265,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":13307,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":15437,"spinlock_wait_cycles":156339712,"thread_start_us":554580,"threads_started":2,"wal-append.queue_time_us":573953}
W20260709 13:03:06.099756  9040 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:06.097988  9004 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.121646  9037 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:06.122072  9033 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:06.100334  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:06.096542  9043 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.123641  9043 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:06.091503  8786 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.124197  8786 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:06.125057  1533 raft_consensus.cc:1275] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:06.104255  9056 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:06.125952  9056 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.126379  9056 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:06.127543  8798 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.106001  8855 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:06.073649  9008 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:03:06.095896  9005 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:06.128499  8996 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.122148  9037 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.129426  9037 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.130170  9001 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.128924  9005 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:06.113047  8873 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:06.132611  9005 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:06.133285  8873 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:06.134279  8873 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.134819  9001 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:06.136909  9045 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:06.128925  9008 consensus_queue.cc:1243] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:06.137064  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.139700  1530 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:06.140864  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.141813  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.141455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.142352  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.088442  8969 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:06.085467  8983 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.144536  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.151221  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.151520  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.152140  2252 raft_consensus.cc:2468] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 13.
I20260709 13:03:06.152338  2256 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:06.139959  1527 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:06.155058  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.155268  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.155716  2257 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:06.158304  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.158329  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.159209  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:06.075646  8819 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.167120  8819 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.123796  8906 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.085709  8847 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.178992  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.179112  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.180281  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.180740  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.181059  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.182367  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.183545  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.185052  1530 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:06.185743  8957 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:06.128136  8798 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.186303  8957 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.149910  8969 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.158624  8984 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.197058  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.196930  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.219108  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.220042  2255 raft_consensus.cc:2410] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:03:06.220357  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:06.220918  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.222028  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.222383  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.223014  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.199671  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.203670  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:06.224107  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.224805  1600 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:06.225296  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.225716  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.226429  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.204680  8693 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.209336  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.209811  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.183832  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.246578  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.250489  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.252029  1604 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.251382  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.251405  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.253060  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.255091  2253 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:06.181514  8906 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.257927  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:06.232865  8984 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.256740  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.227090  8693 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.260869  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.158459  8983 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.217797  8969 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:06.233027  8986 raft_consensus.cc:2764] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:06.271868  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.229954  8871 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.283181  2256 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:06.283996  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.273622  2255 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:06.243400  8886 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:06.282209  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.259315  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:06.264524  8906 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.357721  2252 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:03:06.359819  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 100586us
I20260709 13:03:06.362569  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.363941  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.369215  1609 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:06.271381  9058 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:06.364944  8977 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:06.315624  9022 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.312441  9068 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:06.404979  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.406188  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:06.392663  8994 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:06.388139  9058 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.380010  8798 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.365202  8886 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:06.431766  9060 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:03:06.429628  8986 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:06.466670  8971 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 1.786s	user 0.004s	sys 0.029s
I20260709 13:03:06.436478  9058 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:06.427147  2257 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
W20260709 13:03:06.427939  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65483.6us
I20260709 13:03:06.405836  9022 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.536566  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.477049  8957 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.472236  8986 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:06.544723  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.545548  2257 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:06.487533  8847 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.571336  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.492579  8693 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:06.568976  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 174313us
I20260709 13:03:06.576212  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.576920  2255 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:06.578174  2255 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:03:06.575183  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3363) took 3402 ms. Trace:
I20260709 13:03:06.580539  1603 rpcz_store.cc:276] 0709 13:03:03.172961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.195772 (+ 22811us) service_pool.cc:224] Handling call
0709 13:03:03.196117 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.242600 (+ 46483us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:03.242639 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.243224 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.616390 (+373166us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18004884a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:03:04.183491 (+567101us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:04.183541 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.183630 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.272723 (+2089093us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:06.574960 (+302237us) raft_consensus.cc:1685] finished
0709 13:03:06.574982 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.575124 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18226,"raft.queue_time_us":18381,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7036,"spinlock_wait_cycles":11573504,"thread_start_us":566857,"threads_started":1,"wal-append.queue_time_us":1362734}
W20260709 13:03:06.583346  9064 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:03:06.583773  9072 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:06.590592  9063 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:03:06.538725  9043 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.598208  9043 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.547019  8986 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:06.537508  9076 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.627847  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:06.628638  1674 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
W20260709 13:03:06.603106  9069 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:03:06.603572  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.634958  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:06.584007  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:06.609640  2255 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:03:06.619156  9061 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
W20260709 13:03:06.620478  9053 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.514s	user 0.002s	sys 0.000s
I20260709 13:03:06.620208  8693 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:06.620949  9005 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.624010  9037 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.640681  1678 raft_consensus.cc:1275] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:06.574626  8984 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.658950  9037 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.660037  8693 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:06.660465  9043 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.660882  8979 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.663174  9005 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:06.664521  8983 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:06.684154  9014 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.256s	user 0.000s	sys 0.005s
W20260709 13:03:06.667328  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 395499us
W20260709 13:03:06.668874  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128916us
I20260709 13:03:06.674158  8760 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.690466  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.688001  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:06.675114  8847 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:06.671499  8984 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:03:06.675026  9043 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.727789  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:06.728637  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3282) took 1052 ms. Trace:
I20260709 13:03:06.729028  1679 rpcz_store.cc:276] 0709 13:03:05.676483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.676950 (+   467us) service_pool.cc:224] Handling call
0709 13:03:05.677636 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.677852 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.677875 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.749218 (+ 71343us) log.cc:844] Serialized 26 byte log entry
0709 13:03:06.026159 (+276941us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:06.026195 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.026260 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.619763 (+593503us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:06.721214 (+101451us) raft_consensus.cc:1685] finished
0709 13:03:06.721236 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.728565 (+  7329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33045376,"thread_start_us":189261,"threads_started":1,"wal-append.queue_time_us":289982}
I20260709 13:03:06.729787  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:06.728672  9078 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:06.732805  9077 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:06.730806  8665 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:06.734019  8665 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:06.734913  8665 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.736084  8665 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:06.738732  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48817.9us
W20260709 13:03:06.750427  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 174339us
I20260709 13:03:06.762952  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:06.743839  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.766500  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.737434  8886 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.783226  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:06.747483  9008 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.747129  8797 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:06.770095  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 82154us
I20260709 13:03:06.749995  8989 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.749637  8760 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.762200  9077 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.791271  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.791811  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.786551  8693 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:06.810565  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.767805  8983 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:06.793661  8773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.414s	user 0.009s	sys 0.030s
I20260709 13:03:06.809758  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:06.797350  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:06.813382  1602 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:06.788172  9022 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.676170  8979 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.818145  1573 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:06.939554  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 121474us
I20260709 13:03:06.809932  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.789790  8857 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:06.917130  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 119922us
I20260709 13:03:06.765285  8847 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.795405  8797 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.938741  8977 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.796037  8886 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.963477  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:06.940883  1573 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:06.940529  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:06.823004  8773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.446s	user 0.009s	sys 0.031s
I20260709 13:03:06.964851  8857 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:06.795787  9077 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:06.995638  8847 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:06.998224  8797 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:06.811020  8693 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.057659  9082 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:07.056823  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 247108us
W20260709 13:03:07.063894  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 123077us
I20260709 13:03:07.064080  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3385) took 1723 ms. Trace:
I20260709 13:03:06.966477  9081 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:06.794103  8989 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.792995  9008 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:07.052534  9075 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:03:07.059798  8786 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.935s	user 0.008s	sys 0.002s
I20260709 13:03:06.988432  8868 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.088239  1605 rpcz_store.cc:276] 0709 13:03:05.340442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.340582 (+   140us) service_pool.cc:224] Handling call
0709 13:03:05.340935 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.466487 (+125552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.466521 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.466564 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:05.466600 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.063835 (+1597235us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400206f54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:07.063881 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.064022 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288163072}
I20260709 13:03:07.088769  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:07.077791  8693 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.066738  8857 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.095847  8931 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:07.075011  8906 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.691s	user 0.000s	sys 0.011s
I20260709 13:03:06.796243  8760 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:06.940026  9083 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:07.071600  8871 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:07.062892  8855 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:07.114243  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 293834us
I20260709 13:03:06.987525  9058 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.090538  9082 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.130708  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:07.133162  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.136663  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.119367  8886 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:03:07.141237  1605 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:07.141754  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.121569  9083 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.123513  8983 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:07.161270  9056 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 1.034s	user 0.010s	sys 0.002s
I20260709 13:03:07.147284  9089 consensus_queue.cc:1048] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:03:07.161795  9056 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.162912  1604 raft_consensus.cc:2368] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:07.113634  8786 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.166806  8786 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.129881  8773 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:07.146605  8797 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.168749  8797 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:07.169766  9085 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:07.171147  8797 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.150768  9023 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.171900  9023 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.174153  9023 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.175482  8693 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.176808  2261 raft_consensus.cc:1240] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:07.178643  8693 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.189368  8979 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:03:07.190917  8830 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260709 13:03:07.136204  9082 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.194909  8760 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.119588  8906 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.196386  1607 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:03:07.197557  8906 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.138942  9076 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:03:07.138162  8977 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:03:07.154095  9077 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.155629  8989 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:07.156144  8986 consensus_meta.cc:287] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.001s
I20260709 13:03:07.201344  9083 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:07.201236  8986 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.203552  8986 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.157676  9058 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.160849  8983 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:07.129739  8855 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:07.148700  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:07.206616  8983 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:07.208170  9092 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:07.137108  9031 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.148878  9081 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:07.215103  8969 consensus_meta.cc:287] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.902s	user 0.007s	sys 0.002s
I20260709 13:03:07.215643  8969 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.139245  8878 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:07.216485  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 243992us
I20260709 13:03:07.248842  8878 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:07.249758  8878 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.250694  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.251937  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:07.218309  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 69997.1us
I20260709 13:03:07.218883  2252 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:07.192444  9008 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.223810  8756 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:07.164044  9056 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.234221  9043 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.242836  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3377) took 2056 ms. Trace:
I20260709 13:03:07.245011  8773 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.151480  9090 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.253029  8936 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.286127  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.254602  1532 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:07.256016  8969 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.260537  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:07.263866  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:07.264149  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:07.272550  8756 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:07.269197  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.270232  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:07.248822  9065 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.756s	user 0.005s	sys 0.033s
W20260709 13:03:07.274751  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 126416us
I20260709 13:03:07.275049  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:07.296823  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.274813  1608 rpcz_store.cc:276] 0709 13:03:05.186360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.188372 (+  2012us) service_pool.cc:224] Handling call
0709 13:03:05.211905 (+ 23533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.327236 (+115331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.327271 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.327330 (+    59us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:05.327420 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.242508 (+1915088us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003840d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:07.242567 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.242753 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264796544}
I20260709 13:03:07.278529  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.297660  1674 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 25.
I20260709 13:03:07.253612  8977 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:07.307679  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.287176  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.288688  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.290253  2256 raft_consensus.cc:2393] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:07.268146  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.308815  2257 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:07.291790  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.309852  1678 raft_consensus.cc:2410] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:07.294018  1680 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:07.274616  9077 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.308445  1679 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 18: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:07.272696  8927 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:07.288436  8773 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.322712  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.318081  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.318938  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.319603  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.272846  8866 consensus_queue.cc:1059] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:03:07.278312  9051 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.330132  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.326462  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:07.289894  9056 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.334638  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.334638  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.338487  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.339299  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.322383  9076 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:07.343196  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.293094  9090 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.344280  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.352238  1677 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:03:07.353298  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.354449  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.341032  8830 tablet_bootstrap.cc:492] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:03:07.344969  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.347687  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.349478  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.350438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.351522  1675 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:07.343818  1683 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.358001  1649 leader_election.cc:400] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:07.363268  1649 leader_election.cc:403] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.357837  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.363831  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.359822  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.336911  9043 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:07.348479  9015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.004s	sys 0.042s
I20260709 13:03:07.366122  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.367724  1601 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:07.369529  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.329888  8927 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.382988  1574 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:07.345671  8986 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.373272  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.399992  1675 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:03:07.341939  8977 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:03:07.375202  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.401386  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:07.343027  8969 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.377720  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1641) took 1226 ms. Trace:
I20260709 13:03:07.339933  9056 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.384212  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.374176  9031 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.321274  9083 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.372123  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.384805  1678 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:07.370929  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.393426  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.394043  1683 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:07.394227  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.334672  8857 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.400461  1675 pending_rounds.cc:85] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 12
I20260709 13:03:07.335176  8868 consensus_queue.cc:1048] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:07.345983  9076 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:07.401991  2257 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:07.453706  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 137059us
I20260709 13:03:07.356946  9008 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.382802  9043 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.408804  8830 ts_tablet_manager.cc:1403] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 3.041s	user 0.072s	sys 0.046s
I20260709 13:03:07.399165  8931 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.398942  8906 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:03:07.401892  1682 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:07.385849  1605 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:03:07.412151  2258 rpcz_store.cc:276] 0709 13:03:06.151747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.153767 (+  2020us) service_pool.cc:224] Handling call
0709 13:03:06.154005 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.158850 (+  4845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.158891 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.159366 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:03:06.274931 (+115565us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:06.274987 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.275048 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.684624 (+409576us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b48000cc0d8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:03:07.244013 (+559389us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:07.377433 (+133420us) raft_consensus.cc:1685] finished
0709 13:03:07.377460 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.377640 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8340,"raft.queue_time_us":8387,"raft.run_cpu_time_us":1705,"raft.run_wall_time_us":516243,"spinlock_wait_cycles":14293632,"thread_start_us":90679,"threads_started":1,"wal-append.queue_time_us":252381}
W20260709 13:03:07.386416  9015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.005s	sys 0.044s
I20260709 13:03:07.334721  9051 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.387485  9012 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.460542  9076 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:07.454816  1604 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:07.456210  1677 raft_consensus.cc:2368] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17.
I20260709 13:03:07.411307  8871 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:03:07.450616  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55726.1us
I20260709 13:03:07.459604  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.461258  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3162) took 1339 ms. Trace:
I20260709 13:03:07.462424  9081 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:07.475219  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:07.498436  1525 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:07.420150  8979 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:03:07.473205  8391 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.480582  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.507406  1531 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:03:07.420248  1675 pending_rounds.cc:107] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:03:07.487691  2257 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:07.487632  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.508908  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3392) took 1257 ms. Trace:
I20260709 13:03:07.509594  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.510874  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.509331  1609 rpcz_store.cc:276] 0709 13:03:06.249862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.251160 (+  1298us) service_pool.cc:224] Handling call
0709 13:03:07.507529 (+1256369us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540029bdd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:07.507632 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266763776}
I20260709 13:03:07.423242  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:07.489511  8906 consensus_queue.cc:1243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer b88b12b461734b3aa6a3da4f5c22c79b log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:07.416482  8969 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.458937  8797 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:07.508294  1675 raft_consensus.cc:2889] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.421968  9098 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 13:03:07.493353  1528 rpcz_store.cc:276] 0709 13:03:06.121621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.138210 (+ 16589us) service_pool.cc:224] Handling call
0709 13:03:06.138518 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.155636 (+ 17118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.155669 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.156143 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.208451 (+1052308us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18000e5660. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:03:07.387697 (+179246us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:07.387740 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.387824 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.458669 (+ 70845us) raft_consensus.cc:1685] finished
0709 13:03:07.458694 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.461187 (+  2493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16744,"raft.queue_time_us":17519,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":12089,"spinlock_wait_cycles":6017408,"thread_start_us":179034,"threads_started":1,"wal-append.queue_time_us":1280795}
I20260709 13:03:07.470031  9008 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.512060  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:07.529059  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54070.4us
I20260709 13:03:07.537667  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.545992  8742 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:07.546496  8742 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:07.546851  8742 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:07.540395  1648 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.482012  8931 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:07.560381  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 142619us
W20260709 13:03:07.560999  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 137848us
I20260709 13:03:07.561771  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:07.564210  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:07.566414  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.566862  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.567569  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.568658  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.506806  8794 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:03:07.569999  1574 leader_election.cc:400] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17.
I20260709 13:03:07.570129  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.570361  1574 leader_election.cc:403] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.563099  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:07.564656  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.574584  1530 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 23: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:07.575551  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:07.575932  8969 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:07.578685  9110 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:03:07.580561  9090 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.581194  8849 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:07.581614  8849 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.581971  8849 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.550554  8871 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:07.590425  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.584853  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:07.522728  8391 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.598930  1530 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 16: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:07.601838  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.604406  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.605527  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:07.607342  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49242.3us
I20260709 13:03:07.589850  8855 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.608824  8986 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.609370  8986 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.524852  9082 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.578603  8797 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:07.586581  9012 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.587159  9015 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:07.618468  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.588918  8977 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.615871  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:07.621286  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33608 (request call id 3163) took 1482 ms. Trace:
I20260709 13:03:07.620636  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:07.624681  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:07.606775  9011 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.626685  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885"
dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
mode: GRACEFUL
new_leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:50480
I20260709 13:03:07.603507  9100 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:07.606442  9022 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:07.606388  9005 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:07.621929  1533 rpcz_store.cc:276] 0709 13:03:06.139134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.141332 (+  2198us) service_pool.cc:224] Handling call
0709 13:03:06.143463 (+  2131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.155290 (+ 11827us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:06.193492 (+ 38202us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.617058 (+423566us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4800080058. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e68a5aaa1 00007f7e68a51b37 00007f7e68a519ca 00007f7e68b4926f 00007f7e68b48f37 00007f7e68b5d55c 00007f7e68b5d508 00007f7e68b5d488 00007f7e68b5d443 00007f7e68b5c6ec 00007f7e67a86a96
0709 13:03:07.206178 (+589120us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b1800491fe0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:03:07.229672 (+ 23494us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800491fe0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a
0709 13:03:07.335837 (+106165us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.337641 (+  1804us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.337804 (+   163us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:07.515725 (+177921us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b1800491fe0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e675293c7 00007f7e63b3b9a7 00007f7e63b4b0bf 00007f7e63b4b038
0709 13:03:07.614398 (+ 98673us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.620974 (+  6576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.621051 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.621094 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:07.621106 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.621226 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":822999,"prepare.queue_time_us":45468,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":125942,"raft.run_cpu_time_us":1153,"raft.run_wall_time_us":463851,"spinlock_wait_cycles":100822656,"thread_start_us":168300,"threads_started":2,"wal-append.queue_time_us":70288}
I20260709 13:03:07.629027  2258 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:07.629216  1683 raft_consensus.cc:606] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Received request to transfer leadership to TS b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:07.686422  1683 raft_consensus.cc:614] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:07.614122  8886 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:07.625744  8927 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.692000  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.607213  8906 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:03:07.613981  8986 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.626086  8851 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.619309  8957 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.684962  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.622910  8970 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:07.625869  9056 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.614959  8797 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.619850  9015 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:07.588711  9076 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.697767  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.630501  9043 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.692663  9071 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.729650  1683 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:03:07.737082  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.737896  1683 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:07.632444  8857 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.697748  9090 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:07.732018  9008 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.695372  9058 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.631311  9100 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.695734  9068 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.729197  9015 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:07.632093  8830 raft_consensus.cc:359] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEARNER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:07.726781  8797 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.739078  8931 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.741955  9051 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.770725  9068 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.780515  9068 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.767745  9058 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.781378  9082 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.781411  9076 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.783321  9058 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.730166  8957 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.702350  8878 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.759785  9071 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.765378  9100 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.799306  9071 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:07.800052  9115 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:03:07.685264  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:07.834739  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 149367us
I20260709 13:03:07.851848  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:07.853505  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:07.857246  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.859786  1683 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:07.864899  8742 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.730938  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.869064  8794 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.870986  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.876888  8840 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:07.877748  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.878913  1683 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.886396  8742 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.883754  8851 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:07.889045  8851 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.890268  8871 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.891304  8871 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:07.891840  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:07.894336  8871 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.892099  8851 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:07.889708  8878 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:07.928416  1498 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d85e1fb5b4b419c96d985561042498a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.928723  9082 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.919948  8871 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.935807  8871 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.939193  8871 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.890580  8830 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:03:07.935679  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.951535  1683 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:07.954241  9068 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.955451  9068 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.958381  9068 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:07.961637  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:07.962721  2257 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:07.964700  9082 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.976461  9071 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:07.977466  9071 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.981086  9071 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:07.977260  8773 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.641s	user 0.003s	sys 0.026s
I20260709 13:03:07.982460  8773 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:07.986690  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.932215  8957 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:07.994421  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:07.944998  8797 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:07.986194  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1605) took 1796 ms (client timeout 1998 ms). Trace:
W20260709 13:03:07.998308  1532 rpcz_store.cc:269] 0709 13:03:06.179675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.180010 (+   335us) service_pool.cc:224] Handling call
0709 13:03:07.975584 (+1795574us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003a6bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:07.975968 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465968000}
I20260709 13:03:08.000824  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1699) took 2937 ms. Trace:
I20260709 13:03:07.997362  8871 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.002822  8871 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.004518  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1722) took 1190 ms. Trace:
I20260709 13:03:08.005425  2261 rpcz_store.cc:276] 0709 13:03:06.813627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.813883 (+   256us) service_pool.cc:224] Handling call
0709 13:03:06.814089 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.177191 (+363102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.003839 (+826648us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400408654. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.004283 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833752448}
I20260709 13:03:08.008561  1601 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:08.012288  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:08.015596  1676 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:08.019344  1606 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:08.021528  8983 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.022145  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.022341  8983 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.023471  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:08.015671  8705 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:08.027010  2252 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:08.001422  2259 rpcz_store.cc:276] 0709 13:03:05.062991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.063121 (+   130us) service_pool.cc:224] Handling call
0709 13:03:05.063366 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.132895 (+ 69529us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:05.530631 (+397736us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.791219 (+260588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.791305 (+    86us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:05.791434 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.999476 (+2208042us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180039eec0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a122a6 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419
0709 13:03:08.000208 (+   732us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b5400a18e54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.000263 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.000585 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57443,"prepare.queue_time_us":200602,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":396,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":43667,"spinlock_wait_cycles":182399232,"thread_start_us":650145,"threads_started":2,"wal-append.queue_time_us":478927,"wal-append.run_cpu_time_us":1985,"wal-append.run_wall_time_us":1109116}
I20260709 13:03:08.052453  8993 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:08.058466  9128 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:07.984555  8830 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:08.067413  9102 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.067914  9102 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:08.070098  8472 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:08.344282  1534 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.138068  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.393103  8977 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.009s
I20260709 13:03:08.064585  8983 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.433342  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1612) took 1118 ms. Trace:
I20260709 13:03:08.433830  1525 rpcz_store.cc:276] 0709 13:03:07.315275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.319368 (+  4093us) service_pool.cc:224] Handling call
0709 13:03:08.422712 (+1103344us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002ce054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:08.433174 (+ 10462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398060288}
I20260709 13:03:08.109858  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:08.252581  1683 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:08.075830  8871 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.068140  8830 ts_tablet_manager.cc:1434] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.593s	user 0.005s	sys 0.005s
I20260709 13:03:08.303947  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:08.324512  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.441187  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:08.073362  9105 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.675s	user 0.000s	sys 0.003s
I20260709 13:03:08.359258  8797 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:08.344702  9106 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.927s	user 0.001s	sys 0.006s
W20260709 13:03:08.393383  9100 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.007s
W20260709 13:03:08.097123  9031 consensus_meta.cc:287] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.007s
W20260709 13:03:08.396706  8849 consensus_meta.cc:287] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.014s
I20260709 13:03:08.076607  8740 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:08.423028  8773 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.070395  9083 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.446738  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:08.100785  9082 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.423921  8977 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 16. Current term is 17.
I20260709 13:03:08.248101  9129 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:08.462103  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 352566us
W20260709 13:03:08.443804  8830 ts_tablet_manager.cc:1467] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Tablet startup took 971ms
I20260709 13:03:08.460546  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.462767  2258 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:08.459718  8740 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.473913  1676 raft_consensus.cc:1240] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:08.473644  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.481812  8915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.339s	user 0.008s	sys 0.020s
W20260709 13:03:08.482358  8915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.364s	user 0.008s	sys 0.020s
I20260709 13:03:08.459224  9100 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.479202  8740 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:08.472527  9031 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:08.493012  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.464963  8849 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.497037  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:08.508440  1525 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.523862  8868 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.503574  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.525357  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.502903  9112 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:08.522428  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.522177  9038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.012s	sys 0.027s
I20260709 13:03:08.525566  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:08.495316  9129 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:08.544986  9074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.008s	sys 0.019s
I20260709 13:03:08.512051  8977 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:08.544111  9038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.012s	sys 0.029s
W20260709 13:03:08.557034  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58128.7us
I20260709 13:03:08.532467  9112 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.560289  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.560864  1678 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:03:08.569062  9015 consensus_meta.cc:287] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.007s
I20260709 13:03:08.569728  2259 raft_consensus.cc:1240] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:08.556411  9074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.009s	sys 0.019s
I20260709 13:03:08.569624  9015 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:08.473881  8830 ts_tablet_manager.cc:1469] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Trace:
0709 13:03:00.459217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.466221 (+  7004us) service_pool.cc:224] Handling call
0709 13:03:01.209160 (+742939us) ts_tablet_manager.cc:934] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
0709 13:03:01.901673 (+692513us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:02.372372 (+470699us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.019731 (+647359us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.047910 (+ 28179us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 13:03:03.153744 (+105834us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:03.212563 (+ 58819us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:03.213035 (+   472us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:03.213113 (+    78us) inbound_call.cc:177] Queueing success response
0709 13:03:04.367370 (+1154257us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:07.478103 (+3110733us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:07.581293 (+103190us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:07.581877 (+   584us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":8531,"raft.queue_time_us":10408,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":152,"tablet-copy.queue_time_us":226677,"tablet-download-pool.queue_time_us":365,"tablet-download-pool.run_cpu_time_us":1347,"tablet-download-pool.run_wall_time_us":500263,"thread_start_us":188111,"threads_started":2}
I20260709 13:03:08.524834  8868 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.570657  8797 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:08.566004  9112 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.605232  1604 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:08.606945  9143 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:03:08.608350  1675 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:08.580498  1531 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:08.603783  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.583410  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:08.563760  9082 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:08.614881  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 190256us
I20260709 13:03:08.617291  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.624737  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:08.609634  8797 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.625521  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1607) took 1257 ms. Trace:
I20260709 13:03:08.629549  1609 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.558821  9102 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:08.625515  9107 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.208s	user 0.005s	sys 0.009s
I20260709 13:03:08.636976  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.631074  8797 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.613200  8977 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.638890  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:08.649649  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.641851  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.629215  1527 rpcz_store.cc:276] 0709 13:03:07.313930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.316852 (+  2922us) service_pool.cc:224] Handling call
0709 13:03:07.317190 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.317403 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.317438 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.325344 (+  7906us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.396458 (+ 71114us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:07.396510 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.396588 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.322799 (+926211us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:08.544793 (+221994us) raft_consensus.cc:1685] finished
0709 13:03:08.544816 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.571159 (+ 26343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17172736,"thread_start_us":49957,"threads_started":1,"wal-append.queue_time_us":57786}
I20260709 13:03:08.659530  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1365) took 1306 ms. Trace:
I20260709 13:03:08.664774  9049 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:08.666386  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47603.8us
I20260709 13:03:08.664494  1679 rpcz_store.cc:276] 0709 13:03:07.321698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.321816 (+   118us) service_pool.cc:224] Handling call
0709 13:03:07.322125 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.333315 (+ 11190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.333348 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.336114 (+  2766us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.397744 (+ 61630us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:07.398110 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.418818 (+ 20708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.418906 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.072420 (+653514us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:08.584562 (+512142us) raft_consensus.cc:1685] finished
0709 13:03:08.614799 (+ 30237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.627633 (+ 12834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111043,"prepare.queue_time_us":218,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":33466,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":12577,"spinlock_wait_cycles":43702656,"thread_start_us":61262,"threads_started":1,"wal-append.queue_time_us":61628}
I20260709 13:03:08.667351  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:08.668097  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:08.668366  9049 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:08.668849  9049 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:08.669231  9049 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.669832  8849 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.670740  8798 consensus_queue.cc:1059] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:08.672616  8472 raft_consensus.cc:3055] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:08.673018  8472 raft_consensus.cc:740] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:08.673976  8472 consensus_queue.cc:260] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.675232  8472 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.640394  9100 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:03:08.642140  9076 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:08.684988  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:08.685207  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.688902  9147 log.cc:927] Time spent T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:08.638851  9082 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.678272  9074 raft_consensus.cc:3055] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:08.700824  1681 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:08.692662  8849 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:08.706377  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:08.708945  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.694470  9074 raft_consensus.cc:740] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:08.719841  9142 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:08.720278  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.724541   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:08.725692  8868 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.692350  8915 consensus_queue.cc:1059] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:03:08.730396  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.697009  9076 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.721791  9015 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.728035  8819 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:08.747429  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.747640  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 134016us
I20260709 13:03:08.742405  9129 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.747104  9049 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.762822  1609 raft_consensus.cc:2468] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:08.763736  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.767449  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1363) took 1444 ms. Trace:
I20260709 13:03:08.767877  1674 rpcz_store.cc:276] 0709 13:03:07.308977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.309132 (+   155us) service_pool.cc:224] Handling call
0709 13:03:07.311288 (+  2156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.311633 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.311659 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.332933 (+ 21274us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.395090 (+ 62157us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:07.398504 (+  3414us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.417246 (+ 18742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.417320 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.532829 (+1115509us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:08.728398 (+195569us) raft_consensus.cc:1685] finished
0709 13:03:08.736750 (+  8352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.753682 (+ 16932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20505,"prepare.queue_time_us":1244,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":54335,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11330,"spinlock_wait_cycles":22252928,"thread_start_us":41319,"threads_started":2,"wal-append.queue_time_us":53227}
W20260709 13:03:08.771340  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.772908  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.772655  9074 consensus_queue.cc:260] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.774168  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.774477  8977 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.774953  1606 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:03:08.775141  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.776486  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.776983  9103 log.cc:927] Time spent T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.296s	user 0.000s	sys 0.003s
I20260709 13:03:08.777289  1528 raft_consensus.cc:2368] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:08.778136  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.778445  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44456 (request call id 3396) took 2513 ms (client timeout 2189 ms). Trace:
W20260709 13:03:08.778842  1607 rpcz_store.cc:269] 0709 13:03:06.265025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.265167 (+   142us) service_pool.cc:224] Handling call
0709 13:03:08.778091 (+2512924us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400454cd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:08.778267 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096431872}
I20260709 13:03:08.774290  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.755008  9102 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.768349  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1615) took 1430 ms. Trace:
I20260709 13:03:08.785378  2258 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25.
I20260709 13:03:08.786973  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:08.773612  9108 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.271s	user 0.002s	sys 0.007s
I20260709 13:03:08.763229  9049 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.774127  9074 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:08.792069  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:08.791826  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.791775  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:08.801226  9082 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.790522  8819 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.806352  9024 raft_consensus.cc:993] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: : Instructing follower b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:03:08.807974  9039 raft_consensus.cc:1081] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Signalling peer b8ff9782cd95483c905cd1d906f41aaf to start an election
I20260709 13:03:08.784462  1529 rpcz_store.cc:276] 0709 13:03:07.337542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.338899 (+  1357us) service_pool.cc:224] Handling call
0709 13:03:07.347223 (+  8324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:07.376670 (+ 29447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.376704 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:07.387187 (+ 10483us) log.cc:844] Serialized 52 byte log entry
0709 13:03:08.106119 (+718932us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18004cbb80. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:03:08.439944 (+333825us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:08.440002 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.446602 (+  6600us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.767878 (+321276us) raft_consensus.cc:1685] finished
0709 13:03:08.767897 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.768087 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78514,"raft.queue_time_us":29625,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":17226,"spinlock_wait_cycles":7679872,"thread_start_us":185399,"threads_started":1,"wal-append.queue_time_us":1075515}
W20260709 13:03:08.808940  9144 log.cc:927] Time spent T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:08.809404  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.809913  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:08.811069  9145 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:08.810943  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.812391  8819 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.813918  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.814896  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3302) took 1462 ms. Trace:
I20260709 13:03:08.815498  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:08.816427  9082 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:08.816835  9082 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.817229  9082 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:08.819228  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:08.812631  9146 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
W20260709 13:03:08.810329  9151 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:08.820495  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.798199  8977 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.820894  8819 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:08.824872  9090 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:08.825340  9090 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:08.819623  1525 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:03:08.828245  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.828914  1529 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:08.832284  1609 raft_consensus.cc:1240] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:08.828416  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.830892  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.830060  1603 raft_consensus.cc:1240] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:08.860460  8915 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:08.830994  8855 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.867502  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.849609  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:08.838416  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.872407  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.869268  8798 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.862365  8915 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:08.873273  8915 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:08.873624  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.874059  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.874238  1531 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:08.839872  1532 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:08.849787  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3785) took 1158 ms. Trace:
I20260709 13:03:08.875366  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.796598  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.875049  8819 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:08.876498  8819 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.876957  8819 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:08.868779  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.863303  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.871122  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:08.876634  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.876772  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.880517  1674 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:08.856803  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.883818  1609 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:08.884143  1531 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:08.832381  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3424) took 1440 ms. Trace:
I20260709 13:03:08.815344  1681 rpcz_store.cc:276] 0709 13:03:07.352508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.371812 (+ 19304us) service_pool.cc:224] Handling call
0709 13:03:08.814662 (+1442850us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540007e4d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:08.814818 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547053824}
I20260709 13:03:08.874248  8915 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.854012  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33564 (request call id 1367) took 1515 ms. Trace:
I20260709 13:03:08.865401  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3346) took 1004 ms. Trace:
I20260709 13:03:08.878685  1601 rpcz_store.cc:276] 0709 13:03:07.691458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.691585 (+   127us) service_pool.cc:224] Handling call
0709 13:03:07.691970 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.009205 (+317235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.849530 (+840325us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400207954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.849717 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704631552}
I20260709 13:03:08.884737  1526 rpcz_store.cc:276] 0709 13:03:07.392104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.392249 (+   145us) service_pool.cc:224] Handling call
0709 13:03:08.435020 (+1042771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.435514 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.435563 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:08.435626 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:08.435654 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.435738 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.832055 (+396317us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002ce050. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:08.832202 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396998528}
I20260709 13:03:08.886994  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:08.886350  1527 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:08.896415  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:08.887270  1675 rpcz_store.cc:276] 0709 13:03:07.860689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.976721 (+116032us) service_pool.cc:224] Handling call
0709 13:03:07.977146 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.609919 (+632773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.865061 (+255142us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400177d54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.865295 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241682176}
I20260709 13:03:08.901896  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.877697  1426 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.904662  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.886926  1680 rpcz_store.cc:276] 0709 13:03:07.338632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.338759 (+   127us) service_pool.cc:224] Handling call
0709 13:03:07.339116 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.418738 (+ 79622us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:07.419008 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.550864 (+131856us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b18002443c0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:03:07.625970 (+ 75106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.626032 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:07.626081 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.853594 (+1227513us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b54003291d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.853666 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.853835 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4471,"prepare.queue_time_us":1183,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":99270,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4180,"spinlock_wait_cycles":202581120,"thread_start_us":113237,"threads_started":2,"wal-append.queue_time_us":38785,"wal-append.run_cpu_time_us":1562,"wal-append.run_wall_time_us":1038637}
I20260709 13:03:08.899350  9083 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.908046  8707 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:08.908562  8472 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:08.897944  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:08.851444  8391 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.862082  8756 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.920518  1534 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 14.
I20260709 13:03:08.935040  8756 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:08.921101  9076 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.927242  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.945798  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:08.946161  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 50441.5us
I20260709 13:03:08.947402  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.899582   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:08.948463  9043 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:08.925417  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 97121.9us
I20260709 13:03:08.949321  9043 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:08.949847  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:08.871639  9112 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.950718  9008 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.951160  9008 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:08.951540  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:08.926717  9157 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:08.943938  1608 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:03:08.906174  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:08.924710  8915 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:08.916278  8740 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:08.954948  9072 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:08.952906  9112 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:08.955912  1533 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 24: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:08.954624  9157 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.958618  8740 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.927103  1573 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:08.927525  1677 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:08.960160  9076 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:08.961023  9076 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:08.961400  9005 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:08.962225  9076 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.964751  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.965065  9015 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:08.933872  8472 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:08.965523  9015 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:08.965997  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59926.4us
I20260709 13:03:08.966380  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.847498  8977 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.967010  1603 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:08.967633  9102 raft_consensus.cc:2764] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:08.952625  1608 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 14
I20260709 13:03:08.928339  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1872) took 2729 ms. Trace:
I20260709 13:03:08.968408  1605 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:08.932541  8707 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:08.945014  8840 raft_consensus.cc:3055] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:08.966589  9015 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:08.964075  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:08.934275  1531 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:08.959022  9157 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:08.944990  1527 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:08.965545  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.968371  1608 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 21.15
W20260709 13:03:08.970893  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 240969us
I20260709 13:03:08.955807  9072 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:08.999282  1601 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:08.996804  1608 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:08.859107  8797 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.001883  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:08.970753  8977 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:08.968766  2253 rpcz_store.cc:276] 0709 13:03:06.198750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.268609 (+ 69859us) service_pool.cc:224] Handling call
0709 13:03:06.269403 (+   794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.442463 (+173060us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:06.473459 (+ 30996us) log.cc:844] Serialized 14 byte log entry
0709 13:03:08.107745 (+1634286us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b1800237700. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a
0709 13:03:08.108155 (+   410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:08.108253 (+    98us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:08.108405 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.927994 (+819589us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001ecb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:08.928036 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.928169 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30877,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":157,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":167,"spinlock_wait_cycles":413269504,"thread_start_us":66450,"threads_started":1,"wal-append.queue_time_us":187122,"wal-append.run_cpu_time_us":1157,"wal-append.run_wall_time_us":1028039}
I20260709 13:03:08.950361  9043 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:08.931813  9074 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:09.005357  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 134338us
I20260709 13:03:08.951997  9008 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.008711  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.032231  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.005127  1529 raft_consensus.cc:2368] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 23. Current term is 24.
I20260709 13:03:09.019124  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:08.972514  8707 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:09.033685  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.034243  1426 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 18, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:09.035727  1619 tablet_copy_service.cc:342] P 428f0180c2cd487c8b48e91f14dff65d: Request end of tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1 received from {username='slave'} at 127.0.0.1:49526
I20260709 13:03:09.036489  1619 tablet_copy_service.cc:434] P 428f0180c2cd487c8b48e91f14dff65d: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-5293a667c8bb4fdbb1fa97aaeba1cfc1 on tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 with peer 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:08.972656  8840 raft_consensus.cc:740] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.038443  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.038610  8840 consensus_queue.cc:260] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.039391  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
W20260709 13:03:09.025472  1424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 228) took 18855 ms (client timeout 15000 ms). Trace:
W20260709 13:03:09.026870  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.029186  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3776) took 1682 ms. Trace:
I20260709 13:03:09.035753  1426 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 18, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 18 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.045118  9008 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.932354  9083 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.049058  8840 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.050963  9083 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:09.041129  1424 rpcz_store.cc:269] 0709 13:02:50.169566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.216724 (+ 47158us) service_pool.cc:224] Handling call
0709 13:03:09.025168 (+18808444us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:59.603657 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:59.604280 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:59.604351 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:02:59.604371 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:59.605587 (+  1216us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:59.605695 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:59.605730 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:59.606895 (+  1165us) tablet.cc:701] Row locks acquired
0709 13:02:59.606946 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:02:59.607110 (+   164us) write_op.cc:270] Start()
0709 13:02:59.607251 (+   141us) write_op.cc:276] Timestamp: P: 1783602179607040 usec, L: 0
0709 13:02:59.607273 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:59.608041 (+   768us) log.cc:844] Serialized 4430 byte log entry
0709 13:02:59.825931 (+217890us) op_driver.cc:464] REPLICATION: finished
0709 13:03:00.129179 (+303248us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e60a270ac 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e67567ef0
0709 13:03:00.314544 (+185365us) write_op.cc:301] APPLY: starting
0709 13:03:00.321064 (+  6520us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:01.021754 (+700690us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:01.024769 (+  3015us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:01.887066 (+862297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:01.887354 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:03:01.887403 (+    49us) write_op.cc:312] APPLY: finished
0709 13:03:01.887711 (+   308us) log.cc:844] Serialized 105 byte log entry
0709 13:03:01.917295 (+ 29584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:01.917458 (+   163us) write_op.cc:454] Released schema lock
0709 13:03:01.917518 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:01.926015 (+  8497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:01.926050 (+    35us) write_op.cc:454] Released schema lock
0709 13:03:03.197714 (+1271664us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
Metrics: {"mutex_wait_us":5696891,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":434886,"apply.run_cpu_time_us":34716,"apply.run_wall_time_us":1621820,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50217,"num_ops":11,"prepare.queue_time_us":117530,"prepare.run_cpu_time_us":15865,"prepare.run_wall_time_us":34590,"raft.queue_time_us":100662,"raft.run_cpu_time_us":19091,"raft.run_wall_time_us":466595,"replication_time_us":188779,"spinlock_wait_cycles":85333248,"thread_start_us":539558,"threads_started":5,"wal-append.queue_time_us":98144,"wal-append.run_cpu_time_us":22902,"wal-append.run_wall_time_us":3308171}]]}
W20260709 13:03:09.030141  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 82863.6us
I20260709 13:03:09.031206  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.033133  1601 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 14: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:09.029682  1609 raft_consensus.cc:1240] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:09.015129  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.052451  1426 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 16, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 16 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:09.057827  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 49010.9us
I20260709 13:03:09.054203  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.044936  1608 rpcz_store.cc:276] 0709 13:03:07.346673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.348116 (+  1443us) service_pool.cc:224] Handling call
0709 13:03:07.364648 (+ 16532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.004769 (+1640121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.028874 (+ 24105us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54004376d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:09.029124 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3630633728}
I20260709 13:03:08.964746  8906 consensus_queue.cc:1059] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:03:08.966524  8472 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.079097  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:09.077157  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 62242.9us
W20260709 13:03:09.089125  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.097576  1607 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:09.092489  8977 raft_consensus.cc:3055] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:09.100143  8977 raft_consensus.cc:740] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.076156  9157 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.053629  8819 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.033392  9090 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.114701  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.118181  1607 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.104568  9031 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.109090  8773 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.094406  9074 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.124950  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:09.108562  8906 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:09.130288  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119974us
I20260709 13:03:09.125289  1426 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.132989  8740 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:09.133450  8740 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.133841  8740 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.106077  8798 consensus_queue.cc:1059] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:09.136550  9161 ts_tablet_manager.cc:933] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
W20260709 13:03:09.138505  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 83800.3us
I20260709 13:03:09.139699  1605 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:09.105506  9082 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.121374  9157 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:09.132874  8870 consensus_queue.cc:1059] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:03:09.145334  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.149776  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.151525  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:09.137401  9072 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.148118  9049 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:03:09.131568  8773 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.127068  9102 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:03:09.173569  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.193513  1603 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:09.153255  9162 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:09.147053  8797 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:09.193004  9157 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.173467  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:09.199743  2255 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:03:09.199908  1531 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:03:09.150067  8707 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.200798  9015 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.201247  9157 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:09.202414  8707 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:09.192783  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.193856  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 63291.8us
I20260709 13:03:09.205857  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.180927  9090 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.164253  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.207002  9162 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:09.208485  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53188.7us
I20260709 13:03:09.208599  8705 raft_consensus.cc:3055] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:09.209019  8705 raft_consensus.cc:740] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.209275  1499 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.209493  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.210901  8782 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.211215  8706 raft_consensus.cc:3055] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:09.211594  8706 raft_consensus.cc:740] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.212527  8706 consensus_queue.cc:260] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.172640  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d"
dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
 from {username='slave'} at 127.0.0.1:33602
I20260709 13:03:09.213234  9090 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.198400  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:09.208097  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43974.5us
I20260709 13:03:09.213747  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.214866  8886 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.214967  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.215987  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.217859  8391 raft_consensus.cc:3055] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:09.159840  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.181677  8819 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.223598  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:09.222642  1529 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.180706  9082 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.237419  2253 raft_consensus.cc:2393] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:09.157132  9031 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.240105  1649 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:09.240231  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.253291  1681 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:09.241454  2255 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:09.241477  1529 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:09.223567  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.221343  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:09.238920  2256 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:09.245249  1677 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:09.242769  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:09.252274  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.256974  1678 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.257596  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.258267  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.222162  9072 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:09.237486  8706 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.153220  8906 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.259793  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:09.209579  9162 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:09.265960  2261 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.259065  8855 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.238613  8391 raft_consensus.cc:740] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.209648  8798 consensus_queue.cc:1059] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:03:09.264671  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 52797.2us
I20260709 13:03:09.245419  9076 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.270007  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:09.270772  1426 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 17 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:09.220183  8977 consensus_queue.cc:260] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:09.274876  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 131414us
I20260709 13:03:09.261767  8756 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:09.275866  1574 leader_election.cc:400] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 23. Current term is 24.
I20260709 13:03:09.280867  1574 leader_election.cc:403] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.266855  9090 raft_consensus.cc:2804] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:09.282166  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:09.283901  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72634.8us
I20260709 13:03:09.285884  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:09.292409  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 118225us
I20260709 13:03:09.302322  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.303082  2256 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:09.300766  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:09.306798  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 61242.9us
I20260709 13:03:09.307555  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.307829  8840 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index -1 to 14, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:09.312681  8391 consensus_queue.cc:260] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.314132  8391 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:09.318125  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.267590  9083 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:03:09.283872  8756 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.305413  1426 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 15 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.322391  2258 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:09.324823  8756 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.327538  1601 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:09.306294  9161 tablet_copy_client.cc:323] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:36133
I20260709 13:03:09.328891  1608 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index -1 to 14, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:09.331729  9158 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:09.333710  8756 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.335127  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.336077  8756 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.336762  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.337393  2260 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:09.338421  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.339396  2260 raft_consensus.cc:2368] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:09.340106  9074 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.304539  9043 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:03:09.341979  8906 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.282588  9031 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:03:09.346556  8977 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.347560  2261 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:09.277805  8740 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.350602  8740 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:09.352010  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51860.6us
I20260709 13:03:09.353966  8760 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:09.354519  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47075.4us
I20260709 13:03:09.354820  9113 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.355306  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.352118  9090 raft_consensus.cc:697] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:09.356667  9159 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.356520  9090 consensus_queue.cc:237] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.336199  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.362522  2254 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 13.
I20260709 13:03:09.362854  9031 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:09.363251  9031 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:09.365275  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.368148  8797 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:09.368731  8773 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.332183  9158 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.369695  9158 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.372000  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:09.372635  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71991.8us
I20260709 13:03:09.372859  9005 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.372154  9083 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:09.373371  9005 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.373808  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.375247  8760 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:09.375608  8760 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:09.375960  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47137.8us
I20260709 13:03:09.376478  8868 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:09.364142  9031 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.381304  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:09.381460  9031 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.383288  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.383956  8782 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:09.391700  1603 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:09.353816  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:09.392791  1678 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:09.400691  2255 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:09.393421  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:09.401022  1675 raft_consensus.cc:1240] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:09.404382  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.405843  1531 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:09.407107  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.408135  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.409111  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.373795  9005 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.414000  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:09.410794  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.411156  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.415337  1681 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:03:09.411381  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.403585  1529 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.414212  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.386039  8782 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:09.423326  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.425673  1600 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:09.431145  1529 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.386276  9083 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.418589  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.417659  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.419533  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.416733  8855 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:09.422626  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.423172  9074 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:09.416203  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.433889  2255 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:09.438568  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:09.401916  8886 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 23. Current term is 24.
I20260709 13:03:09.405337  9008 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:09.439952  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53400.9us
I20260709 13:03:09.418934  9043 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.376478  8760 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.447570  1607 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:09.457159  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.449615  2252 raft_consensus.cc:1217] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEARNER]: Deduplicated request from leader. Original: 19.13->[22.14-22.14]   Dedup: 22.14->[]
W20260709 13:03:09.440984  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.447058  9072 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.433245  1426 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 20 to 22, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.452232  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.410280  9129 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:03:09.460400  1678 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:09.445775  9074 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.443642  8707 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:03:09.467396  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.468871  1681 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:09.469354  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 148838us
I20260709 13:03:09.446983  8868 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:09.471405  1678 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:09.457388  8756 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.482389  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.482923  1682 raft_consensus.cc:2410] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:09.480715  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.483682  1683 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:09.484558  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:09.481696  2255 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:03:09.487362  9168 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:09.464284  9008 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:09.477681  8868 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:09.478125  1426 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:09.495919  8760 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:09.446338  8782 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:09.510053  9008 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.488333  8707 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.510576  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.503909  1607 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:09.533933  2226 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:09.530309  2225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.510099  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.555313  8782 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.558064  9074 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:09.560527  8707 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:09.564502  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 107089us
I20260709 13:03:09.566136  1648 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.567698  1683 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:09.498428  8868 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:09.481132  9043 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:09.603241  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 116522us
I20260709 13:03:09.610116  2259 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:09.616956  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 202798us
I20260709 13:03:09.618192  1677 raft_consensus.cc:2410] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:09.618511  1574 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.572979  9162 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:09.616772  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 205405us
I20260709 13:03:09.574892  9074 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:09.608641  8760 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:09.624809  1573 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.626412  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.635430  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.636345  1683 raft_consensus.cc:3055] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:09.638307  1683 raft_consensus.cc:740] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:09.638968  2257 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:09.634111  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:09.640686  1426 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 18 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.643640  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:09.645186  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 165409us
I20260709 13:03:09.646095  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:09.646570  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.635047  8906 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:09.650538  8849 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:09.650363  8705 consensus_queue.cc:260] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.651384  1525 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:09.651659  8773 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:09.635774  9074 raft_consensus.cc:697] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:09.658211  1426 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 17, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.655879  2254 raft_consensus.cc:2393] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:09.627439  9162 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.654043  9076 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:09.686195  9177 log.cc:927] Time spent T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:03:09.686311  9171 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:09.709388  9171 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.708616  1426 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 20, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.710374  9171 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.710613  8886 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:03:09.711515  9171 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.711169  1426 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:09.714289  9185 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:03:09.647828  8706 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:03:09.688913  8906 raft_consensus.cc:697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.692255  9158 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.692643  9043 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.694207  9083 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.695327  9157 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:09.697305  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:09.699226  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48999.8us
I20260709 13:03:09.675594  1683 consensus_queue.cc:260] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.701862  1500 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:09.683738  9005 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.735733  8391 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:09.736377  8391 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.736879  9005 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.707703  9074 consensus_queue.cc:237] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:09.685369  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 66706.4us
I20260709 13:03:09.729637  9015 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:09.749162  1674 raft_consensus.cc:2393] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:09.749344  8472 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.751699  8472 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.747285  9015 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.754637  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:09.754390  9015 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.749419  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.755617  9015 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.729091  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.732131  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.756790  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:32970 (request call id 1) took 3805 ms. Trace:
I20260709 13:03:09.698885  8773 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:09.739813  1648 leader_election.cc:400] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:09.759946  1648 leader_election.cc:403] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:09.760021  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.737221  8391 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.741991  8706 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:09.742261  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 70980.2us
I20260709 13:03:09.754812  8472 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.755209  1525 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:09.709375  9178 log.cc:927] Time spent T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:03:09.730873  1682 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:09.748970  1679 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:09.758121  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:09.698014  8819 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:09.728099  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:09.761703  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.765583  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.734637  8886 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:03:09.760836  8773 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:09.781458  1681 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:09.793916  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.782035  9157 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:09.777143  8472 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.779381  9043 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.791111  9082 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:09.801440  9082 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:09.801903  9082 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:09.773006  9031 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
W20260709 13:03:09.818583  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53063.9us
W20260709 13:03:09.792095  9190 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:03:09.757577  8840 rpcz_store.cc:276] 0709 13:03:05.951442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.951731 (+   289us) service_pool.cc:224] Handling call
0709 13:03:06.135410 (+183679us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b540044c3a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63aae520 00007f7e63b37b42 00007f7e63b36800 00007f7e68af7d29 00007f7e620761d4 00007f7e62076162 00007f7e62076091 00007f7e6207600c 00007f7e620752c2 00007f7e61e6c48c
0709 13:03:06.193881 (+ 58471us) log.cc:844] Serialized 506 byte log entry
0709 13:03:06.616228 (+422347us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540044c3a0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63ab1b26 00007f7e63aab49a 00007f7e63aaa714 00007f7e63a8aeaa 00007f7e63a91d53 00007f7e63a91cd9 00007f7e63a91c69 00007f7e63a91c31 00007f7e63a90dfd 000000000038f354
0709 13:03:07.253678 (+637450us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b1800263fe0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e609bec0a 00007f7e6a0fe219 00007f7e60a46a40 00007f7e60a414e4 00007f7e60a41455 00007f7e63a8ab0b 00007f7e63b0fb63 00007f7e63b37752 00007f7e68af7d29
0709 13:03:09.756564 (+2502886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1542191,"raft.queue_time_us":1016155,"raft.run_cpu_time_us":4107,"raft.run_wall_time_us":534388,"spinlock_wait_cycles":233993984,"thread_start_us":46765,"threads_started":1,"wal-append.queue_time_us":47151,"wal-append.run_cpu_time_us":2015,"wal-append.run_wall_time_us":1003253}
I20260709 13:03:09.822320  8472 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.793817  8782 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:03:09.867853  8472 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:09.868369  8472 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:09.868700  8868 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.869233  8472 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.870528  8472 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.871084  8868 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.767783  8849 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
W20260709 13:03:09.833276  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.872323  8849 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:09.836709  9005 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:03:09.873399  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 54015.6us
I20260709 13:03:09.840500  9162 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:09.879218  9158 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:09.848167  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.853400  9184 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:09.856796  9183 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:09.756747  8906 consensus_queue.cc:237] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.881855  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:09.874258  1648 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:03:09.872848  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79048.5us
W20260709 13:03:09.848251  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.772773  8819 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:09.888244  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 160204us
W20260709 13:03:09.904551  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.908649  1525 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:03:09.817664  8705 raft_consensus.cc:3060] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.919763  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.921485  1676 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:09.927400  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 132222us
I20260709 13:03:09.925665  1574 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:09.885103  9076 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:09.872855  8849 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.908485  8819 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:09.920722  9031 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:09.941710  1573 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.926616  9127 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.943619  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.946195  8979 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:09.948884  9186 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:09.948957  8979 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.949452  9186 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:09.949887  9005 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.950003  9186 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:09.950435  9005 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.947955  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.959523  9186 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.960692  9031 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:09.961694  9031 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:09.961982  1573 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.962997  8868 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:09.963632  8868 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.963759  8756 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:09.964663  8868 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.964689  8756 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:09.966313  8756 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:09.969856  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:09.973286  8782 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:09.977646  9179 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:09.978375  9072 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:09.978787  9072 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:09.981505  9184 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:03:09.985944  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.988840  9186 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.970161  9005 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:09.970573  9127 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:09.997855  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 123646us
I20260709 13:03:09.999946  1647 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.000599  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:09.943926  9015 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:10.009732  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 251410us
I20260709 13:03:09.979671  9072 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.016340  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.007712  9015 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:10.021616  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.014401  9158 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.992555  8849 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.029193  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.030716  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.040184  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.041390   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.052994  9015 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.029476  8797 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:10.064739  2227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.063711  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.069234  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.073364  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.073597  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.074136  2254 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:10.048532  9005 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:10.077418  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.078791  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.080778  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.060760  8849 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:10.076907  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.080077  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.087267  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.091442  2254 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:10.089140  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.092059  2261 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.090030  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.093586  2258 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:10.061486  9072 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.095754  2256 raft_consensus.cc:1275] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:10.100811  1543 tablet_copy_service.cc:140] P b8ff9782cd95483c905cd1d906f41aaf: Received BeginTabletCopySession request for tablet 2d85e1fb5b4b419c96d985561042498a from peer 9b6586a864a94c019cae2d8e2987a7af ({username='slave'} at 127.0.0.1:56406)
I20260709 13:03:10.101454  1543 tablet_copy_service.cc:161] P b8ff9782cd95483c905cd1d906f41aaf: Beginning new tablet copy session on tablet 2d85e1fb5b4b419c96d985561042498a from peer 9b6586a864a94c019cae2d8e2987a7af at {username='slave'} at 127.0.0.1:56406: session id = 9b6586a864a94c019cae2d8e2987a7af-2d85e1fb5b4b419c96d985561042498a
I20260709 13:03:10.118036  1606 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:10.135397  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:10.135525  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.136375  2258 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:10.083777  8773 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:10.135710  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 135446us
I20260709 13:03:10.123752  9184 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.141976  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:10.149407  2261 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:03:10.125970  8979 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.154834  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.158586  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:10.154692  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 154800us
I20260709 13:03:10.155357  1601 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:10.159461  1573 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:10.140901  9186 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:10.119334  9005 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:10.165071  1499 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:10.168217  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 117643us
I20260709 13:03:10.157279  8855 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:10.160207  9200 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.175832  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.163998  8756 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:10.145644  9170 consensus_queue.cc:1059] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:03:10.182138  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.161635  9186 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:10.180619  9129 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:10.196025  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.196810  1681 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:10.197060  8773 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.198076  9082 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.193087  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.195900  9186 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:10.205101  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.207401  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.183116  9210 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:10.209096  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.211593  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.211755  9186 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.212847  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.213399  2258 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.214119  9186 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.153628  9184 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.200932  2261 raft_consensus.cc:2368] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
W20260709 13:03:10.208683  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 43728.1us
I20260709 13:03:10.190106  8756 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.217574  8756 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.218333  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.219182  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:10.221472  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.223287  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.163797  8906 consensus_queue.cc:1048] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:03:10.225128  9082 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.232519  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.233218  2259 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:10.239681  9129 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.240722  8840 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:10.241180  8840 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:10.242108  8840 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:10.243468  1604 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:10.245800  9005 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.252741  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.256958  9184 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.257898  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.259338  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.246132  9083 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:10.267679  8819 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.269214  1679 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:03:10.278633  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.279542  9202 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:10.282562  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.267338  8706 consensus_queue.cc:1059] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:10.253413  2261 raft_consensus.cc:2376] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25. Re-sending same reply.
I20260709 13:03:10.291740  2254 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:10.287925  2258 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:10.288987  1604 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:03:10.288622  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:10.271991  8819 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:10.293002  9008 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:10.297573  9008 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.299006  9202 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:10.299517  9202 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.299882  9008 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.300597  2255 raft_consensus.cc:1240] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:10.301066  1677 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:03:10.303063  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.305613  2260 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:10.306066  2261 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:10.307286  9202 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.295862  1573 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:10.311101  2257 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:10.305557  2259 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:10.313853  2260 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:10.313500  8756 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.326689  8756 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.326843  1605 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:10.317463  9157 raft_consensus.cc:3055] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:10.328523  9157 raft_consensus.cc:740] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:10.319216  8906 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:10.324072  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.329499  8906 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:10.243527  8840 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:10.332288  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 181699us
W20260709 13:03:10.334030  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55504.1us
I20260709 13:03:10.341995  1604 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 24: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:10.293588  1675 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
W20260709 13:03:10.349475  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59055.5us
I20260709 13:03:10.351615  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.357992  1573 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:10.359016  1573 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:10.359871  1529 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:10.360754  8756 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:10.360949  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.330657  8706 raft_consensus.cc:3055] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:10.363945  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.366732  2253 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:10.369084  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.369966  2256 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.373859  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.349355  8760 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:10.363744  8756 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.377453  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.377530  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.380700  1605 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:10.378654  8979 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:10.374835  9200 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:10.385577  9200 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:10.386453  9200 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.364707  8706 raft_consensus.cc:740] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:10.373353  8705 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:03:10.404240  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.404910  1681 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:10.406222  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.407699  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.408931  8868 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:10.375943  9008 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:03:10.413523  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.414726  9199 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:10.415804  9157 consensus_queue.cc:260] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.416254  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.417025  9157 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:10.417348  9199 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:10.418967  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.419898  9199 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.422087  2256 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:10.423542  1573 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:10.424744  8868 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:10.425328  8868 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:10.426342  8868 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:10.431486  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 57221.5us
I20260709 13:03:10.432690  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.434079  8797 raft_consensus.cc:2764] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:10.435274  8797 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:10.434937  2226 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.403497  8706 consensus_queue.cc:260] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.439404  9199 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:10.413635  1683 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:10.440871  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.392226  1531 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:10.388883  8756 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:10.363723  9158 consensus_queue.cc:1059] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:03:10.330569  8906 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.396425  8760 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.401839  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.402058  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.451809  1603 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:10.402324  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.441803  1604 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:10.449525  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.451980  1682 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
W20260709 13:03:10.458279  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.461429  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 93778.2us
I20260709 13:03:10.451982  9199 raft_consensus.cc:2764] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:10.469223  1681 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.439481  8706 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:10.471343  1605 raft_consensus.cc:1240] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:10.442796  8391 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.482549  1683 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:10.472887  9072 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:10.486889  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57724.8us
I20260709 13:03:10.493251  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.504674  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.506973  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.509141  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.486338  8391 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:10.518451  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 48067.9us
I20260709 13:03:10.522294  1681 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:10.508630  8819 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.508662  9202 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.496460  9159 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:03:10.511065  9072 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:10.511680  9199 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:10.525565  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.526943  1531 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:10.531168  8979 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:10.540967  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.541899  9200 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.542282  9200 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:10.542471  8391 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.542884  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.543596  1528 raft_consensus.cc:2393] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:10.532742  9199 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:10.547690  8760 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.548099  1683 raft_consensus.cc:1275] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:03:10.548627  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet df548e1d094249d5ac1f6ffa2f7d9885: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:10.550447  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.554387  9200 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.556547  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:10.559552  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.559036  1676 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:10.562613  9199 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.575259  2261 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:10.575810  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54127.7us
I20260709 13:03:10.576931  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.578574  9083 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:10.579493  9200 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:10.578567  9072 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:03:10.577852  8886 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:03:10.586279  9043 raft_consensus.cc:3055] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:10.586721  9043 raft_consensus.cc:740] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:10.559612  9223 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:03:10.588436  9072 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.588079  9043 consensus_queue.cc:260] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.602731  8840 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:10.603135  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:10.603395  8840 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.604938  1525 raft_consensus.cc:1240] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:10.605717  8840 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.603994  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.577154  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.617884  1498 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.618561  1647 leader_election.cc:400] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:10.618498  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.622442  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.624466  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.625439  8870 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.625980  1526 raft_consensus.cc:1275] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:10.626302  1534 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:03:10.626725  1534 pending_rounds.cc:85] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Aborting all ops after (but not including) 13
I20260709 13:03:10.626958  1534 pending_rounds.cc:107] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:03:10.627203  1534 raft_consensus.cc:2889] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:10.627688  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:10.628607  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.629256  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.627310  1526 raft_consensus.cc:1240] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:10.600734  9043 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.596480  8756 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.639732  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.645088  2259 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:10.621923  8840 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.655289  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.640784  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.657011  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.647152  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.577793  9224 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:03:10.620354  9222 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:10.658807  2254 raft_consensus.cc:1240] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:10.659107  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.659955  2256 raft_consensus.cc:2393] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:10.657135  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.649796  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.632987  8819 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:10.660732  2255 raft_consensus.cc:2368] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 23. Current term is 24.
I20260709 13:03:10.629714  8391 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.660671  2253 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:10.636932  8870 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:10.676496  1601 raft_consensus.cc:2368] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:10.673025  1530 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:10.651486  9223 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:10.673753  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.654191  9200 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.694553  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.679677  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:10.684250  8756 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:10.674652  8797 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:03:10.679082  9159 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.696478  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:10.699748  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.702468  1533 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:10.700022  1526 raft_consensus.cc:2393] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 14: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:10.700685  1677 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 14.
I20260709 13:03:10.701975  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.704950  1603 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:10.674746  9072 raft_consensus.cc:2764] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:03:10.708026  1525 raft_consensus.cc:2468] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:10.709913  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.710911  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:10.711588  2257 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:10.711606  2259 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:10.712862  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:10.713450  1678 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:10.714568  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.708207  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:10.715152  1674 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:10.715659  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:10.654316  9186 consensus_queue.cc:1048] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:10.677729  9224 consensus_queue.cc:1243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:03:10.717514  1682 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:10.679306  9223 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:10.723694  1681 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:10.716718  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:10.671216  8472 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:03:10.674316  8760 consensus_queue.cc:1048] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:03:10.727887  2258 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:10.721519  1680 raft_consensus.cc:1275] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:10.719777  1678 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:10.698514  9199 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:10.702724  9082 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:03:10.744575  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 45176us
I20260709 13:03:10.754935  8797 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:10.725032  9223 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:10.725363  8782 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:03:10.725226  9209 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:03:10.745620  9072 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:10.721091  9170 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:10.766193  2259 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:10.768101  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:10.723331  9225 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:10.723485  8756 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:10.773196  1525 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:10.775501  1648 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:10.718592  9201 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:10.771649  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 107067us
I20260709 13:03:10.780120  8870 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:10.804586  9236 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:03:10.778244  9209 consensus_queue.cc:1059] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:10.805744  1543 tablet_copy_source_session.cc:215] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:10.806329  8782 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:10.806808  8782 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:10.791802  8979 raft_consensus.cc:2804] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:10.807871  8782 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.778460  8706 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.809692  8706 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:10.810055  8782 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:10.778698  9038 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.810770  9038 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:10.804726  8472 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:03:10.808668  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet 12bf9f3ae6ad4d89af59a7b75960caa6: Illegal state: Replica 428f0180c2cd487c8b48e91f14dff65d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:10.781739  9031 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:10.795606  9129 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.816567  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:10.802767  8756 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:10.832120  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 115479us
I20260709 13:03:10.805956  9236 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:03:10.837987  8706 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.824139  9031 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:10.850064  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:10.851536  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 59130.2us
I20260709 13:03:10.825021  9129 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:10.937883  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 84333.4us
I20260709 13:03:10.954365  1674 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:10.843757  8760 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:03:10.966898  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:10.969159  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:10.945531  8849 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.944187  9038 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:10.951316  8706 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.965263  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 165846us
W20260709 13:03:11.093677  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 363717us
I20260709 13:03:11.095465  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:11.099793  8849 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.121155  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:11.171243  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 50164.7us
I20260709 13:03:10.858135  8870 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:10.965922  9238 consensus_queue.cc:1059] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.158s
W20260709 13:03:11.123466  9231 log.cc:927] Time spent T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 13:03:11.120671  9209 raft_consensus.cc:3055] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:11.092563  8706 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.168617  9082 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:11.180428  9237 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:10.977286  8756 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.166946  8979 raft_consensus.cc:697] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.180085  9199 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:11.252983  9199 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.255496  9199 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:11.191869  9043 consensus_meta.cc:287] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:03:11.256526  9224 raft_consensus.cc:1064] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:03:11.188964  8977 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.259019  8977 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.102391  9031 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:11.252027  8819 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.000s
I20260709 13:03:11.230252  9246 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.230378  9237 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.266906  9246 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.267681  9237 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:11.233332  9239 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:03:11.234210  9241 log.cc:927] Time spent T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:03:11.235268  9222 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:03:11.243628  9248 log.cc:927] Time spent T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:11.244689  9129 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:11.246613  8979 consensus_queue.cc:237] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.247534  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:11.299769  1603 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:11.184201  9240 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:11.250870  8706 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:11.259732  1480 auto_rebalancer.cc:629] Failed to schedule move for tablet 75b33947f35745f4809f8a533ebbdaf8: Illegal state: Replica b88b12b461734b3aa6a3da4f5c22c79b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
W20260709 13:03:11.228479  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.265983  9157 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.848s	user 0.013s	sys 0.000s
I20260709 13:03:11.194285  9209 raft_consensus.cc:740] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.233014  9247 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.343863  9076 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.343705  9247 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.344558  9076 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.345898  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:11.346319  9247 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:11.291162  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119035us
I20260709 13:03:11.348217  9074 consensus_queue.cc:1059] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:11.349396  9082 raft_consensus.cc:3055] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:11.349779  9082 raft_consensus.cc:740] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:11.350756  9082 consensus_queue.cc:260] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.351788  9246 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:11.287106  9227 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.509s	user 0.006s	sys 0.004s
I20260709 13:03:11.352056  9082 raft_consensus.cc:3060] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:11.305045  1679 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:03:11.323454  8782 consensus_meta.cc:287] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.004s
W20260709 13:03:11.330762  9243 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:03:11.292891  9222 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.287787  8819 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:11.341702  8849 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.287163  9224 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.287091  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:11.346968  9076 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:11.357321  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 54027.3us
I20260709 13:03:11.481406  1609 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:11.497920  1606 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:11.360781  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
W20260709 13:03:11.410262  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60413.7us
W20260709 13:03:11.434118  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 57144us
I20260709 13:03:11.448372  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44456 (request call id 3465) took 1004 ms. Trace:
I20260709 13:03:11.438845  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:11.505648  1649 leader_election.cc:400] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:11.506085  1649 leader_election.cc:403] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:11.496992  1574 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:11.500447  1608 rpcz_store.cc:276] 0709 13:03:10.443541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.443721 (+   180us) service_pool.cc:224] Handling call
0709 13:03:10.468617 (+ 24896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.469303 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:10.504084 (+ 34781us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.634668 (+130584us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.644955 (+ 10287us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.645092 (+   137us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:10.645126 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.645187 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.246051 (+600864us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:11.360453 (+114402us) raft_consensus.cc:1685] finished
0709 13:03:11.448141 (+ 87688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.448288 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":528,"prepare.queue_time_us":27007,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":761,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":14811,"spinlock_wait_cycles":31643904,"thread_start_us":144549,"threads_started":2,"wal-append.queue_time_us":257809}
I20260709 13:03:11.510053  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:11.464922  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:11.513078  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 74333.6us
I20260709 13:03:11.515944  1601 raft_consensus.cc:2393] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:11.517212  2252 raft_consensus.cc:1240] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 25. Current term is 26. Ops: []
W20260709 13:03:11.488502  9249 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:03:11.432283  9200 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.527566  1527 raft_consensus.cc:1240] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:11.542515  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:11.543308  9223 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.000s
I20260709 13:03:11.543733  9223 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.544503  8849 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:11.545995  9223 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.546856  9076 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.546659  9200 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:11.547345  9076 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.549115  9200 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:11.543243  1534 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:11.510396  8782 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.510576  9157 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.555091  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.011s	sys 0.034s
I20260709 13:03:11.510473  9240 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.557179  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.557798  1677 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:11.449875  9074 consensus_queue.cc:1048] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:03:11.569283  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:11.569533  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.570133  1600 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 24: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:11.516872  9247 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20.
I20260709 13:03:11.575950  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3815) took 1007 ms. Trace:
I20260709 13:03:11.526669  9258 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:11.553254  9127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.000s	sys 0.042s
I20260709 13:03:11.343866  9209 consensus_queue.cc:260] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.512881  9083 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:03:11.587069  8886 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.587522  9076 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.587801  8886 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.576366  1604 rpcz_store.cc:276] 0709 13:03:10.568080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.568337 (+   257us) service_pool.cc:224] Handling call
0709 13:03:10.597390 (+ 29053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.607756 (+ 10366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.607792 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.623691 (+ 15899us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.814343 (+190652us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:10.814379 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.814442 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.575726 (+761284us) raft_consensus.cc:1685] finished
0709 13:03:11.575753 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.575893 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1768,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":152646,"threads_started":1,"wal-append.queue_time_us":221522}
I20260709 13:03:11.605785  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d85e1fb5b4b419c96d985561042498a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.558874  9038 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:11.609771  1607 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:11.574932  8840 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.614528  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:11.615870  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3350) took 1025 ms. Trace:
I20260709 13:03:11.618628  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:11.622934  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:11.624990  2252 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:11.608542  9258 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:11.613332  9127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.000s	sys 0.043s
I20260709 13:03:11.626904  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:11.555061  9257 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.094s
I20260709 13:03:11.631842  2254 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:11.626991  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1640) took 1106 ms. Trace:
I20260709 13:03:11.559839  8782 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.572014  9157 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.619846  1676 rpcz_store.cc:276] 0709 13:03:10.590321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.590515 (+   194us) service_pool.cc:224] Handling call
0709 13:03:10.590936 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.591391 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.591426 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.598648 (+  7222us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.941925 (+343277us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:10.941969 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.942046 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.615656 (+673610us) raft_consensus.cc:1685] finished
0709 13:03:11.615676 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.615811 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5658,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":335744,"threads_started":1,"wal-append.queue_time_us":738762}
I20260709 13:03:11.630189  2252 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:11.624214  9245 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:11.621762  9259 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.649951  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:11.575752  9240 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.652872  2252 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:11.661420  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 25.
W20260709 13:03:11.665822  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.016s
W20260709 13:03:11.666260  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.016s
I20260709 13:03:11.622085  8840 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.654886  9209 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.648550  8886 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.655272  9257 consensus_queue.cc:1243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer 428f0180c2cd487c8b48e91f14dff65d log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:03:11.672791  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:11.674443  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:11.677431  2252 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:11.680704  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.681857  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.682278  1679 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:11.667254  9256 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.697561  2259 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:11.698163  1574 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:11.660024  9259 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.667413  8706 consensus_queue.cc:1059] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:03:11.715493  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3470) took 1080 ms. Trace:
I20260709 13:03:11.715971  1530 rpcz_store.cc:276] 0709 13:03:10.635242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.635339 (+    97us) service_pool.cc:224] Handling call
0709 13:03:10.655181 (+ 19842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.679948 (+ 24767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.715254 (+1035306us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54002ce054. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:11.715435 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31758592}
I20260709 13:03:11.716995  8391 raft_consensus.cc:3055] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:11.718130  8756 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.719110  8391 raft_consensus.cc:740] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:11.719369  8756 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.719779  8756 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:11.718204  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.723408  1683 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:11.727784  9268 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.728497  9268 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.730243  9043 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.730746  9043 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.727981  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:11.735492  1683 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:11.704291  9038 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:11.738287  2255 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
W20260709 13:03:11.743217  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 44282.3us
W20260709 13:03:11.746618  9267 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:03:11.748622  8782 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.750991  9043 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.754722  8977 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.755556  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:11.756224  1534 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:11.756969  1527 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:11.757277  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:11.762089  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:11.739825  9038 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.766400  1675 raft_consensus.cc:1275] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:11.767266  2257 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:11.767696  9200 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.768226  9200 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.770726  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:11.771621  1526 raft_consensus.cc:2393] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:11.775080  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:11.775774  1602 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:11.740767  9031 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.686039  9258 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.699587  9256 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.760006  9210 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.772032  9257 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.797194  1531 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:11.795117  9200 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.788709  9257 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.776988  9225 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:03:11.818854  9240 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:11.795740  9210 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.784286  9031 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.632740  1529 rpcz_store.cc:276] 0709 13:03:10.520420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.520565 (+   145us) service_pool.cc:224] Handling call
0709 13:03:10.520916 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.521125 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:10.532203 (+ 11078us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.593064 (+1060861us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800375d00. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d123a
0709 13:03:11.626681 (+ 33617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:11.626736 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:11.626777 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.626835 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.626936 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31080,"prepare.queue_time_us":77843,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2244,"raft.queue_time_us":38016,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":27006336,"thread_start_us":79676,"threads_started":2,"wal-append.queue_time_us":171608}
W20260709 13:03:11.822458  9237 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.002s
I20260709 13:03:11.795451  9157 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:11.844887  9247 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:11.853173  9259 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.855494  1647 leader_election.cc:400] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 23. Current term is 24.
I20260709 13:03:11.853626  8391 consensus_queue.cc:260] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.871090  1647 leader_election.cc:403] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:11.858029  9257 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:11.893141  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
W20260709 13:03:11.887770  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 114227us
I20260709 13:03:11.896270  8391 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:11.892088  8840 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.861784  9237 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:11.901978  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 152070us
I20260709 13:03:11.930227  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:11.897235  9038 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:11.904899  9225 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:11.956540  9225 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.956892  9222 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.957450  9225 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:11.958233  9222 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:11.958741  9225 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:11.961186  8868 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.961762  8868 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:11.964342  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.931779  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1643) took 1386 ms. Trace:
I20260709 13:03:11.938413  9210 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:11.969547  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.946957  9246 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.931600  9288 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:11.947662  9291 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185) with higher term. Message: Invalid argument: T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 23. Current term is 24.
I20260709 13:03:11.963932  8868 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:11.965734  1528 rpcz_store.cc:276] 0709 13:03:10.545266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.549251 (+  3985us) service_pool.cc:224] Handling call
0709 13:03:10.549593 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.549780 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:10.665000 (+115220us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.175428 (+510428us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.756271 (+580843us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b180005dee0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287 00007f7e63b4c208
0709 13:03:11.931323 (+175052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:11.931375 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:11.931428 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.931497 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.931720 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13989,"prepare.queue_time_us":96867,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":231039,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":6768,"spinlock_wait_cycles":9885568,"thread_start_us":784499,"threads_started":4,"wal-append.queue_time_us":429823}
I20260709 13:03:12.013873  9236 raft_consensus.cc:3055] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:12.014511  9236 raft_consensus.cc:740] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:11.950317  9237 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.021641  8391 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:12.022297  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:11.952857  8797 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:11.953320  9031 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:11.965241  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:12.023511  8797 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:12.024115  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 58969.4us
I20260709 13:03:12.024849  9268 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.025486  9268 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:12.026026  9268 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.973609  9288 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:11.971640  9258 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.980050  8756 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.031842  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:12.049309  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.049628  1677 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.033521  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:12.036666  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65763.9us
I20260709 13:03:12.043972  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:12.047232  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 262576us
W20260709 13:03:12.048069  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.058205  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.060495  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.025651  8797 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.061856  2257 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:12.059240  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.060979  1680 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 14.
I20260709 13:03:11.972724  9246 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.061309  9259 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:03:12.106966  2255 raft_consensus.cc:1275] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:03:12.072077  2253 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:12.108487  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.076144  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.110213  2259 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:12.050347  9258 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.049633  9031 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.113412  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.113706  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.114061  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.113412  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.115223  2254 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:12.116452  1604 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 25.
I20260709 13:03:12.057989  9082 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.049880  9210 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
W20260709 13:03:12.122085  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55348.1us
I20260709 13:03:12.015725  9236 consensus_queue.cc:260] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.065531  9005 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.109328  9246 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:12.068410  9083 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.117129  9258 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:12.132010  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.063664  8706 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:12.061339  9237 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:12.136123  1674 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:12.108286  8849 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.149456  8706 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.120430  9031 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.128381  9082 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.159345  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.167215  1677 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:12.111141  9274 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:03:12.188529  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 55884.9us
I20260709 13:03:12.179960  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:12.190567  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 65715.2us
I20260709 13:03:12.190963  1604 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 14.
I20260709 13:03:12.127851  9200 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:03:12.196811  1602 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:12.203495  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:12.174997  9236 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.173312  9244 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:12.221635  1679 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:12.209362  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.211167  2261 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:12.209934  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:12.224454  1601 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:12.225054  1649 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:12.216344  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.135993  9076 consensus_queue.cc:1048] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 13:03:12.229894  9170 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:12.230533  9170 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.230970  9170 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:12.231510  9259 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:12.232020  9259 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.232471  9259 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:12.242081  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.242609  9259 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.168782  9083 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.195729  9157 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:12.195959  8886 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.249734  1528 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:12.146948  9005 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:12.256294  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.274420  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.274935  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.179013  8849 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.202555  8906 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.237617  9301 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.268535  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.268922  9186 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.314328  1528 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:12.278276  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.227717  9238 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.327438  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.329202  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.249927  9240 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:12.286551  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 47389.3us
W20260709 13:03:12.286688  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 61690.3us
I20260709 13:03:12.311071  2256 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:12.318141  2260 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 15.
W20260709 13:03:12.320340  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.322053  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 62756.7us
I20260709 13:03:12.322368  9308 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.312559  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:12.171978  9268 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.333124  1534 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:12.317013  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:12.223470  9282 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.087s
I20260709 13:03:12.341740  2252 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 LEARNER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:12.345669  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:12.346282  2252 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.326881  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:12.341281  1607 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:12.288903  8705 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.355116  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.249293  9257 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.371272  2256 raft_consensus.cc:1275] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:12.228715  9244 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.379714  2252 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:12.348614  9250 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.287946  8886 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.309602  9201 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.095s
I20260709 13:03:12.269925  9157 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.348863  9008 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.476884  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:12.364553  8756 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.380797  9200 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.472795  9250 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.355448  9289 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.477465  2252 raft_consensus.cc:1240] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:12.471832  1681 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:12.477527  1676 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:12.370327  9247 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.333701  9186 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.384861  9072 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.388389  9202 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:12.332947  8906 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.467857  9076 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:03:12.349740  9240 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.387574  8705 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:03:12.501428  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 174624us
I20260709 13:03:12.349470  9238 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.330325  9301 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.484527  9237 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.487660  9264 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:12.491273  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 159861us
I20260709 13:03:12.492661  9250 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.362556  9308 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:12.500566  9225 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.004s
I20260709 13:03:12.491662  9008 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.491792  9200 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.536353  1527 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:03:12.511165  8706 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.536255  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:12.542091  2259 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:12.500828  9247 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:12.531229  9300 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 13:03:12.569208  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 252264us
I20260709 13:03:12.522927  9237 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.522562  9304 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.498056  9289 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:12.566766  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 47652.3us
I20260709 13:03:12.531451  9264 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.578737  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:12.590972  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.541828  9259 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 26 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.583380  9237 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.506512  9072 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.510417  9202 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.587610  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:12.596654  9264 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:12.567343  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.582497  9201 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:12.666949  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 157503us
I20260709 13:03:12.625101  2259 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:12.674165  9259 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.606431  8849 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.683702  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:12.694031  9072 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.694936  9311 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.695377  9072 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.697325  9008 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.676566  9257 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.697708  9240 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.698215  9240 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.698689  9240 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.702262  9244 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.702924  9244 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.703373  9244 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.595153  9304 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.705032  8706 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:12.705495  8706 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.705894  8706 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:12.706386  8886 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.678203  9082 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.708643  9308 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.690825  9201 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.695420  9311 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.705555  9186 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.710697  9201 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.711282  9259 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.729239  9244 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.719004  9170 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.722949  9157 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.667688  9005 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:12.741474  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 153962us
I20260709 13:03:12.742451  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:12.730471  9311 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.695902  9072 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.670100  9314 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:12.728088  9304 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.714386  9202 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.765250  2258 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:12.772593  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:12.722813  9240 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.722580  9289 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.779146  8391 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.781577  8391 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.782370  8906 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.783299  9247 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.783520  8391 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.782270  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.786234  8391 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.786842  8391 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:12.786703  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 414604us
I20260709 13:03:12.788614  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.792083  1602 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:12.792949  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:12.795842  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 112779us
I20260709 13:03:12.800891  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:12.784165  9237 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.813187  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.784832  9008 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:12.788615  9314 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:12.817569  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.822438  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.819017  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.807744  9247 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:12.856657  8391 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.863358  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.864833  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:12.865171  1674 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:12.867856  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.814144  9240 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.874616  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.876961  1601 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:12.877816  8391 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:12.878299  8391 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.818392  9311 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:12.827926  8782 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.797107  8906 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:03:12.883893  9240 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.861884  9256 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.806917  9159 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:03:12.922379  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:12.922616  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.802693  9289 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:03:12.925531  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:12.927139  9236 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.000s
W20260709 13:03:12.929060  9323 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:12.930033  9038 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.930845  1574 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:12.931610  9310 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.931818  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.932281  9237 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.934247  9072 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:12.934854  9314 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.884131  9313 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.885596  8849 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:03:12.941637  9311 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:12.883855  9304 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:12.947207  9258 consensus_meta.cc:287] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.797s	user 0.001s	sys 0.008s
I20260709 13:03:12.950446  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.916939  8906 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.886402  9170 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:13.022203  2253 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:03:12.888736  9240 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:12.889786  8391 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.886389  8782 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.891074  1676 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:12.911516  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:12.918962  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:12.916500  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:13.024580  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 105693us
I20260709 13:03:13.000130  2261 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:12.913357  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:12.885716  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:13.000734  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 69990.6us
I20260709 13:03:13.026623  1674 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
W20260709 13:03:12.903326  9316 log.cc:927] Time spent T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.114s	user 0.001s	sys 0.002s
I20260709 13:03:12.952212  9264 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.906898  9031 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:03:12.891577  9331 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:12.904000  9083 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:12.886881  9312 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.024791  2260 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:12.927846  8706 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.029060  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.029587  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:12.896502  9253 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:12.996906  9246 consensus_meta.cc:287] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.840s	user 0.011s	sys 0.000s
I20260709 13:03:12.918401  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.031812  1674 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:13.032287  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.041410  1573 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:13.022223  9304 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:12.898732  9250 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.039705  2254 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:13.079849  8391 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.050273  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.050973  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.080269  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.052003  9076 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:13.055590  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:12.917316  9292 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:12.892468  9256 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.031288  9005 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:13.046211  1605 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:13.081326  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.036201  9331 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.083731  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.084648  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.086105  1608 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:13.090792  1600 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 26: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:13.048619  9083 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:13.084575  8391 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.090407  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.094285  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3416) took 1039 ms. Trace:
I20260709 13:03:13.097136  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.095777  1683 rpcz_store.cc:276] 0709 13:03:12.054837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.055004 (+   167us) service_pool.cc:224] Handling call
0709 13:03:12.058642 (+  3638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.058972 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.058998 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.264847 (+205849us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b2c0012ecf8. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:03:12.272151 (+  7304us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.494570 (+222419us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:12.494615 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.494687 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.902641 (+407954us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:13.094003 (+191362us) raft_consensus.cc:1685] finished
0709 13:03:13.094027 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.094232 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14399,"raft.queue_time_us":135,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":49428,"spinlock_wait_cycles":217738496,"thread_start_us":145633,"threads_started":1,"wal-append.queue_time_us":367899}
I20260709 13:03:13.056581  9304 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.030735  8906 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.034591  9274 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:03:13.020790  9313 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:12.905977  9288 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.097028  9083 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.029814  9258 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.134196  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.137941  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.138154  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:13.138403  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.091053  8870 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.153053  1534 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:13.140682  1532 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.044545  9337 consensus_queue.cc:1048] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 13:03:13.084671  9237 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.090914  9005 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.145730  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.153168  1528 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:13.157209  8391 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.040073  9312 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.091998  9331 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.052544  9246 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.092186  9292 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.152334  1530 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:13.092731  9256 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.169384  9283 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:13.170516  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3410) took 1142 ms. Trace:
I20260709 13:03:13.133077  9038 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.173767  1603 raft_consensus.cc:2368] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 20. Current term is 21.
I20260709 13:03:13.129494  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.184026  2255 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:13.158087  9005 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:13.173373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.182209  1681 rpcz_store.cc:276] 0709 13:03:12.028194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.049013 (+ 20819us) service_pool.cc:224] Handling call
0709 13:03:13.170317 (+1121304us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54003575d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:13.170443 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968238848}
W20260709 13:03:13.165231  9161 consensus_meta.cc:287] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.000s
I20260709 13:03:13.172493  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.188906  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.191699  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.192497  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.194876  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.196818  2256 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:13.198751  1677 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:13.160328  9288 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:13.202252  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.200469  1531 raft_consensus.cc:2393] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:13.202543  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.203229  1674 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:13.164011  9336 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.204154  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.205349  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.205730  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.205945  1674 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:13.152724  9083 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:13.211480  1530 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:13.184199  9283 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.214509  1681 raft_consensus.cc:1240] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.217034  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.219053  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:13.226001  1533 raft_consensus.cc:2368] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22.
I20260709 13:03:13.227469  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.227933  1531 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:03:13.216670  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136532us
I20260709 13:03:13.220798  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.221603  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.162194  8870 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.228108  1530 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
W20260709 13:03:13.213557  9339 log.cc:927] Time spent T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:03:13.239428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.229249  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.164873  9237 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.185664  9268 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.233974  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.234831  1605 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:13.223771  9076 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:13.192104  9031 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.269273  9031 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.206256  9223 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:13.244335  1606 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.238499  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.245992  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.247255  9237 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.247718  9274 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:13.248942  9312 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.247586  9292 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.251067  9268 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.252631  8849 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:13.254412  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.228783  9283 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.197561  9038 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.255622  8782 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.257499  8906 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.257992  8870 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.224967  1498 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.275461  1608 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:13.282228  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.286201  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.227217  9311 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.333848  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.291504  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.268890  9256 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:13.297878  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43571.7us
I20260709 13:03:13.268967  9076 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.271350  9031 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.289798  9344 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.281270  9274 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.298029  9292 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.302081  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.342636  1604 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:13.294301  8706 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:13.304581  9341 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:03:13.306113  9304 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:13.288458  9159 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:03:13.310952  9250 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:13.312052  9313 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.288386  9223 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.313162  9246 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.313741  8849 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:13.315013  9268 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.316931  9038 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.317898  9258 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.295228  9247 consensus_queue.cc:1048] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:03:13.320990  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:13.324419  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.380914  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.335139  1609 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:13.335400  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:13.307757  9347 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:03:13.385470  1680 raft_consensus.cc:2468] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:13.351445  8886 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:13.344699  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.345281  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:13.346372  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.393222  1608 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.208650  9336 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.419380  9336 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.337730  9161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 1672) took 4948 ms. Trace:
I20260709 13:03:13.344851  9274 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:13.344050  9256 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:13.381901  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:13.339766  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 114857us
I20260709 13:03:13.385762  9246 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:13.389164  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.389411  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.437103  2257 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:13.344787  9344 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:13.349575  9292 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.402169  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:13.403743  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 58537.2us
I20260709 13:03:13.442670  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:13.404419  9236 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:13.404994  1649 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:13.405759  9310 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:13.412874  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:13.447136  2256 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:13.415217  9304 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.453308  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.454224  1609 raft_consensus.cc:2410] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:13.455030  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:13.417215  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 81903.7us
I20260709 13:03:13.417644  8906 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.425796  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.426822  1608 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:13.427424  1604 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:13.428182  1606 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:13.439050  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.403971  9238 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.445533  8870 consensus_queue.cc:1059] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:03:13.449354  8797 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:13.449972  9159 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:13.449994  9083 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.427548  9336 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.415906  9331 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.445164  9038 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.431550  9256 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.486547  9256 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:13.438679  8706 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.487579  8706 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.487938  9344 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.488709  9336 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.464799  1605 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:13.445717  9236 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.466979  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.463541  8782 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.470953  8870 raft_consensus.cc:3055] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.475369  9264 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.481642  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.485931  9331 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.464854  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.499203  1608 raft_consensus.cc:2368] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22.
I20260709 13:03:13.468168  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.500020  1681 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:13.500859  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.497275  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.507112  2256 raft_consensus.cc:2468] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:13.489652  8706 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.486359  9038 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.446171  9246 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.523756  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.524458  1649 leader_election.cc:400] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22.
I20260709 13:03:13.493762  9236 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:13.532047  1649 leader_election.cc:403] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.532058  1682 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:13.497433  8870 raft_consensus.cc:740] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:13.559069  8870 consensus_queue.cc:260] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.560460  8870 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.561436  9336 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.563187  9292 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.566435  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1709) took 1275 ms. Trace:
I20260709 13:03:13.566883  2258 rpcz_store.cc:276] 0709 13:03:12.290680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.290801 (+   121us) service_pool.cc:224] Handling call
0709 13:03:12.291111 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.775192 (+484081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.566160 (+790968us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54005c0b54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:13.566365 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089668480}
I20260709 13:03:13.536669  9222 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:13.561455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.571632  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:13.548115  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:13.537542  9322 log.cc:927] Time spent T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.818s	user 0.005s	sys 0.001s
W20260709 13:03:13.539404  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49526 (request call id 1531) took 1463 ms (client timeout 1873 ms). Trace:
I20260709 13:03:13.541808  1675 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:13.543390  9246 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.546567  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.530905  9038 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.548746  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.425091  9161 rpcz_store.cc:276] 0709 13:03:08.437953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.823560 (+385607us) service_pool.cc:224] Handling call
0709 13:03:09.143262 (+319702us) ts_tablet_manager.cc:934] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Initiating tablet copy from peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
0709 13:03:11.518651 (+2375389us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:12.138502 (+619851us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:12.175223 (+ 36721us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:13.231989 (+1056766us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:13.291032 (+ 59043us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:13.308183 (+ 17151us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:13.308261 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":41781,"tablet-copy.queue_time_us":292068,"thread_start_us":339517,"threads_started":2}
I20260709 13:03:13.549453  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.588264  1525 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:13.550364  9083 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.550599  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.589751  1527 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:13.589516  9283 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.596885  9161 tablet_copy_client.cc:806] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:13.597678  9161 tablet_copy_client.cc:670] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:13.598853  9283 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.551741  8886 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:13.553511  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.555316  9256 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.548265  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.602882  1533 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:13.582692  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
W20260709 13:03:13.583458  1603 rpcz_store.cc:269] 0709 13:03:12.075532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.075641 (+   109us) service_pool.cc:224] Handling call
0709 13:03:13.539179 (+1463538us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001bcbd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:13.539323 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436382464}
I20260709 13:03:13.603915  1531 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
W20260709 13:03:13.605815  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 149587us
W20260709 13:03:13.608618  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 147711us
I20260709 13:03:13.608217  9274 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.606464  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:13.605439  8886 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:13.601500  9246 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.617177  1499 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.615929  1574 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.624998  8472 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:13.625456  8472 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:13.625764  9321 log.cc:927] Time spent T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.837s	user 0.005s	sys 0.002s
I20260709 13:03:13.625799  8472 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.637732  9200 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.620255  9283 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:13.655212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.644107  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.647056  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.589254  9005 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.651336  1534 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:13.674379  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.682623  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.651185  9336 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.687624  1606 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 24. Ops: []
I20260709 13:03:13.654011  9083 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:13.650934  9311 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.691236  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33602 (request call id 3480) took 1416 ms. Trace:
I20260709 13:03:13.654322  9283 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.692765  9283 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:13.693089  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 234117us
I20260709 13:03:13.691656  1574 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.697291  1500 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:13.698239  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.624428  9246 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.697623  1526 rpcz_store.cc:276] 0709 13:03:12.274912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.287359 (+ 12447us) service_pool.cc:224] Handling call
0709 13:03:13.557161 (+1269802us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58000c0f98. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68b0afc0 00007f7e68af5929 00007f7e68af53d2 00007f7e6206cbd4
0709 13:03:13.557348 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.557540 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:13.557865 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.690884 (+133019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.690938 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:13.690981 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.691048 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.691166 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2796,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":5981,"spinlock_wait_cycles":2563328,"thread_start_us":132594,"threads_started":1}
I20260709 13:03:13.666393  9240 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:03:13.717780  2252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1713) took 1223 ms. Trace:
W20260709 13:03:13.701495  2227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:36091 timed out after 1.873s (SENT) [suppressed 15 similar messages]
I20260709 13:03:13.713243  8797 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:13.698690  9200 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:13.665220  8706 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
W20260709 13:03:13.716770  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49407.2us
I20260709 13:03:13.690017  9363 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.718129  2252 rpcz_store.cc:276] 0709 13:03:12.493966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.494115 (+   149us) service_pool.cc:224] Handling call
0709 13:03:12.494416 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.579155 (+ 84739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.579186 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.579227 (+    41us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:12.579266 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.717551 (+1138285us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b5400550354. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:13.717605 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.717732 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194382080}
I20260709 13:03:13.720088  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.722133  1674 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:13.724208  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:13.699970  9292 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:13.711575  9225 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.722265  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.696844  9336 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.725780  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.716696  9345 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.730517  1676 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:13.732415  9225 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.733647  9274 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.734505  9225 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.734730  1679 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:13.735453  9246 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.730834  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.699415  9311 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.717506  9008 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.746167  2226 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.737084  9352 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.747380  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.747608  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:13.729777  9264 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.728652  9292 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.749706  1500 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.750502  1681 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:13.751744  1500 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.736865  9312 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.753561  1500 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:13.756388  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:13.761771  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60302.5us
I20260709 13:03:13.766420  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.769085  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.770123  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.770342  1647 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.755839  9331 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:13.771145  9345 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.771201  9246 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:13.771838  9345 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.772333  9345 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.770803  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:13.773880  2257 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:13.771103  9225 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:13.775030  9225 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.775396  9225 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:13.748670  9371 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.758807  9365 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:13.776597  9371 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.777029  9371 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.750602  9264 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.777681  9264 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.751099  9170 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:13.778980  1648 leader_election.cc:400] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22.
I20260709 13:03:13.750278  9352 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:13.825150  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46208.5us
I20260709 13:03:13.752763  9237 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.829301  9237 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:13.829799  9237 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.830098  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.830695  1605 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:13.831272  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:13.829210  9320 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 1.125s	user 0.004s	sys 0.000s
I20260709 13:03:13.826612  9253 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:13.836690  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3378) took 1493 ms. Trace:
I20260709 13:03:13.838004  9259 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:13.837097  1678 rpcz_store.cc:276] 0709 13:03:12.343482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.352597 (+  9115us) service_pool.cc:224] Handling call
0709 13:03:12.356760 (+  4163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.362908 (+  6148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.362940 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.363425 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.513015 (+149590us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:12.513072 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.515324 (+  2252us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.815694 (+1300370us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:13.836371 (+ 20677us) raft_consensus.cc:1685] finished
0709 13:03:13.836391 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.836604 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20961,"raft.queue_time_us":6566,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":97961,"spinlock_wait_cycles":441367424,"thread_start_us":120076,"threads_started":1,"wal-append.queue_time_us":263786}
I20260709 13:03:13.838569  1648 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.839761  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:13.765444  9240 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:13.841130  9240 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.838898  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.841536  9240 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:13.842392  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.842631  8705 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:13.818465  9368 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:13.752789  9292 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:13.816674  9170 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.776096  8886 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.771211  9331 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:13.848681  1678 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:03:13.828555  9005 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.727511  9283 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:13.855003  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.840831  9031 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:13.828217  9256 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.845369  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3375) took 1636 ms. Trace:
I20260709 13:03:13.759542  8706 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:13.827605  9246 raft_consensus.cc:2804] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:13.860767  1675 rpcz_store.cc:276] 0709 13:03:12.209001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.209119 (+   118us) service_pool.cc:224] Handling call
0709 13:03:13.845214 (+1636095us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003abe54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:13.845313 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030261504}
I20260709 13:03:13.861815  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.741649  9244 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:03:13.847157  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.848068  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.819796  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1652) took 1575 ms. Trace:
I20260709 13:03:13.867254  1529 rpcz_store.cc:276] 0709 13:03:12.244220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.244563 (+   343us) service_pool.cc:224] Handling call
0709 13:03:12.244830 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.474689 (+229859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.474720 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.474763 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.474792 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.817976 (+1343184us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003a66d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:13.819590 (+  1614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.819728 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528168704}
I20260709 13:03:13.776926  9365 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:13.839788  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:13.853171  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:13.751343  9008 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.757763  9236 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.769109  2260 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
W20260709 13:03:13.874228  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 126688us
W20260709 13:03:13.860186  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.862459  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.864106  1681 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:13.865249  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:13.876502  1675 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:13.850922  9170 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:13.869264  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.872963  1678 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:13.869000  1607 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:13.873896  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.874217  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.877425  8706 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:13.880494  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.875972  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:13.836822  9253 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.883493  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.878805  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:13.885226  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.886330  1499 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:13.886914  1533 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:13.878234  9365 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:13.885501  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.879909  2226 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:13.896016  9170 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.901062  9331 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:13.904902  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:13.894364  9008 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.873724  9247 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:13.892207  8886 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:13.906277  2260 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:03:13.911065  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.912155  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:13.931329  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 45053.6us
I20260709 13:03:14.019483  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.018548  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:14.032110  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 156345us
I20260709 13:03:13.873540  9288 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:13.878290  9031 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:13.888818  8797 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.876237  9246 raft_consensus.cc:697] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:14.041872  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.043669  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:14.045164  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.045326  9312 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.058624  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:13.905035  9256 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:14.048174  9074 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:14.065750  1529 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:14.039891  9247 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.018500  9268 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:14.071249  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.085633  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.086621  1527 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:14.068015  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.045142  9372 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.087868  1528 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:14.094317  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.048954  8797 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:14.101518  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:14.063014  9222 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b for earlier term 21. Current term is 22.
I20260709 13:03:14.063462  9374 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.080396  9074 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.875373  9352 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.078645  8870 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:14.084466  9247 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:14.171064  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 331313us
I20260709 13:03:14.146250  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.057543  9288 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.139561  8797 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.181026  1600 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:14.182809  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.172497  9074 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.157016  9363 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:14.174324  8472 consensus_meta.cc:287] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:03:14.190068  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:14.066748  9312 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.185750  9223 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.107425  9259 consensus_queue.cc:1059] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:03:14.194561  8391 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.196564  9311 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.196838  9008 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.197418  9296 raft_consensus.cc:2764] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:03:14.192711  9253 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.108068  9268 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.225564  1648 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.147394  9372 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.195994  9237 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.197319  9225 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.233718  9345 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.144845  8706 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.239486  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:14.255008  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.231130  9038 consensus_meta.cc:287] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.003s
I20260709 13:03:14.226380  9363 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:14.234323  9268 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.217479  8472 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.268494  9379 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:14.279341  1531 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.175720  9374 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.283838  1682 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:14.268482  9345 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.306301  1525 raft_consensus.cc:2368] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:03:14.257470  9074 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.311941  9074 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.312227  9237 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.317524  9225 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.319253  9372 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.278934  9268 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.262684  9283 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:14.303071  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 208851us
I20260709 13:03:14.335451  1679 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:14.285951  9223 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.265285  9038 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.183316  9246 consensus_queue.cc:237] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.338162  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:14.345072  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:14.308065  9236 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.346581  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:14.342893  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 202088us
I20260709 13:03:14.351328  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:14.352005  1679 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:14.353037  8391 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:14.354908  8391 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:14.355336  8391 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.328811  9274 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.282400  9379 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.365651  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.364127  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.368806  1528 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:14.373430  1604 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:14.370837  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 326221us
I20260709 13:03:14.342666  9256 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:14.379654  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.380298  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.350236  9345 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:14.380453  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.379109  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf"
I20260709 13:03:14.379586  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:14.407940  1526 consensus_meta.cc:287] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:03:14.358346  9259 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:14.379900  9292 consensus_meta.cc:287] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 13:03:14.453883  1606 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:14.452833  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3420) took 1266 ms. Trace:
I20260709 13:03:14.452963  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.454046  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.486985  1607 raft_consensus.cc:3060] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.486640  1683 rpcz_store.cc:276] 0709 13:03:13.186030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.186164 (+   134us) service_pool.cc:224] Handling call
0709 13:03:13.832646 (+646482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.832825 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.832850 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.832891 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:13.832920 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.832968 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.452662 (+619694us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54000ed3d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.452767 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470499200}
I20260709 13:03:14.427878  1534 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:14.423915  1679 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:14.457180  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.482388  1604 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:14.452721  1608 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:14.490993  1602 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.480444  1526 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:03:14.463375  9240 consensus_meta.cc:287] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 13:03:14.379998  9380 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.407567  9345 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.379670  9238 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:14.495357  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:14.520962  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:14.376945  9274 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:14.454384  9264 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 13:03:14.533675  1603 raft_consensus.cc:1240] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:14.522509  1525 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 11 to 15, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:14.455538  9312 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.460906  9379 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.423426  9301 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.459347  8472 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.521950  1648 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:14.524214  9345 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:14.413625  9371 consensus_meta.cc:287] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.013s
I20260709 13:03:14.461999  9374 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.525529  1683 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:14.532559  9365 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:14.532611  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.485152  9259 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.538007  1607 raft_consensus.cc:2468] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:03:14.543077  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.544951  8391 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.546483  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.562124  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.562536  2252 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:14.540343  9159 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.380175  8797 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.549636  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.530869  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.553663  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.420691  9288 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.567607  1604 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:14.521706  9240 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.525322  9257 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:03:14.570075  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.443665  9247 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.565523  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:14.566401  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 151769us
I20260709 13:03:14.495882  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.557343  9008 raft_consensus.cc:2804] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:14.564275  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.495294  9292 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.532738  9223 consensus_queue.cc:1059] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:03:14.558740  9161 tablet_copy_client.cc:538] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:14.573251  8391 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.533367  9238 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.560523  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.596176  2257 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.596376  2252 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:14.558595  9372 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.540717  9264 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.585057  2256 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:14.585135  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.600687  2259 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.606015  9240 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:14.600611  1604 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:14.609560  8797 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.609866  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.610164  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.611693  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.612460  9374 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.613932  9312 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.570276  9159 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.617769  2255 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 13:03:14.586565  1675 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:14.586782  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.524501  9380 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.593571  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.619916  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.620576  9380 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.406915  9363 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:14.620833  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3370) took 2422 ms. Trace:
I20260709 13:03:14.621186  1677 rpcz_store.cc:276] 0709 13:03:12.198510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.205100 (+  6590us) service_pool.cc:224] Handling call
0709 13:03:12.205408 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.199203 (+993795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.620549 (+1421346us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54003ab954. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:14.620749 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283837312}
I20260709 13:03:14.450423  9225 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 11 to 15, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:14.622637  1677 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:14.566272  9365 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:14.594388  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.624558  1609 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.625339  9274 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.594791  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.616786  9257 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:14.626350  2254 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:14.626992  9365 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.559882  9376 consensus_queue.cc:1059] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:14.630823  9376 consensus_queue.cc:1243] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer b8ff9782cd95483c905cd1d906f41aaf log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:14.631326  9376 raft_consensus.cc:3055] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:14.631759  9376 raft_consensus.cc:740] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:14.608421  9008 raft_consensus.cc:697] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:14.624608  9247 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.635449  9008 consensus_queue.cc:237] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.637279  9170 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.639464  9159 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.421226  9256 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.645043  9238 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.631389  9038 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.608052  9394 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:14.657617  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.657845  1534 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.658257  2261 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:14.639993  2258 raft_consensus.cc:1240] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: [19.15-20.16]
I20260709 13:03:14.660522  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.661234  2258 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:14.661676  2227 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.626016  9257 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:14.662339  9360 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 1.021s	user 0.000s	sys 0.011s
I20260709 13:03:14.662865  9257 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.664052  9257 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:14.633481  9259 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.667114  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.667874  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.668548  2256 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:14.653121  1500 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:14.667820  1606 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.673717  9379 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:14.674526  9379 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.675071  9240 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:14.676119  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.676558  8391 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:14.668215  2253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1783) took 2145 ms. Trace:
I20260709 13:03:14.677589  9364 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:14.657800  9394 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.642848  9264 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.677953  1528 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.643329  9336 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.678269  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.678793  9268 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:14.633437  1574 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.679348  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:14.680025  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46765.8us
I20260709 13:03:14.680847  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8ff9782cd95483c905cd1d906f41aaf" is_pre_election: true
I20260709 13:03:14.681478  1534 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 26.
I20260709 13:03:14.651208  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.677088  8391 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:14.651446  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.661969  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.681054  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.651216  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.632725  9376 consensus_queue.cc:260] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.643415  1533 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:14.681353  9083 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:14.686323  2254 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:14.744189  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.640527  9372 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.677201  2253 rpcz_store.cc:276] 0709 13:03:12.522385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.031319 (+508934us) service_pool.cc:224] Handling call
0709 13:03:13.031596 (+   277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:13.031957 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.031985 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:13.036259 (+  4274us) log.cc:844] Serialized 52 byte log entry
0709 13:03:13.480016 (+443757us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b18004376e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a26e07 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a43c02 00007f7e636cb20b 00007f7e636d0d23 00007f7e636d10d1 00007f7e63aeca0f
0709 13:03:13.643076 (+163060us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:13.680945 (+ 37869us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.830008 (+149063us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18004376e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:03:14.451924 (+621916us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b18004376e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e60a443f3 00007f7e60a467c1 00007f7e60a46779 00007f7e60a46709 00007f7e60a466d1 00007f7e60a459cd 000000000038f354 000000000038f199 00007f7e60a2783a
0709 13:03:14.667690 (+215766us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b18004376e0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6990cde1 00007f7e699195b1 00007f7e636d94bc 00007f7e60a2748b 00007f7e69881ab9 00007f7e60a4369b 00007f7e60a4193f 00007f7e60a41455 00007f7e63b29060 00007f7e63b3b716 00007f7e63b4c287
0709 13:03:14.667835 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.667930 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.667976 (+    46us) raft_consensus.cc:1685] finished
0709 13:03:14.667990 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.668154 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31526,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2655,"raft.queue_time_us":22241,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6230,"spinlock_wait_cycles":51260928,"thread_start_us":174545,"threads_started":2,"wal-append.queue_time_us":653925}
I20260709 13:03:14.759925  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1403) took 1115 ms. Trace:
I20260709 13:03:14.760344  1674 rpcz_store.cc:276] 0709 13:03:13.644167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.682313 (+ 38146us) service_pool.cc:224] Handling call
0709 13:03:14.759722 (+1077409us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5400356bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.759858 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89054080}
I20260709 13:03:14.762226  1681 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:14.735839  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:14.763736  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.736171  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 85018.4us
I20260709 13:03:14.684587  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.765236  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.735262  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.738036  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.742393  8391 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:14.766326  1607 raft_consensus.cc:2368] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 20. Current term is 21.
W20260709 13:03:14.765839  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3422) took 1579 ms (client timeout 1891 ms). Trace:
I20260709 13:03:14.766336  2258 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:14.769716  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1393) took 1473 ms. Trace:
W20260709 13:03:14.767648  1680 rpcz_store.cc:269] 0709 13:03:13.186623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.186732 (+   109us) service_pool.cc:224] Handling call
0709 13:03:14.765677 (+1578945us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001d9a54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.765781 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411869440}
I20260709 13:03:14.771169  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42552 (request call id 3443) took 1128 ms. Trace:
W20260709 13:03:14.767026  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 93502.8us
I20260709 13:03:14.777690  2259 raft_consensus.cc:2410] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:03:14.779000  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.839957  9291 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:14.775713  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.850620  9291 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.851399  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.770080  1676 rpcz_store.cc:276] 0709 13:03:13.296692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.497029 (+200337us) service_pool.cc:224] Handling call
0709 13:03:14.769562 (+1272533us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000e3154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.769651 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524868480}
I20260709 13:03:14.852542  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:14.841655  1600 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 25: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:14.854496  2255 raft_consensus.cc:1240] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:14.840986  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75629.9us
I20260709 13:03:14.559659  9371 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.878118  2258 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:14.806052  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.776772  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.840677  2253 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:14.771528  1682 rpcz_store.cc:276] 0709 13:03:13.643154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.653143 (+  9989us) service_pool.cc:224] Handling call
0709 13:03:14.771022 (+1117879us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54003575d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.771116 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141677312}
W20260709 13:03:14.862478  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 211309us
I20260709 13:03:14.898712  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.865059  1606 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:14.865691  1609 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:14.866539  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.868649  2257 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:14.857492  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.677416  9259 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:14.910647  2261 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:14.871409  2259 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:14.912595  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:14.913391  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 46954.6us
I20260709 13:03:14.677999  9364 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:14.741482  9268 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:14.909503  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3399) took 1161 ms. Trace:
I20260709 13:03:14.970453  1678 rpcz_store.cc:276] 0709 13:03:13.747800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.081271 (+333471us) service_pool.cc:224] Handling call
0709 13:03:14.084123 (+  2852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.235213 (+151090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.235247 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.235293 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:14.235332 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.909227 (+673895us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003296d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:14.909279 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.909438 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346907008}
I20260709 13:03:14.910341  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.901635  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:14.915987  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 139323us
I20260709 13:03:14.973062  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.759485  9223 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.917255  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:14.917912  1499 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:14.918571  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:14.922931  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3395) took 1202 ms. Trace:
I20260709 13:03:14.917098  9170 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.925163  9083 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:14.926102  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.927104  1679 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.927810  9043 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:14.928958  2254 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:14.929335  9259 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:14.911449  9253 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:14.927003  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1400) took 1283 ms. Trace:
I20260709 13:03:14.840458  9393 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:14.934134  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:14.997886  2259 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
I20260709 13:03:14.949066  9389 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.949909  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:15.002010  2252 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:03:14.955276  9345 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:14.957285  9394 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.959833  9372 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:14.960660  9352 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.961596  9200 raft_consensus.cc:3055] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:14.965304  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 104518us
I20260709 13:03:14.856992  9376 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:14.995265  8472 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.967259  9371 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:15.055600  1678 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:14.974454  1604 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:14.974970  1681 rpcz_store.cc:276] 0709 13:03:13.720800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.061996 (+341196us) service_pool.cc:224] Handling call
0709 13:03:14.761966 (+699970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.762659 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.922724 (+160065us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400356bd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.922868 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599758208}
I20260709 13:03:14.979592  2256 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 25.
W20260709 13:03:14.980578  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 66032.1us
I20260709 13:03:14.661681  9292 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:14.764006  9283 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:14.983810  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 65982.8us
I20260709 13:03:14.986140  1608 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:14.974418  1500 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:15.106386  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.987920  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.774842  9336 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:14.761536  9222 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.989547  2261 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 26: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:14.848521  8797 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:03:14.996908  1675 rpcz_store.cc:276] 0709 13:03:13.643441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.885291 (+241850us) service_pool.cc:224] Handling call
0709 13:03:14.926798 (+1041507us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540024b3d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:14.926947 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580533504}
I20260709 13:03:14.734728  9387 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.254s
I20260709 13:03:14.966229  2260 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:14.774478  9247 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.219s
W20260709 13:03:15.010299  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 230968us
I20260709 13:03:15.124472  1605 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:14.989074  9382 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:15.049952  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:15.046382  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 310592us
I20260709 13:03:14.853583  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:15.051786  2252 raft_consensus.cc:2468] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:15.046797  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:14.993693  9043 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.988909  9083 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:14.916432  1607 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 23: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:15.104560  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:15.112407  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:15.112551  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.103444  1647 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:15.115885  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:15.122198  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 134355us
I20260709 13:03:14.994040  9223 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.118240  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:15.131362  1603 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:03:15.135248  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 88516.1us
I20260709 13:03:15.135998  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:15.135217  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:15.047536  9159 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:15.046793  9200 raft_consensus.cc:740] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:14.912128  9304 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.094s
I20260709 13:03:15.045495  9008 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:15.169142  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:15.169816  1680 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:15.145624  1573 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:15.166550  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:15.126641  9291 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:15.128473  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 154113us
I20260709 13:03:15.124123  9371 raft_consensus.cc:2764] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:03:15.137354   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:15.134660  1675 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.131403  1681 raft_consensus.cc:2468] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:15.112063  9363 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.004751  9253 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.145957  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:15.182819  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 79440.5us
I20260709 13:03:15.175915  9336 raft_consensus.cc:2764] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:03:15.114137  9364 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.167505  9159 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:15.184333  9396 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:15.184155  9200 consensus_queue.cc:260] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.184867  9407 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:15.133666  9083 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:15.129976  9043 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:15.134210  8472 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:15.266815  9186 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:15.117511  8797 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.244048  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3400) took 1492 ms. Trace:
I20260709 13:03:15.301349  1679 rpcz_store.cc:276] 0709 13:03:13.751863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.519583 (+767720us) service_pool.cc:224] Handling call
0709 13:03:14.926926 (+407343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.989457 (+ 62531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.243814 (+254357us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540024b3d0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:15.243979 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892989312}
I20260709 13:03:15.250038  1604 raft_consensus.cc:2468] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
W20260709 13:03:15.251260  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69178.9us
I20260709 13:03:15.167871  9283 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:15.304627  9283 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:15.163060  9292 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:15.124450  9222 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.178370  9382 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.186787  1500 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:15.175917  9307 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.263751  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:15.265241  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 119344us
I20260709 13:03:15.189384  9038 raft_consensus.cc:2804] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:15.181298  9008 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.250917  9394 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:03:14.780367  9289 consensus_queue.cc:1175] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "428f0180c2cd487c8b48e91f14dff65d" responder_term: 18 status { last_received { term: 17 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:15.123908  1682 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:03:15.313171  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 126454us
W20260709 13:03:15.314175  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 50507.4us
I20260709 13:03:15.298440  9200 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.328576  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:15.333187  1647 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:15.335583  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:15.256775  9304 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:03:15.295346  9253 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:15.321870  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:15.322592  1573 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.294840  8472 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:15.306118  9283 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.350205  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.350868  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.357250  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.357280  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:15.352430  1574 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.319089  9246 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:03:15.325126  9225 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:03:15.315960  9038 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:15.336751  9364 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:15.366400  2227 leader_election.cc:400] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 20. Current term is 21.
I20260709 13:03:15.379774  2227 leader_election.cc:403] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:15.367949  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:15.368129  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.356580  9407 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:15.357366  9247 raft_consensus.cc:2804] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:15.323573  9238 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:15.360602  8906 raft_consensus.cc:2764] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
W20260709 13:03:15.330525  9402 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:03:15.365154  9372 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.375697  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:15.330459  9186 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:03:15.401250  1608 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:15.375043  9382 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:15.378798  9038 raft_consensus.cc:3060] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.381040  1682 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:15.369546  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:15.367033  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:15.351498  9394 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:15.403896  2227 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:15.360832  9385 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.365932  8886 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:15.391959  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.392943  8797 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:15.393953  9008 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:15.394433  9336 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 20. Current term is 21.
W20260709 13:03:15.394796  9403 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:03:15.319478  9365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.012s	sys 0.033s
I20260709 13:03:15.398204  1603 raft_consensus.cc:1240] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:15.356551  9264 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:15.327135  9345 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:15.323383  9307 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.460700  9307 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:15.371408  9292 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:15.461807  9292 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.462277  9292 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.380493  2256 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:15.401921  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 503224us
I20260709 13:03:15.402402  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:15.465098  1649 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:15.466749  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:15.467442  9031 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:15.468035  9031 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.405048  2258 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:15.405366  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.468998  9008 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:03:15.469547  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64263us
I20260709 13:03:15.469216  8472 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.316336  9363 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:03:15.471683  9170 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:15.410303  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:15.383040  9407 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:15.417066  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:15.417976  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:15.475148  2259 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:15.497159  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:15.497910  1679 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:15.499564  2256 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:15.422782  1675 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:15.399646  9247 raft_consensus.cc:697] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:15.501083  9247 consensus_queue.cc:237] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.434002  1680 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:15.506297  9223 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:15.403272  9296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.006s	sys 0.013s
I20260709 13:03:15.402532  9372 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.414215  9301 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:15.402784  9238 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:15.415877  9371 raft_consensus.cc:2804] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:15.438848  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:15.437060  9365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.013s	sys 0.033s
W20260709 13:03:15.440869  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.005s	sys 0.013s
I20260709 13:03:15.445778  9394 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.426422  9385 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.453277  8977 raft_consensus.cc:3055] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:15.454912  9382 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:15.403848  2261 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:15.493897  9407 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:15.510705  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 100498us
I20260709 13:03:15.410724  9161 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap starting.
I20260709 13:03:15.532241  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:15.535203  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 399237us
I20260709 13:03:15.538717  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:15.532459  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 358813us
I20260709 13:03:15.539644  9274 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:15.540138  8797 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.560334  9304 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:15.561501  9379 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:15.532958  9301 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.569284  9238 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.571417  9372 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:15.579209  9395 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.420s	user 0.001s	sys 0.001s
W20260709 13:03:15.583909  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.494261  9307 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.595412  1679 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:03:15.598681  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:15.464241  9292 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:15.509927  9387 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.511329  9380 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.603650  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:15.637007  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:15.592037  9376 consensus_meta.cc:287] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:03:15.531423  9223 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:15.645147  8797 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.648871  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:15.684912  1677 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:15.642882  9304 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:15.649466  9274 consensus_queue.cc:1059] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:15.656087  9186 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:03:15.666771  9288 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.665944  9291 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:15.651599  9038 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.655155  9170 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.656616  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:15.677510  9031 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:15.658021  9301 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:15.658986  9083 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.660691  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:15.747850  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 87282.5us
I20260709 13:03:15.749681  1498 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:15.665153  2259 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:15.674845  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.600598  8977 raft_consensus.cc:740] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:15.648608  9222 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:15.729454  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.742651  9352 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.002s
I20260709 13:03:15.683009  9393 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.743199  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 379368us
I20260709 13:03:15.657274  9043 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.701759  9385 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:15.681620  9372 consensus_queue.cc:1059] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:03:15.644271  9382 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.682382  9345 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
W20260709 13:03:15.771168  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 96424.1us
I20260709 13:03:15.771661  8391 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:15.778303  8391 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.778602  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:15.687873  9363 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:03:15.686062  9387 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.685592  9223 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.683542  9307 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.685913  9380 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.775060  9264 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:03:15.782533  9417 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.747767  9031 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.754447  9292 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.755048  9365 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:15.794031  1681 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 26.
I20260709 13:03:15.740703  9291 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.796057  8391 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:15.739014  9288 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.706394  9304 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.783404  8782 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:15.806962  8886 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:15.796841  9225 raft_consensus.cc:3055] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:15.775681  9393 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:15.829917  9257 consensus_meta.cc:287] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 1.165s	user 0.012s	sys 0.000s
I20260709 13:03:15.843876  1678 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:03:15.833954  9225 raft_consensus.cc:740] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:15.848493  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 378059us
I20260709 13:03:15.849977  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:15.815986  8977 consensus_queue.cc:260] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.837026  9417 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.876055  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.827400  9292 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.862377  1605 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:15.856428  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 490045us
I20260709 13:03:15.893695  1607 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:15.897552  1674 raft_consensus.cc:2410] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 22 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:03:15.907600  9296 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:15.908265  9296 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:15.909204  9296 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:15.910265  9296 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:15.915393  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.916285  1679 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:03:15.851492  9304 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.889834  8472 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:15.892567  9170 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:15.890726  9257 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:15.933486  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 329434us
W20260709 13:03:15.898447  9364 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.002s
I20260709 13:03:15.895022  9425 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.842609  8886 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:15.923355  9371 raft_consensus.cc:697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:15.932786  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 326166us
I20260709 13:03:15.999161  2258 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:16.000298  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:16.002045  1574 leader_election.cc:400] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Vote denied by peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133) with higher term. Message: Invalid argument: T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18.
I20260709 13:03:15.933387  8797 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.003813  2261 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:16.005797  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.009833  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:15.933564  9038 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:15.935004  8977 raft_consensus.cc:3060] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:16.012373  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 230272us
I20260709 13:03:16.016640  1499 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:16.020236  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:15.958295  9083 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.026791  1499 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:16.002982  9170 raft_consensus.cc:3055] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:16.026791  2256 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 11 to 15, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:16.038573  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.004056  9307 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:15.934721  8472 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.021036  9222 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:03:16.025516  9412 log.cc:927] Time spent T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:03:16.073486  1679 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:16.074787  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:16.079424  1674 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:16.082172  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:15.946157  9257 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:16.075796  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.030498  9417 raft_consensus.cc:2804] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:16.086298  2254 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:03:16.093817  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 174854us
I20260709 13:03:15.945261  9225 consensus_queue.cc:260] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.055047  9223 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.048925  9170 raft_consensus.cc:740] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:16.099664  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.949992  9425 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.009359  9337 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.069s
I20260709 13:03:16.015069  9005 consensus_queue.cc:1059] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:03:16.059497  9394 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.022400  9411 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:03:16.104861  1682 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:16.103219  9031 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.037858  9038 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:03:16.078087  9222 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.069599  9416 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.076743  9419 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:16.117311  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:16.091030  9264 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:16.091338  9417 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:16.120944  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.167675  2254 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:03:16.121587  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 334276us
W20260709 13:03:16.106233  9423 log.cc:927] Time spent T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:03:16.135779  1682 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:16.112000  9186 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:16.145077  1603 raft_consensus.cc:1240] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:16.146245  1607 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:16.106899  9371 consensus_queue.cc:237] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.147133  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.124930  9407 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.148118  1604 raft_consensus.cc:1275] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:16.149793  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.150862  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.152302  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.152685  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.141115  9440 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:16.157368  9429 log.cc:927] Time spent T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:03:16.157914  9418 log.cc:927] Time spent T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 13:03:16.158408  9422 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:03:16.159879  9419 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:16.123795  9291 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.163235  9292 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.144942  9416 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.140834  9331 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.326037  9331 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.170939  9417 raft_consensus.cc:3060] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:16.169003  1674 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:16.331967  8472 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.207789  2252 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:16.138325  9225 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:16.207435  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.142280  9222 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:16.281675  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:16.282455  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 112794us
W20260709 13:03:16.283473  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 137066us
I20260709 13:03:16.286919  1681 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:16.279592  1682 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.145455  9393 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.295542  1607 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:16.302326  9259 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.303330  1604 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:16.303722  9031 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.281162  9301 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.249186  9264 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.288121  9170 consensus_queue.cc:260] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.309291  9440 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.294499  9038 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:16.324018  9407 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.325013  9419 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:16.294338  9424 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:03:16.325629  9043 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.292580  9337 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.286209  9382 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.347687  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.358726  1681 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:03:16.357219  9268 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:16.296759  9186 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.374061  9291 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.406896  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:16.382010  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.384383  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.384662  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.385159  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.408227  1601 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
I20260709 13:03:16.385257  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:16.394022  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.397828  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.372581  1682 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:16.404558  2252 raft_consensus.cc:2393] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:03:16.413362  9431 log.cc:927] Time spent T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:03:16.407753  1604 raft_consensus.cc:2393] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:16.423583  1606 raft_consensus.cc:1275] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:03:16.424091  1606 pending_rounds.cc:85] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 15
I20260709 13:03:16.424335  1606 pending_rounds.cc:107] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:03:16.424564  1606 raft_consensus.cc:2889] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:16.426654  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.427359  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.429966  1649 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:16.400545  9170 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:16.434067  1682 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:16.372174  9364 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:03:16.371985  9031 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.405862  9268 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:16.440479  9251 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:03:16.442415  9268 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.443467  9268 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:16.445995  9031 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.449862  9264 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.455490  9268 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.457794  9268 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.457019  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:16.456357  1682 raft_consensus.cc:1240] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:16.423684  9451 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.406919  9337 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.480589  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:16.400188  9038 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.481913  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:16.482627  9450 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:16.483139  9450 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.483523  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33564 (request call id 1407) took 1143 ms. Trace:
I20260709 13:03:16.483992  9038 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.472807  1675 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:16.497030  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.471662  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.497757  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.496418  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.498864  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:16.499436  1675 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:16.438349  9411 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:16.476691  9202 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.477236  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.478268  9222 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.479630  9394 raft_consensus.cc:3055] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:16.480110  9186 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.484910  9031 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:16.485157  9450 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.485913  9440 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.486388  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:16.486716  9428 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:16.483870  1678 rpcz_store.cc:276] 0709 13:03:15.340488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.340598 (+   110us) service_pool.cc:224] Handling call
0709 13:03:16.483329 (+1142731us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540031b5d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:16.483470 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106320128}
I20260709 13:03:16.476437  9251 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.496156  1601 raft_consensus.cc:3055] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:16.501276  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1802) took 1090 ms. Trace:
I20260709 13:03:16.524361  1681 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:16.524251  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.502562  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.434577  9289 consensus_queue.cc:1048] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:16.416808  9291 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.511094  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.481814  9337 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.512336  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.492165  9257 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.518108  1675 raft_consensus.cc:2468] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:16.520745  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:16.478269  9331 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.501515  2256 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:16.525903  1678 raft_consensus.cc:2410] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:16.524704  1601 raft_consensus.cc:740] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:16.509784  9202 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.527642  9416 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.526173  2257 rpcz_store.cc:276] 0709 13:03:15.410745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.411405 (+   660us) service_pool.cc:224] Handling call
0709 13:03:15.412044 (+   639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.424521 (+ 12477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.424553 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.436922 (+ 12369us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.849383 (+412461us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:15.894854 (+ 45471us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.917996 (+ 23142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.480228 (+562232us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54001ecb54. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:16.480278 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.492950 (+ 12672us) raft_consensus.cc:1685] finished
0709 13:03:16.501037 (+  8087us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.501195 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22849,"prepare.queue_time_us":45347,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":3350,"raft.queue_time_us":25343,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":14023,"spinlock_wait_cycles":27825408,"thread_start_us":316448,"threads_started":1,"wal-append.queue_time_us":651041}
I20260709 13:03:16.468557  9451 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.509549  9394 raft_consensus.cc:740] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:16.531080  9296 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
I20260709 13:03:16.512120  9425 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.507794  9008 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:16.536886  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.566411  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.538772  1604 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 23: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:16.541847  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.544185  1574 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:16.513741  9031 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.554659  2258 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:03:16.554519  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.572908  2252 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:03:16.569406  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.557564  1678 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:16.573678  9352 raft_consensus.cc:2804] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:16.542686  1601 consensus_queue.cc:260] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.523910  9426 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:16.559602  9382 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:16.568014  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.567334  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 26.
I20260709 13:03:16.574048  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.567340  1680 raft_consensus.cc:2468] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:16.578089  9352 raft_consensus.cc:697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:16.578998  9352 consensus_queue.cc:237] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.541432  8886 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:03:16.580492  9382 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.580950  9382 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:16.581796  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.582367  2256 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:16.583215  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:16.575896  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.587586  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.584167  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.559959  9449 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:03:16.574118  1676 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:03:16.599397  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:16.567267  2226 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.517777  9407 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:03:16.596448  9225 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.541281  9005 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 13:03:16.615695  9222 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.574432  9031 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:16.616761  9426 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.626019  9291 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.629532  9417 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.633203  8906 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:16.635548  9257 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.636129  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59799.6us
I20260709 13:03:16.636683  9038 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:16.639173  9301 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.640823  8782 raft_consensus.cc:3055] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:16.642051  9159 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.643410  8472 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.646001  9225 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:16.647586  9455 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:16.603271  2226 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.649202  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1807) took 1118 ms. Trace:
I20260709 13:03:16.650933  9202 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.655409  2255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1803) took 1238 ms. Trace:
I20260709 13:03:16.657832  1676 raft_consensus.cc:1240] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:16.538597  9428 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.549371  9251 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.662889  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:16.663704  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.666131  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.543025  9283 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.061s
I20260709 13:03:16.711139  2255 rpcz_store.cc:276] 0709 13:03:15.416580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.416799 (+   219us) service_pool.cc:224] Handling call
0709 13:03:16.655161 (+1238362us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400660154. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:16.655320 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451103616}
I20260709 13:03:16.693344  1603 raft_consensus.cc:1240] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:16.558336  9331 consensus_queue.cc:1059] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:03:16.714525  9251 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.716741  1603 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:16.717381  9331 raft_consensus.cc:3055] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:16.717785  9331 raft_consensus.cc:740] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:16.718025  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.718708  9331 consensus_queue.cc:260] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.694170  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.720890  1608 raft_consensus.cc:2410] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:16.700384  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.685704  9419 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.721961  9419 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.723002  9428 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.567714  9304 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.127s
I20260709 13:03:16.682232  9222 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:16.725394  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42552 (request call id 3457) took 1673 ms. Trace:
I20260709 13:03:16.725579  9222 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.725894  1677 rpcz_store.cc:276] 0709 13:03:15.052178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.052283 (+   105us) service_pool.cc:224] Handling call
0709 13:03:15.052554 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.685356 (+632802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.725171 (+1039815us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54001081d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:16.725337 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453337344}
I20260709 13:03:16.727299  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.728252  9222 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:16.712975  1679 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:16.701009  8782 raft_consensus.cc:740] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:16.727211  9008 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:16.729717  8782 consensus_queue.cc:260] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.730422  9008 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:16.731317  9225 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.731525  1679 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:16.734231  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.735620  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.732524  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:16.737710  1679 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:03:16.739585  9426 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.544543  9441 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:03:16.725344  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:16.701695  9257 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.739596  1679 pending_rounds.cc:85] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting all ops after (but not including) 15
I20260709 13:03:16.710054  8472 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.744405  8472 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.729007  9417 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.702005  9238 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:16.746531  9238 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.747617  9417 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.748134  9417 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:16.749058  9238 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:16.750075  9417 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.752575  9202 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:03:16.752811  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 188508us
W20260709 13:03:16.753491  2226 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:16.754050  2226 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.754401  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.755151  9336 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:16.755448  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.715065  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.756644  1679 pending_rounds.cc:107] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:03:16.756989  1679 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.761950  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:16.765075  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.765766  2253 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:16.715085  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.738438  9268 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:16.755977  2226 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:16.769699  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.709887  2260 rpcz_store.cc:276] 0709 13:03:15.531187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.531408 (+   221us) service_pool.cc:224] Handling call
0709 13:03:15.601134 (+ 69726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.601353 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:03:15.929528 (+328175us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.021511 (+ 91983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.021592 (+    81us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:16.021696 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.021795 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.648969 (+627174us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b540039ba50. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b308ad 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:16.649128 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378165,"prepare.queue_time_us":88493,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":23,"raft.queue_time_us":66381,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8633,"spinlock_wait_cycles":159331712,"thread_start_us":415672,"threads_started":2,"wal-append.queue_time_us":391955}
I20260709 13:03:16.738966  1683 raft_consensus.cc:1240] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:16.709331  9005 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:16.694576  9083 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:03:16.751928  2251 tablet_service.cc:1558] Processing DeleteTablet for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 with delete_type TABLET_DATA_TOMBSTONED (TS 9b6586a864a94c019cae2d8e2987a7af not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:51320
I20260709 13:03:16.767335  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.785212  1602 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:16.786198  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.720758  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.787328  1604 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 23: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:16.772465  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.773505  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.777437  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:16.720118  9331 raft_consensus.cc:3060] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:16.779160  2226 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.789669  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.783200  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:16.784219  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:16.791354  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:16.792135  2261 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 26: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:16.792977  1683 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:16.793495  1681 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:16.793983  1602 raft_consensus.cc:2393] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 20: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:16.796911  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:16.797379  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:16.799983  2226 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.800453  2226 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:16.801508  2226 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.801903  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.798715  2260 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:16.800606  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.806835  1604 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:16.750082  1432 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.818507  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:16.821220  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:16.821823  2226 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.822310  2226 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.821851  2254 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 25.
I20260709 13:03:16.778720  9005 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:16.826746  8391 consensus_queue.cc:1059] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:03:16.824420  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.827679  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.827648  8391 raft_consensus.cc:3055] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:16.828343  8391 raft_consensus.cc:740] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:03:16.828878  2226 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.829320  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.796195  8886 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:16.803398  9417 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.738461  9008 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.803467  9202 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.840145  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:16.808115  9428 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.823529  9264 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:16.825582  9372 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.795080  9365 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:03:16.842468  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:16.848685  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 154745us
I20260709 13:03:16.851154  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:16.835184  8886 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:16.833664  9336 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:16.832056  9170 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:16.846660  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.839814  9449 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:03:16.867065  9236 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:16.852017  9264 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:16.859967  1500 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:16.871526  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.841696  9442 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.029s
W20260709 13:03:16.878801  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.833002  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 363) took 18440 ms (client timeout 15000 ms). Trace:
W20260709 13:03:16.849356  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 152819us
I20260709 13:03:16.847592  9458 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.835861  8472 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:03:16.841550  9434 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:16.845163  9440 consensus_queue.cc:1059] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:03:16.859563  9417 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.830756  1432 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: leader changed from <none> to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.844700  9364 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:03:16.866128  9256 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:16.865866  9441 raft_consensus.cc:2804] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:16.888655  1648 leader_election.cc:336] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.887697  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:16.897990  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.900679  1683 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:16.928247  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:16.930008  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:16.937801  1683 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: [16.14-17.15]
I20260709 13:03:16.937844  1675 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:16.940708  1647 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:16.930155  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:16.930505  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:16.966638  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.880517  1426 rpcz_store.cc:269] 0709 13:02:58.394247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.412763 (+ 18516us) service_pool.cc:224] Handling call
0709 13:03:16.832909 (+18420146us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:10.212858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:10.213802 (+   944us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:10.213858 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:03:10.213877 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:10.313675 (+ 99798us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:10.313800 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:10.313826 (+    26us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:03:10.315652 (+  1826us) tablet.cc:701] Row locks acquired
0709 13:03:10.315700 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:10.315864 (+   164us) write_op.cc:270] Start()
0709 13:03:10.316019 (+   155us) write_op.cc:276] Timestamp: P: 1783602190315800 usec, L: 0
0709 13:03:10.316055 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:03:10.381705 (+ 65650us) log.cc:844] Serialized 7365 byte log entry
0709 13:03:10.599879 (+218174us) op_driver.cc:464] REPLICATION: finished
0709 13:03:10.764090 (+164211us) write_op.cc:301] APPLY: starting
0709 13:03:10.781141 (+ 17051us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:11.482828 (+701687us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:11.482983 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:12.153993 (+671010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:12.154457 (+   464us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:03:12.154517 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:12.155098 (+   581us) log.cc:844] Serialized 164 byte log entry
0709 13:03:12.226631 (+ 71533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.284730 (+ 58099us) write_op.cc:454] Released schema lock
0709 13:03:12.345082 (+ 60352us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:12.345567 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.345597 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4605573,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":115813,"apply.run_cpu_time_us":56895,"apply.run_wall_time_us":1619260,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79547,"num_ops":18,"prepare.queue_time_us":198752,"prepare.run_cpu_time_us":29876,"prepare.run_wall_time_us":299306,"raft.queue_time_us":50682,"raft.run_cpu_time_us":18803,"raft.run_wall_time_us":103214,"replication_time_us":283649,"thread_start_us":458626,"threads_started":5,"wal-append.queue_time_us":207080,"wal-append.run_cpu_time_us":10234,"wal-append.run_wall_time_us":2071397}]]}
W20260709 13:03:16.970782  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.985630  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45005.4us
W20260709 13:03:16.994786  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 107154us
W20260709 13:03:16.994897  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 64817.8us
W20260709 13:03:17.005023  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 116388us
I20260709 13:03:17.024976  1647 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:17.026000  1647 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:17.024833  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.926252  9465 log.cc:927] Time spent T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:17.023142  9268 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.927691  9382 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:16.901331  9434 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.031066  1432 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.032706  9382 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.033468  9434 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:16.893368  9384 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:17.033187  1432 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 14, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 14 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.034874  9427 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:17.036401  9437 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:17.036178  9428 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:17.037444  9428 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.038056  9387 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.038571  9159 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:17.039021  9159 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:17.039487  9428 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.036455  9202 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:17.039760  9304 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:17.040153  9202 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.040956  9337 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:16.998149  9222 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:03:17.050415  1574 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.042490  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 112551us
I20260709 13:03:17.077244  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:16.925666  9461 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:03:17.039372  9159 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.035389  1432 catalog_manager.cc:5697] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 10 to 12, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:16.898996  9256 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.103116  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:16.927054  9257 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.117291  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.121876  2261 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:16.877012  9005 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:16.994220  9225 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.001066  9426 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:17.127815  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77409.9us
I20260709 13:03:17.001725  9449 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:16.946336  9441 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:17.101910  9428 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:03:17.155634  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.038604  9387 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.076129  9268 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.125607  9458 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.161098  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:17.153892  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 259491us
W20260709 13:03:17.138327  1574 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.162947  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.039254  8391 consensus_queue.cc:260] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.125381  9301 consensus_queue.cc:1059] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
W20260709 13:03:17.163825  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.163841  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.166903  2261 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:17.162410  1498 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:17.167726  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:17.168751  1574 leader_election.cc:336] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.165045  2226 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.148923  1432 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 18, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.170166  1498 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:17.173424  1674 raft_consensus.cc:2393] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:17.129042  9256 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:17.125371  9005 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.174396  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:17.174283  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.171640  1574 leader_election.cc:336] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:16.997233  9365 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.163s
I20260709 13:03:16.893568  8886 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.176443  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.229907  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1810) took 1283 ms. Trace:
I20260709 13:03:17.152650  9288 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:17.231657  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 330395us
I20260709 13:03:17.231571  1574 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.236059  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:17.126511  8977 consensus_queue.cc:1175] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" responder_term: 18 status { last_received { term: 16 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 17. Current term is 18. Ops: [16.14-17.15]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:17.137439  9449 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:17.132493  9426 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:17.137548  9427 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.926844  9264 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:17.239246  2259 rpcz_store.cc:276] 0709 13:03:15.946843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.947177 (+   334us) service_pool.cc:224] Handling call
0709 13:03:16.003786 (+ 56609us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:16.004170 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.004198 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:16.627355 (+623157us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b2c00046908. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e6242aa11 00007f7e6243a372 00007f7e63b6ca01 00007f7e63b3143a 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2
0709 13:03:16.628085 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 13:03:16.892405 (+264320us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:17.164168 (+271763us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.164909 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.164985 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.165027 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:17.229659 (+ 64632us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.229844 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":503,"raft.queue_time_us":41605,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":22121,"spinlock_wait_cycles":10257152,"thread_start_us":471352,"threads_started":2,"wal-append.queue_time_us":247346}
I20260709 13:03:17.177569  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:17.232517  9202 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.268090  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.151324  9225 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.245234  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:17.247509  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75780.4us
W20260709 13:03:17.249318  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 75100.1us
I20260709 13:03:17.274425  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.275362  2259 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:03:17.274374  1574 leader_election.cc:336] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.172509  9337 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.116725  9437 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.162606  9428 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.229403  8472 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:17.230505  9222 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.151523  9441 raft_consensus.cc:3060] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.276124  1574 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.257375  9458 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.172835  9268 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.251135  9425 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.166711  9450 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.255237  9449 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:17.305190  1648 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.310333  1574 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.325124  1432 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:17.352656  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.404930  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 94634.2us
W20260709 13:03:17.407051  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.407601  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.262280  9426 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.408495  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:17.415685  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 110545us
I20260709 13:03:17.173746  9364 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:17.258507  9440 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 13:03:17.287726  9428 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:03:17.414064  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.284611  8472 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:17.416921  1574 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.426678  1432 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 21 to 22, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 22 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.382689  9202 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.433305  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:17.430001  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 172162us
I20260709 13:03:17.311858  9008 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.381047  9304 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.389180  9288 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.435642  8472 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:17.438916  1432 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 17 to 19, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.409008  9337 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.439864  1574 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.449451  1432 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.444983  2261 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:17.439757  9301 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.429061  9291 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.424052  9222 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:17.452229  1574 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.462414  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 284895us
I20260709 13:03:17.466903  1432 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 17, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 17 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:17.471251  9475 log.cc:927] Time spent T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:03:17.472934  9473 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:03:17.437036  9238 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:17.471936  1432 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 19, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:17.476732  9472 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:03:17.478416  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:17.469041  9031 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.000s
I20260709 13:03:17.459470  9479 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.487978  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:17.449965  9288 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.467703  9380 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.445425  9202 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:17.498386  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.456610  9337 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:17.491708  9468 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:03:17.464427  9291 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.494318  8706 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.505482  1432 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 14 to 18, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 18 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:17.509222  9488 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:17.500190  9480 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.501708  9372 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:17.514405  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.492749  9031 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.516037  1432 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 19, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:17.510377  9251 consensus_meta.cc:287] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.001s
I20260709 13:03:17.531023  8782 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.530818  9251 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.532449  9372 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.534228  9337 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.534832  9372 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.535176  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:17.517154  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.517683  9474 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:03:17.518397  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.519058  9288 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:17.517661  9478 log.cc:927] Time spent T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:03:17.536931  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.537143  1677 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 15.
I20260709 13:03:17.538856  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.526691  1432 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:17.542054  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 53996.5us
I20260709 13:03:17.524354  9256 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.513629  9419 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.552924  9450 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.564869  9159 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.542865  9416 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.548786  9288 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.527575  9480 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:17.551301  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:17.552017  1678 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:17.573746  1648 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.571393  1432 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 12 to 16, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 16 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.546845  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:17.515986  9437 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.517161  9488 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.589038  9488 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.593235  9437 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.594146  9437 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.598623  9256 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:17.599768  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52996.2us
I20260709 13:03:17.601043  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:17.602715  1498 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:17.603802  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:17.604475  8706 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.605093  8706 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.605479  9364 raft_consensus.cc:3060] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.605710  8706 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.607824  9480 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:17.609658  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.574157  1676 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:17.526907  9225 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.575882  9492 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:17.577555  1417 catalog_manager.cc:5002] TS 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): delete failed for tablet 5293a667c8bb4fdbb1fa97aaeba1cfc1 because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 11 but the committed config has opid_index of 15
I20260709 13:03:17.554608  9268 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.620515  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:17.623405  1417 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 46010.4us
W20260709 13:03:17.573801  9331 consensus_meta.cc:287] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.776s	user 0.003s	sys 0.009s
I20260709 13:03:17.611338  9450 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:17.625507  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3419) took 1132 ms. Trace:
I20260709 13:03:17.626844  9450 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.627015  1682 rpcz_store.cc:276] 0709 13:03:16.493136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.498656 (+  5520us) service_pool.cc:224] Handling call
0709 13:03:17.613316 (+1114660us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b580011a398. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e60a0cb71 00007f7e60a0ca22 00007f7e69925c09 00007f7e68a7fee0 00007f7e68b490ab 00007f7e68b49131 00007f7e68af70a0 00007f7e68af6984 00007f7e620716d4 00007f7e62071662
0709 13:03:17.625446 (+ 12130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4294016}
I20260709 13:03:17.628490  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:17.628904  9450 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:17.629129  1682 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:17.631575  2258 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:17.633564  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.634245  2258 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:17.634939  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:17.635502  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:17.637005  2255 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:17.622938  9288 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.645569  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.647080  2255 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 27.
I20260709 13:03:17.650481  9202 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.654502  9288 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.638221  8706 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:17.668368  9437 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:17.665939  9352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.010s	sys 0.001s
I20260709 13:03:17.685412  9441 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:17.688146  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.710793  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.711198  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.689373  1683 raft_consensus.cc:1240] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:17.711820  2260 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:17.698223  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:17.717109  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.718878  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:17.666469  9031 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.723737  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.725205  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.726707  8472 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.728417  9480 consensus_queue.cc:1059] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:17.729235  8472 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.729660  9480 raft_consensus.cc:3055] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:17.730098  9480 raft_consensus.cc:740] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:03:17.709549  9352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.011s	sys 0.001s
I20260709 13:03:17.724531  2260 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:17.739316  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:17.710069  9283 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:17.741834  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:17.742607  1601 raft_consensus.cc:3060] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.731037  9480 consensus_queue.cc:260] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.744127  1681 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:17.732590  9488 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:17.671749  8706 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.721465  9038 consensus_queue.cc:1059] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:03:17.743249  9283 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:17.749176  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:17.758512  9497 log.cc:927] Time spent T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:17.753468  9488 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.803740  9488 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.764819  9480 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.768658  1681 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 27.
I20260709 13:03:17.809185  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:17.810925  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:17.822992  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:17.824499  9031 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:17.824931  9031 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.825428  9031 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:17.831473  9288 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:17.832350  1499 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:17.833905  9264 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:17.834388  9264 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 27 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:17.835196  9264 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:17.780053  9384 consensus_meta.cc:287] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.006s
I20260709 13:03:17.848954  9384 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:17.851410  9451 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.854240  9394 consensus_queue.cc:260] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.855402  9394 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.857383  9251 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:17.859498  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42562 (request call id 3429) took 1197 ms. Trace:
I20260709 13:03:17.770361  9426 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:17.773224  9428 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.774820  9441 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:17.776896  9464 log.cc:927] Time spent T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.735s	user 0.003s	sys 0.001s
I20260709 13:03:17.785769  8706 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.795723  9364 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.798192  9449 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.799515  9283 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.867091  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:17.867159  8391 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:17.867897  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.865267  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.896881  2257 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:17.824294  1647 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:17.874747  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3422) took 1380 ms. Trace:
I20260709 13:03:17.866217  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.868866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:17.860579  1677 rpcz_store.cc:276] 0709 13:03:16.661737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.727061 (+ 65324us) service_pool.cc:224] Handling call
0709 13:03:17.859339 (+1132278us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400329bd4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:17.859442 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860897024}
I20260709 13:03:17.867403  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.862948  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3420) took 1369 ms. Trace:
I20260709 13:03:17.879259  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:17.900372  1678 rpcz_store.cc:276] 0709 13:03:16.493376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.577377 (+ 84001us) service_pool.cc:224] Handling call
0709 13:03:16.577612 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.573403 (+995791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.862717 (+289314us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b540031a1d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:17.862891 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240432512}
I20260709 13:03:17.889840  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.871776  2259 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 27: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:17.894114  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.895622  2258 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:03:17.897744  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.903851  1603 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 26.
I20260709 13:03:17.905153  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.903688  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:17.902050  2253 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 16.
I20260709 13:03:17.900527  1680 rpcz_store.cc:276] 0709 13:03:16.493904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.577664 (+ 83760us) service_pool.cc:224] Handling call
0709 13:03:16.600937 (+ 23273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.601296 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.601326 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.613701 (+ 12375us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.856319 (+242618us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:16.856364 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.856433 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.742678 (+886245us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:17.874452 (+131774us) raft_consensus.cc:1685] finished
0709 13:03:17.874472 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.874688 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":32629,"spinlock_wait_cycles":85352832,"thread_start_us":186269,"threads_started":1,"wal-append.queue_time_us":280048}
I20260709 13:03:17.906271  2257 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:17.906948  1603 raft_consensus.cc:1275] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:17.904533  2227 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:17.909438  2260 raft_consensus.cc:2393] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:17.909209  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:17.910015  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 85811.6us
I20260709 13:03:17.910817  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:17.911643  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.908274  9417 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.913388  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.914199  9426 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.877504  9291 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:17.918957  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.878485  9449 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:17.921996  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:17.872706  9428 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.920349  1607 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 15.
W20260709 13:03:17.921480  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.860927  9005 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.900588  1601 raft_consensus.cc:1275] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:03:17.949245  1601 pending_rounds.cc:85] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 15
I20260709 13:03:17.949504  1601 pending_rounds.cc:107] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:03:17.949733  1601 raft_consensus.cc:2889] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.950603  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44446 (request call id 3872) took 1454 ms. Trace:
I20260709 13:03:17.950886  1601 rpcz_store.cc:276] 0709 13:03:16.495696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.495798 (+   102us) service_pool.cc:224] Handling call
0709 13:03:16.496055 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.742007 (+1245952us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b58006fbfd0. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63a8d0aa 00007f7e63b0f447 00007f7e63b27fe7 00007f7e63b297de 00007f7e63b33b49 00007f7e63b34416 00007f7e63b30d8f 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4
0709 13:03:17.950353 (+208346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.950547 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168583552}
I20260709 13:03:17.922333  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.922533  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.909204  9451 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:17.924881  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:17.913360  9417 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.924719  9372 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:17.935818  9251 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.917162  9492 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:17.924979  8977 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.938145  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:17.911949  9268 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:17.920034  9288 consensus_queue.cc:1048] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:03:17.942546  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:17.917014  9225 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.943085  9031 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:17.948575  9427 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.013382  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75310.3us
I20260709 13:03:18.026209  1647 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:18.030313  1679 raft_consensus.cc:1240] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:03:18.027630  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:17.942996  9488 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:18.016278  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 92671.2us
I20260709 13:03:18.019259  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:18.019582  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:18.009990  9385 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:03:18.013532  9301 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.025133  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:18.023559  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 96770.9us
I20260709 13:03:18.011514  9437 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:18.050235  1680 raft_consensus.cc:1240] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:18.049896  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:18.022135  9387 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:18.055454  1603 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:18.055962  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:18.056921  1573 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:18.057924  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.059785  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:18.083436  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.067198  9466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.003s	sys 0.007s
I20260709 13:03:18.068331  9031 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.069643  9488 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:17.985610  9005 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.014460  9451 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.023110  9291 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:18.031598  9251 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:18.024386  9274 consensus_queue.cc:1059] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:03:18.022447  8977 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.095443  1606 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:18.023731  9268 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.078091  9387 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.176707  1603 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 27.
I20260709 13:03:18.143865  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:18.156138  9466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.003s	sys 0.009s
I20260709 13:03:18.125988  9008 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:18.156785  9005 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.078187  9437 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.084476  9426 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:18.125160  1648 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.195137  1648 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:18.196095  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70971.7us
W20260709 13:03:18.197225  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:18.198125  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.157279  9291 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.157508  9451 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.160012  1604 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:03:18.201884  1604 pending_rounds.cc:85] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting all ops after (but not including) 14
I20260709 13:03:18.202162  1604 pending_rounds.cc:107] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:03:18.202427  1604 raft_consensus.cc:2889] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.202857  8391 raft_consensus.cc:3055] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:18.045243  9301 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.160060  1600 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:18.081434  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:18.205430  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 124078us
I20260709 13:03:18.167078  1681 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:18.022529  9492 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.189479  1607 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.198542  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:18.169570  9488 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.051949  9427 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:18.189409  9387 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:18.203248  8391 raft_consensus.cc:740] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:18.222376  8391 consensus_queue.cc:260] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.223390  8391 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:18.211474  1608 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:03:18.227967  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 195947us
W20260709 13:03:18.228091  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 179264us
I20260709 13:03:18.209097  9301 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.200299  9159 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.209447  9083 raft_consensus.cc:2764] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:03:18.225381  9488 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.240715  9222 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:18.263566  9372 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:18.260231  9417 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.262810  9288 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:18.266060  9428 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:18.273614  9512 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:18.290238  9291 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:18.290753  9501 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:03:18.291409  9437 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.298885  9488 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.298610  9428 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.299160  9301 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.300992  9428 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.301560  9301 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.305022  9492 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.306859  9387 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.307518  9427 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:18.288241  9498 log.cc:927] Time spent T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:03:18.309361  9387 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.299782  9451 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:18.347571  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 335320us
W20260709 13:03:18.154605  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.353016  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:18.219028  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:18.377286  9523 raft_consensus.cc:2764] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:03:18.391819  9268 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:18.385622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.396047  9428 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:18.394410  8391 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.275439  9251 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:18.256387  9257 consensus_queue.cc:1048] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:03:18.390431  9301 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.389678  8977 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.398835  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:18.431386  8391 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.433322  9492 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.434592  8391 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.434283  9492 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.436420  9251 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.438712  9492 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:18.441748  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.442867  2261 raft_consensus.cc:2410] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:03:18.452544  9301 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.459045  9428 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.462385  8391 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:18.463163  8391 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.463505  9428 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.465508  8391 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.467754  9301 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:18.470012  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 212061us
I20260709 13:03:18.471861  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:18.472044  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.473376  1674 raft_consensus.cc:2410] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:03:18.474737  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:18.474887  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:18.476805  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 179585us
I20260709 13:03:18.486756  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:18.488392  9337 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:18.490073  8886 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:18.491000  9337 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.491535  9337 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.491904  9337 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.494319  9522 log.cc:927] Time spent T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:03:18.496608  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.488492  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:18.541436   431 tablet_copy_service.cc:362] P b8ff9782cd95483c905cd1d906f41aaf: Destroying tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2d85e1fb5b4b419c96d985561042498a due to service shutdown
W20260709 13:03:18.541659  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 343423us
I20260709 13:03:18.542222   431 tablet_copy_service.cc:434] P b8ff9782cd95483c905cd1d906f41aaf: ending tablet copy session 9b6586a864a94c019cae2d8e2987a7af-2d85e1fb5b4b419c96d985561042498a on tablet 2d85e1fb5b4b419c96d985561042498a with peer 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:18.545740  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 57495.6us
W20260709 13:03:18.552561  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.554829  9460 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 1.670s	user 0.000s	sys 0.011s
I20260709 13:03:18.557665  9520 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:18.558228  9520 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.558653  9520 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:18.560642  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1748) took 2004 ms. Trace:
I20260709 13:03:18.561175  2256 rpcz_store.cc:276] 0709 13:03:16.555842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.589106 (+ 33264us) service_pool.cc:224] Handling call
0709 13:03:16.589778 (+   672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.590228 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.590259 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.590713 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.771472 (+180759us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:16.771514 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.771576 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.511848 (+1740272us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b24002fbb38. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e608ca9c4 00007f7e608c8acb 00007f7e60a83dc9 00007f7e60a83a55 00007f7e60a8309d 00007f7e636b510e 00007f7e636cc88c 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221
0709 13:03:18.560076 (+ 48228us) raft_consensus.cc:1685] finished
0709 13:03:18.560096 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.560459 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3372,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":17983360,"thread_start_us":180235,"threads_started":1,"wal-append.queue_time_us":274745}
I20260709 13:03:18.563669  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42562 (request call id 3437) took 1511 ms. Trace:
I20260709 13:03:18.564407  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:18.564177  1675 rpcz_store.cc:276] 0709 13:03:17.052586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.052731 (+   145us) service_pool.cc:224] Handling call
0709 13:03:17.053108 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.381682 (+328574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.381711 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.382147 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.498049 (+115902us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:17.498091 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.562898 (+1064807us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540024aed4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b31e01 00007f7e63b3083e 00007f7e68af5419 00007f7e6206cbd4 00007f7e6206cb62 00007f7e6206ca91 00007f7e6206ca0c 00007f7e6206bcc2 00007f7e61e6c48c 00007f7e61e6b8c6
0709 13:03:18.562984 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.563059 (+    75us) raft_consensus.cc:1685] finished
0709 13:03:18.563075 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.563465 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3944,"raft.queue_time_us":2791,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":23646,"spinlock_wait_cycles":751649024,"thread_start_us":84609,"threads_started":1,"wal-append.queue_time_us":171630}
I20260709 13:03:18.569272  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.571367  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.572505  1604 raft_consensus.cc:2393] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 25: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:18.572659  9517 consensus_queue.cc:1059] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:18.574249  9301 raft_consensus.cc:3055] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:18.574702  9301 raft_consensus.cc:740] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:18.560758  9426 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.577381  9426 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.585430  9222 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:18.586617  9222 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:18.588582  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.580617  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.576267  9301 consensus_queue.cc:260] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:18.591475  1648 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.592567  9426 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.589184  9008 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.600217  9008 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.601779  1679 raft_consensus.cc:1240] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:18.605443  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:18.606029  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.606940  9352 raft_consensus.cc:3055] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:18.607398  9352 raft_consensus.cc:740] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:18.606978  1604 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:18.614135  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.615572  9513 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:18.616060  9513 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.616559  9513 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.619164  9283 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:18.595882  9301 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:18.630051  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.640795  1649 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:18.641204  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.642439  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51103.8us
I20260709 13:03:18.652774  9352 consensus_queue.cc:260] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:18.655643  9525 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
W20260709 13:03:18.670051  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 44894.4us
I20260709 13:03:18.678949  2227 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.679358  9225 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:18.679958  9225 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.680034  9170 consensus_queue.cc:1048] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:18.680449  9225 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:18.689109  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 75421.8us
I20260709 13:03:18.671941  9490 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.710966  9372 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:18.712885  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:18.706101  9352 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.711393  9225 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:18.719168  1648 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.722306  1609 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 24.
I20260709 13:03:18.724156  9520 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.739898  9458 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.740185  9520 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:18.743738  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 65142.4us
I20260709 13:03:18.744653  1648 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:18.743752  9225 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.740584  9345 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.786365  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:18.788676  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 122331us
I20260709 13:03:18.788829  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.789772  1601 raft_consensus.cc:2393] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 27: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:18.791261  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:18.792398  9257 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:18.793129  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 120308us
W20260709 13:03:18.794145  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.794203  9222 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:18.794869  1648 leader_election.cc:336] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.795305  1648 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:18.796522  9345 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:18.797318  9530 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:18.784202  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.802421  9345 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.773528  9458 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.806565  9458 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.806926  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.777208  9251 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:18.808955  9337 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.811363  9365 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:18.812743  9442 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:18.814162  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:18.816488  1604 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:03:18.796355  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.820140  9225 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:18.825040  9518 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:18.825644  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:18.826680  2256 raft_consensus.cc:2410] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:03:18.832942  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.834736  1679 raft_consensus.cc:1240] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 24. Current term is 25. Ops: []
W20260709 13:03:18.838651  1648 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:18.812942  9365 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:03:18.841529  9257 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:18.842157  9257 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:18.845721  9301 consensus_queue.cc:1059] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:18.846932  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:18.847837  9417 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:18.848790  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:18.828624  9008 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.851882  9008 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.853418  9417 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:18.854570  9417 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:18.857336  9337 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:18.838897  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47771.4us
I20260709 13:03:18.846887  9301 raft_consensus.cc:3055] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:18.862869  9301 raft_consensus.cc:740] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:18.863837  9301 consensus_queue.cc:260] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.865018  9517 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.865669  9517 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.868046  9517 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:18.869899  1573 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.871381  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.872061  9517 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:18.879515  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.881476  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:18.881935  9031 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:18.882400  1602 raft_consensus.cc:2410] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:03:18.876942  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:18.839239  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:18.886791  9031 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.894868  9301 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:18.851874  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:18.878162  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:18.929930  1608 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.935748  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:18.938661  2259 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:18.939845  9031 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.856942  9417 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.943578  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:18.931872  9222 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:18.955827  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.856992  9513 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:18.960124  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:18.960479  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 108942us
W20260709 13:03:18.961002  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 76097.3us
I20260709 13:03:18.964510  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:18.967092  9516 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.973534  9516 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.968942  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:18.973980  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:18.974175  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:18.974714  2254 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.974825  8391 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:18.975559  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.942584  9251 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:18.976178  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:18.976410  9251 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.977025  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a63db4a447849f8a1a34a53cd5ccefa" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.977941  1677 raft_consensus.cc:2393] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:18.978798  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.979053  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.982205  9419 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:18.982898  9419 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:18.974678  2257 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:18.974932  9512 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.983510  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:18.983973  9512 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.984659  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:18.985544  9372 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:18.986194  9372 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:18.986562  2227 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:18.987639  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:18.974920  2255 raft_consensus.cc:3060] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:19.001987  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.002766  1682 raft_consensus.cc:1240] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 24. Current term is 25. Ops: [24.20-24.20]
I20260709 13:03:19.003298  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.004341  9519 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:19.010217  9251 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.012578  9513 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.014518  9257 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.017078  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.017998  1603 raft_consensus.cc:2393] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 17: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:19.021462  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.022213  2255 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:19.022675  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:19.012645  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 174089us
I20260709 13:03:19.023263  1609 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25.
I20260709 13:03:19.028872  2259 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:19.035972  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.037541  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:19.038612  2226 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:41753 timed out after 1.593s (SENT) [suppressed 83 similar messages]
I20260709 13:03:19.038873  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.002043  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.039543  1601 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:18.987221  9512 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.041162  1683 raft_consensus.cc:2393] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 23: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:19.039217  1500 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:18.989266  9345 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:19.039249  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.051257  1678 raft_consensus.cc:2393] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:19.040987  9372 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.059156  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:19.062857  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.054457  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.041509  9458 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:19.067860  1674 raft_consensus.cc:2393] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 27: Already voted for candidate b8ff9782cd95483c905cd1d906f41aaf in this term.
I20260709 13:03:19.045625  9513 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.039395  9437 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:19.012588  9516 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.080226  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:19.076727  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:19.085359  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:19.067368  9283 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.092413  2252 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.076537  9512 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:19.070690  9458 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:19.080325  9345 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.100232  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:19.100440  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.101222  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.083441  9264 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:19.101732  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.102265  9236 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:03:19.103061  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53835.4us
I20260709 13:03:19.103894  2256 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:19.099642  9532 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:19.103528  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:19.107124  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 117989us
I20260709 13:03:19.121961  1674 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:19.116228  1677 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
W20260709 13:03:19.123382  2226 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.092036  9257 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.124702  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:19.126734  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 87544.7us
I20260709 13:03:19.133044  1682 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:03:19.103736  9428 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.128460  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.138566  2254 raft_consensus.cc:2468] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:19.117516  9458 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:19.104754  9512 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.122730  1605 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:19.106129  9437 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:19.145604  1681 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:19.120419  9236 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.155891  1678 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:19.153846  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.158993  1680 raft_consensus.cc:1240] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:19.159842  1679 raft_consensus.cc:1240] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:19.125581  9170 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.162577  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:19.166510  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.106798  9283 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:19.141070  9264 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:19.167413  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.153179  9512 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:19.177783  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.159166  9236 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:19.132894  9513 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.170554  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:19.187635  9550 consensus_queue.cc:1059] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:03:19.166191  9417 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.168661  9428 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.170478  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:19.183530  9419 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:19.196938  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 59975.6us
I20260709 13:03:19.187623  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:19.197751  1681 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:19.149838  9345 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.200141  9283 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.207392  1674 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:19.211663  2256 raft_consensus.cc:2468] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:19.228509  1607 raft_consensus.cc:2468] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 25.
I20260709 13:03:19.230399  1647 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.231010  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.218604  9516 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:19.179286  9170 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.215231  9417 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.226982  9236 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:19.236543  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 69168us
W20260709 13:03:19.266963  1648 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.275624  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.273905  2254 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:19.232265  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:19.261127  1647 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:19.308921  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47857.2us
I20260709 13:03:19.236122  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.304358  1603 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:19.255420  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:19.305480  2252 raft_consensus.cc:2468] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 17.
I20260709 13:03:19.266369  1608 raft_consensus.cc:2468] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:19.320487  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.309737  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:19.326432  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.266963  9251 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:19.295222  9513 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.278810  9547 raft_consensus.cc:3060] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.298050  9170 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.313620  9516 raft_consensus.cc:2804] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:19.335431  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:19.339581  1498 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf -> Peer 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185): Couldn't send request to peer 9b6586a864a94c019cae2d8e2987a7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:19.347725  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 45696.2us
I20260709 13:03:19.277782  9550 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.332628  9251 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.357321  9553 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:19.298187  9458 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.364113  9257 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:03:19.364677  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 97758.9us
I20260709 13:03:19.356287  9251 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:19.318491  9264 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.376156  2256 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:19.364610  9236 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.367512  9466 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:19.382858  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:19.385373  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 75726.2us
I20260709 13:03:19.385492  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.368108  9257 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.386234  1647 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:19.387272  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 220769us
I20260709 13:03:19.372550  9170 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.368952  9516 raft_consensus.cc:697] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:19.325505  9437 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.371837  9513 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:19.395505  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 318966us
I20260709 13:03:19.363287  9550 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.382014  9488 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:19.403909  2226 leader_election.cc:336] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.385088  9466 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.389456  9257 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:19.411089  2226 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.384219  9555 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:19.392342  9236 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.396276  9428 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.407845  9345 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.415458  9466 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:19.435045  9516 consensus_queue.cc:237] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.425015  9511 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:03:19.448613  1574 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.443005  9291 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:19.441040  9170 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:19.442195  1647 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.415342  9488 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.461968  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 206663us
I20260709 13:03:19.463163  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:19.473543  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 76682.6us
W20260709 13:03:19.474400  2226 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.453058  9417 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.474823  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.440671  9236 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.478343  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52220us
I20260709 13:03:19.487905  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.489996  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.483659  9458 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.495298  9492 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:19.504433  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 70074.9us
I20260709 13:03:19.496292  1677 raft_consensus.cc:2393] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 26: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:19.490025  9170 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:19.501523  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:19.494833  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 60645.5us
I20260709 13:03:19.494554  9345 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:19.513958  9503 log.cc:927] Time spent T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:03:19.514669  9490 raft_consensus.cc:3055] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:19.515170  9490 raft_consensus.cc:740] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:19.516849  9547 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:19.519531  9544 log.cc:927] Time spent T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
W20260709 13:03:19.520907  9557 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:19.521486  9570 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:03:19.522660  2259 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:03:19.528432  1649 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.514564  9458 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.536875  9337 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:19.509336  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.538365  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:19.540526  9458 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.542939  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.543727  2259 raft_consensus.cc:2393] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:19.544477  9291 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.544624  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.544970  9291 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.545281  9513 raft_consensus.cc:2804] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:19.546192  9225 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.547036  9225 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.547899  9492 raft_consensus.cc:697] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:19.549052  9225 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.548894  9492 consensus_queue.cc:237] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.550294  9337 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.550767  9571 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:19.551390  9571 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.552290  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.553674  9571 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.547307  9291 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:03:19.557335  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.558585  2255 raft_consensus.cc:1240] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:03:19.559788  9550 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.561141  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.562521  9337 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.563143  9337 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.563743  9337 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.566392  9337 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.567425  9458 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.568357  9488 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.576143  9257 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.577502  1678 raft_consensus.cc:2368] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 24. Current term is 25.
I20260709 13:03:19.578665  9257 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.579839  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:19.580359  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:19.580884  1607 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:19.584386  9542 log.cc:927] Time spent T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.461s	user 0.003s	sys 0.000s
W20260709 13:03:19.587618  1574 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.588163  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:19.589699  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:19.590912  1574 leader_election.cc:336] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.591315  1574 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.593106  1647 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.592207  9186 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:03:19.598526  2259 raft_consensus.cc:2468] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
W20260709 13:03:19.553838  9561 log.cc:927] Time spent T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:19.599947  1647 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:19.600831  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 127304us
I20260709 13:03:19.606586  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:19.606981  1574 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:19.610042  1648 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.610563  1648 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.612480  1603 raft_consensus.cc:1240] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Rejecting Update request from peer b88b12b461734b3aa6a3da4f5c22c79b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:19.618396  1607 raft_consensus.cc:2468] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 25.
I20260709 13:03:19.620661  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.622121  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.622879  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:19.619998  1649 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:19.630466  1601 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:19.630713  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.606760  9519 raft_consensus.cc:2804] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:19.622300  1573 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:19.636873  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:19.634143  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.645443  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:19.625489  9428 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.645797  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.653416  1608 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
W20260709 13:03:19.657222  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.609846  9337 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.607316  9520 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.608101  9553 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
W20260709 13:03:19.663962  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.651109  1573 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:19.662744  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:19.680004  1601 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:19.620291  8977 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.624040  9257 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:19.680995  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:19.635079  9511 raft_consensus.cc:2804] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:19.619951  9571 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:03:19.662801  9225 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:19.662925  9352 raft_consensus.cc:2804] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:19.684938  9257 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:19.701797  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:19.682119  9236 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.706596  1607 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
W20260709 13:03:19.713001  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.731329  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 85973.8us
I20260709 13:03:19.693167  9337 raft_consensus.cc:2804] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:19.731956  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:19.730716  9574 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:19.732226  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:19.735740  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 132478us
I20260709 13:03:19.700450  9511 raft_consensus.cc:697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:19.729707  9257 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:19.728801  9352 raft_consensus.cc:697] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:19.693385  9520 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:19.748689  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 109300us
I20260709 13:03:19.691605  8977 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.692734  9428 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.742252  9513 raft_consensus.cc:697] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:19.746253  9337 raft_consensus.cc:697] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:19.761312  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:19.743067  9555 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:19.705324  9553 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.731521  9518 consensus_queue.cc:1059] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:19.764976  9513 consensus_queue.cc:237] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.780743  9416 consensus_queue.cc:1059] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:03:19.782678  9569 raft_consensus.cc:3055] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:19.782970  9520 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.791039  9490 consensus_queue.cc:260] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.796463  9161 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.798172  9161 tablet_bootstrap.cc:492] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Bootstrap complete.
I20260709 13:03:19.799239  9161 ts_tablet_manager.cc:1403] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Time spent bootstrapping tablet: real 4.423s	user 0.086s	sys 0.031s
I20260709 13:03:19.755554  9159 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:19.803750  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:19.805207  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:19.806531  9372 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:19.806619  9458 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:19.776378  9518 raft_consensus.cc:3055] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:19.808171  9518 raft_consensus.cc:740] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:19.809058  9518 consensus_queue.cc:260] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.810269  9518 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:19.813617  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 122958us
I20260709 13:03:19.814875  9569 raft_consensus.cc:740] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:19.815922  9569 consensus_queue.cc:260] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:19.827354  8391 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.827926  8391 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.764576  9512 consensus_meta.cc:287] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:03:19.761868  9186 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:19.767129  9170 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:19.839679  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:19.840492  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.830291  9551 log.cc:927] Time spent T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.448s	user 0.000s	sys 0.006s
W20260709 13:03:19.838126  9558 log.cc:927] Time spent T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.474s	user 0.005s	sys 0.000s
I20260709 13:03:19.762518  9466 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.856490  2226 leader_election.cc:400] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 24. Current term is 25.
I20260709 13:03:19.845062  9490 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:19.864713  9577 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:03:19.866539  9572 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:03:19.868532  8977 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:19.868436  9337 consensus_queue.cc:237] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.864620  1680 raft_consensus.cc:1240] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Rejecting Update request from peer 428f0180c2cd487c8b48e91f14dff65d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:19.849025  9437 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:19.837677  9512 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.885922  9543 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.709s	user 0.006s	sys 0.000s
W20260709 13:03:19.892477  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 49805.3us
I20260709 13:03:19.892652  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:19.893487  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49526 (request call id 1582) took 1014 ms. Trace:
I20260709 13:03:19.893890  1604 rpcz_store.cc:276] 0709 13:03:18.878600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.887169 (+  8569us) service_pool.cc:224] Handling call
0709 13:03:18.922787 (+ 35618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.948161 (+ 25374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.948270 (+   109us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.028614 (+ 80344us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.281171 (+252557us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:19.281207 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.281265 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.805835 (+524570us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e608ccdb1 00007f7e6096ac85 00007f7e6096b6a2 00007f7e636dd1db 00007f7e636d8aaf 00007f7e636cc86e 00007f7e636cbbb6 00007f7e636cb7d8 00007f7e636d5221 00007f7e636d51d9 00007f7e636d5169
0709 13:03:19.893155 (+ 87320us) raft_consensus.cc:1685] finished
0709 13:03:19.893175 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.893423 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5212,"raft.queue_time_us":2471,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3938,"spinlock_wait_cycles":3556736,"thread_start_us":230336,"threads_started":1,"wal-append.queue_time_us":310756}
I20260709 13:03:19.895998  9466 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.901777  9520 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.902364  8391 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.902396  9520 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.859519  9511 consensus_queue.cc:237] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.946708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 49215.7us
I20260709 13:03:19.860843  9352 consensus_queue.cc:237] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.944785  9458 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:19.962697  9458 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:19.964818  9458 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:19.974923  8391 consensus_queue.cc:1059] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:19.975950  8391 raft_consensus.cc:3055] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:19.976475  8391 raft_consensus.cc:740] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:03:19.974992  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 323950us
I20260709 13:03:19.985725  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:19.989625  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.990895  8391 consensus_queue.cc:260] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:19.993392  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 348166us
I20260709 13:03:19.992442  1679 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:19.975297  9520 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:19.998306  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.005658  8391 raft_consensus.cc:3060] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:20.006778  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:19.992141  9236 raft_consensus.cc:2804] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:20.007529  1679 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
W20260709 13:03:20.001163  9251 consensus_meta.cc:287] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.002s
I20260709 13:03:19.994333  9553 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.009342  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:20.014665  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.002638  9257 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.015833  1609 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:20.017449  9257 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.013240  9492 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.009400  9236 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.024215  8977 consensus_queue.cc:1059] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:03:20.028120  8977 raft_consensus.cc:3055] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:20.028503  8977 raft_consensus.cc:740] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:20.029191  9428 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.028611  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:20.035149  1601 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:20.014603  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:20.044066  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:20.045307  1609 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:20.046664  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:20.047281  1601 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:19.993259  9519 raft_consensus.cc:697] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:20.029417  8977 consensus_queue.cc:260] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.050966  8977 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:20.026887  9236 raft_consensus.cc:3060] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:20.026075  9512 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.035233  9170 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:20.052706  9581 log.cc:927] Time spent T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:03:20.069777  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 55200us
I20260709 13:03:20.075753  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.076020  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:20.081310  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:20.082475  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:20.080010  2261 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 27.
I20260709 13:03:20.032430  9251 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.068507  9170 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.026329  9492 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.103103  1602 raft_consensus.cc:1240] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:20.098423  9567 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:20.104135  9567 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:20.105171  9567 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.106297  9589 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:03:20.107332  9161 raft_consensus.cc:359] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:20.053403  9553 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:03:20.108263  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:20.111526  2258 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:20.116039  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:20.118539  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.119585  2258 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
W20260709 13:03:20.119975  1648 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:20.120951  1648 leader_election.cc:336] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.121327  1648 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:20.121681  1574 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.133605  1609 raft_consensus.cc:2468] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:20.122038  9513 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:20.084530  9437 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:20.135228  1649 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:20.139752  1601 raft_consensus.cc:2468] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:20.124657  9352 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:20.141412  9352 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.141575  9512 raft_consensus.cc:2804] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:20.141819  9352 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:20.142463  1648 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.143519  9588 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:20.143970  9588 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.144466  9519 consensus_queue.cc:237] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.147022  9512 raft_consensus.cc:697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
W20260709 13:03:20.147784  9582 log.cc:927] Time spent T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 13:03:20.108198  9161 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Initialized, Role: LEARNER
I20260709 13:03:20.148449  9512 consensus_queue.cc:237] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.148957  9161 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:20.150931  9569 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:20.154137  9492 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.160544  9555 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:20.161229  9555 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.154160  9161 ts_tablet_manager.cc:1434] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: Time spent starting tablet: real 0.354s	user 0.000s	sys 0.010s
I20260709 13:03:20.163785  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.165995  9352 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:20.166888  9574 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.167456  9574 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.102805  9170 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.169806  9574 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.172735  9251 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.172829  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.156047  9437 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:20.177424  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 55767.1us
I20260709 13:03:20.178510  9437 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.181095  9437 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:20.181895  9588 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:20.198026  9583 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 13:03:20.218784  1647 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:20.221289  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:20.222100  2255 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:20.225310  9251 raft_consensus.cc:2804] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:20.229179  2259 raft_consensus.cc:1275] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:20.231563  9251 raft_consensus.cc:697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:20.234335  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:20.234776  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:20.235407  1600 raft_consensus.cc:2393] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 25: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:20.235775  9591 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:20.236202  9591 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.236658  9591 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:20.254767  2255 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:20.263096  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.264638  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.265484  1678 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:20.302470  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:20.304272  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:20.304908  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 162448us
I20260709 13:03:20.314244  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:20.323647  1679 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:03:20.322268  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.321384  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:20.327147  1678 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:20.327466  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.327080  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.333458  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.334319  2255 raft_consensus.cc:2393] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:20.336580  2257 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 13:03:20.337647  2226 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.338340  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.340683  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:20.340551  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.343370  2259 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEARNER]: Advancing to term 18
W20260709 13:03:20.345345  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.309190  9301 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.312500  8977 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.353026  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.353504  2252 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:03:20.346241  1574 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.312716  9555 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.309494  9352 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.364363  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:20.367766  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.367787  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:20.364249  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.233477  9251 consensus_queue.cc:237] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.372151  1607 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:20.384146  1574 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.384608  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.386121  9186 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:20.354476  9236 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.364566  9428 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:20.371361  8977 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:20.407495  1607 raft_consensus.cc:2468] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:20.374042  9283 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:20.378536  9365 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.364838  9301 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.373590  9555 consensus_queue.cc:1059] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:03:20.418887  2252 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:20.422041  9236 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.427606  1679 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:20.439733  2253 raft_consensus.cc:3060] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:20.445878  9170 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.449892  9301 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.450613  1606 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:20.450995  9518 consensus_queue.cc:1048] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:20.451882  8977 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.456696  9555 raft_consensus.cc:3055] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:20.457190  9555 raft_consensus.cc:740] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:20.457983  9555 consensus_queue.cc:260] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.459309  9555 raft_consensus.cc:3060] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:20.447108  1431 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 20 to 21, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.450899  1647 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:20.461475  9519 raft_consensus.cc:2804] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:20.462049  9519 raft_consensus.cc:697] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:20.463068  9519 consensus_queue.cc:237] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.477628  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
W20260709 13:03:20.480515  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 140820us
I20260709 13:03:20.482992  2252 raft_consensus.cc:1275] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 13:03:20.482380  2226 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.486174  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.487879  2253 raft_consensus.cc:1275] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:03:20.518810  2226 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.519306  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.520419  9518 consensus_queue.cc:1048] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:20.522486  9513 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:20.524132  9257 consensus_queue.cc:1048] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:20.520115  9574 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:20.528263  9588 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:20.530750  9588 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:20.549623  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 165475us
W20260709 13:03:20.553248  1574 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:20.556818  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.556102  1574 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.420580  9365 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:20.562314  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43548.1us
W20260709 13:03:20.591367  2226 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.600467  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.562134  9170 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:20.610000  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 56800.6us
W20260709 13:03:20.610805  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 234366us
W20260709 13:03:20.613629  1574 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.614104  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.616559  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:20.617249  1601 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.598431  9236 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.658810  2257 raft_consensus.cc:1275] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:03:20.658021  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44423.1us
I20260709 13:03:20.598678  9428 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.665297  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:20.665475  1574 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.550457  1431 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: config changed from index -1 to 11, term changed from 21 to 22, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added, no longer has a pending config: VOTER b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193), VOTER 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194), VOTER b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.609158  9416 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.667299  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:20.676578  1574 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.677174  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.690620  2261 raft_consensus.cc:1275] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:03:20.649123  9588 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:20.646726  9601 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.664064  9251 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.732180  1601 raft_consensus.cc:2468] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:20.719750  9301 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:20.650179  9518 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.612025  9337 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.635704  9236 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.690079  9365 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.720063  9602 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:20.721773  9283 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:20.690310  9437 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:20.721000  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44452.3us
W20260709 13:03:20.748852  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 138238us
W20260709 13:03:20.766362  1574 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:20.767570  1574 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:20.769748  1574 leader_election.cc:336] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:20.771725  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:20.772543  9520 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:20.773554  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:20.691437  9416 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.744445  9606 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:20.785040  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:20.736588  9251 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:20.791358  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 155026us
I20260709 13:03:20.734248  9601 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.796113  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:20.785743  1431 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 21 to 23, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 23 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.799151  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.766089  9518 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:20.797204  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 336) took 20303 ms (client timeout 15000 ms). Trace:
I20260709 13:03:20.805752  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:20.801755  1675 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:20.798753  1499 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:20.806835  1683 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 26.
I20260709 13:03:20.807341  1431 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 16 to 17, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.788779  9574 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:03:20.808377  1499 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:20.771123  9437 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.771261  9602 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:20.818652  9591 consensus_meta.cc:287] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.002s
I20260709 13:03:20.820956  9591 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.822078  9602 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.823726  9591 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.827907  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:20.814108  9595 log.cc:927] Time spent T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:03:20.812969  9550 raft_consensus.cc:3060] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:20.811522  9569 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:20.846258  9569 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 26 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:20.847298  9569 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:20.852469  9616 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:20.853286  9616 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:20.854296  9616 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.864172  9601 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:20.806197  1432 rpcz_store.cc:269] 0709 13:03:00.327101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.327283 (+   182us) service_pool.cc:224] Handling call
0709 13:03:20.618378 (+20291095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:18.300299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:18.300927 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:18.300968 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:18.300987 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:18.302410 (+  1423us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:18.302474 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:18.302504 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:03:18.303701 (+  1197us) tablet.cc:701] Row locks acquired
0709 13:03:18.303719 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:18.303870 (+   151us) write_op.cc:270] Start()
0709 13:03:18.304004 (+   134us) write_op.cc:276] Timestamp: P: 1783602198303818 usec, L: 0
0709 13:03:18.304025 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:18.316877 (+ 12852us) log.cc:844] Serialized 6366 byte log entry
0709 13:03:18.740993 (+424116us) op_driver.cc:464] REPLICATION: finished
0709 13:03:18.961468 (+220475us) write_op.cc:301] APPLY: starting
0709 13:03:18.961601 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.018861 (+ 57260us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.018974 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:19.286839 (+267865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:19.287301 (+   462us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:03:19.287370 (+    69us) write_op.cc:312] APPLY: finished
0709 13:03:19.288112 (+   742us) log.cc:844] Serialized 148 byte log entry
0709 13:03:19.288405 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.288801 (+   396us) write_op.cc:454] Released schema lock
0709 13:03:19.288873 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:19.289396 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.289425 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":357645,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":202387,"apply.run_cpu_time_us":27841,"apply.run_wall_time_us":337728,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71167,"num_ops":16,"prepare.queue_time_us":382647,"prepare.run_cpu_time_us":6758,"prepare.run_wall_time_us":138499,"raft.queue_time_us":241687,"raft.run_cpu_time_us":16444,"raft.run_wall_time_us":40923,"replication_time_us":436626,"spinlock_wait_cycles":23296,"thread_start_us":718372,"threads_started":4,"wal-append.queue_time_us":2269,"wal-append.run_cpu_time_us":36611,"wal-append.run_wall_time_us":1982459}]]}
W20260709 13:03:20.866094  9609 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:20.867723  9612 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:20.869549  9623 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:20.870230  9623 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:20.873126  9623 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.873700  1431 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 19 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.874539  9437 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:20.875486  9236 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.791986  9606 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:20.878860  9606 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:20.877040  9598 log.cc:927] Time spent T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:03:20.883311  1601 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:20.883720  1606 raft_consensus.cc:1240] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:20.873222  9416 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:20.888763  9512 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:03:20.972594  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 164313us
I20260709 13:03:20.971484  9416 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.976442  9416 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:20.984879  9416 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:21.003794  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 387195us
W20260709 13:03:21.004848  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.005300  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.001880  9553 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.012753  9555 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.015450  9518 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.030719  9580 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.034916  9251 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:21.031698  9428 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.044636  9428 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.047044  9428 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.053942  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.055009  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.055866  1677 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:21.060460  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:21.062621   431 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 1559)
W20260709 13:03:21.066494  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.068977  9596 log.cc:927] Time spent T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.461s	user 0.009s	sys 0.006s
I20260709 13:03:21.069561  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.070410  1600 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:03:21.070552  9625 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:21.071637  1605 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:21.071967  1601 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:21.071962  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.077345  2256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1986) took 1004 ms. Trace:
I20260709 13:03:21.078009  2256 rpcz_store.cc:276] 0709 13:03:20.073404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.073539 (+   135us) service_pool.cc:224] Handling call
0709 13:03:21.077084 (+1003545us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54001ed7d4. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b352fa 00007f7e68af6b17 00007f7e620716d4 00007f7e62071662 00007f7e62071591 00007f7e6207150c 00007f7e620707c2 00007f7e61e6c48c 00007f7e61e6b8c6 00007f7e61e6b26f
0709 13:03:21.077265 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304783104}
I20260709 13:03:21.079922  1602 raft_consensus.cc:1240] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:21.087026  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 77749.9us
I20260709 13:03:21.057451  1678 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Committing config change with OpId 16.14: config changed from index -1 to 14, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:21.075384  9606 consensus_queue.cc:1048] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:21.040761  9580 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.092115  9337 consensus_queue.cc:1048] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:21.095036  2258 raft_consensus.cc:1275] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 13:03:21.095465  2258 pending_rounds.cc:85] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 16
I20260709 13:03:21.099014  1606 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 27. Current term is 28. Ops: []
I20260709 13:03:21.026664  9553 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.121517  9553 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.123106  9584 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.123713  9584 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.126277  9584 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.127485  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.128194  1600 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:21.132277  9586 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.132902  9586 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.135177  9586 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.139853  1676 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:21.141569  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.146974  2253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:21.148521  2253 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:21.152969  2227 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:21.155154  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.161151  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.156057  1675 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:21.095687  2258 pending_rounds.cc:107] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 13:03:21.164557  2258 raft_consensus.cc:2889] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.166626  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.168568  1498 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:21.105509  1574 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.108480  9437 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.108992  9613 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.176079  1498 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:21.176766  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 150683us
I20260709 13:03:21.113886  9580 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.117373  1682 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:21.119254  1605 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:21.091279  2260 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:21.169422  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.170887  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.173457  2256 raft_consensus.cc:3055] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:21.171602  2257 raft_consensus.cc:1275] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:03:21.111322  9615 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.275s	user 0.000s	sys 0.003s
I20260709 13:03:21.180837  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.181171  2256 raft_consensus.cc:740] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:21.181828  1604 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:03:21.182391  2227 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:21.184719  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:21.194803  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.197655  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.198356  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.199002  1674 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:21.195389  1600 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
W20260709 13:03:21.191401  1648 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.193092  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 87616.3us
I20260709 13:03:21.202214  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.202572  1574 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.203065  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.204375  1499 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:21.180224  9428 raft_consensus.cc:2804] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:21.207949  8391 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.208948  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.207329  1498 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:21.210359  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.209640  2252 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
W20260709 13:03:21.207034  1574 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.220992  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.221218  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.221685  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.241631  1677 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 20: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:21.241794  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.222173  9257 consensus_queue.cc:1048] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:21.242548  2255 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:21.223552  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:21.185047  9613 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.180739  9437 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.225363  9623 raft_consensus.cc:3060] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:21.206624  9283 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.229113  9603 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:21.212978  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:21.203204  9550 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:21.210669  2256 consensus_queue.cc:260] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.233013  9236 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:21.201843  9458 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:21.197341  9617 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.242066  1675 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 25: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:21.192492  9466 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.094246  9616 consensus_queue.cc:1059] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
W20260709 13:03:21.245770  1574 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.250270  1649 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.269066  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:21.251127  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 65500us
I20260709 13:03:21.252403  1498 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:21.259517  9251 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:21.270851  1648 leader_election.cc:336] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.167598  9553 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:03:21.271282  1648 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.268291  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.273178  9437 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:21.273720  1574 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.274248  9627 log.cc:927] Time spent T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:21.267890  9236 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.275615  9236 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:21.276621  9301 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.276640  9492 consensus_queue.cc:1048] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:21.279101  9490 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:21.280560  9617 raft_consensus.cc:3055] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:21.280979  9617 raft_consensus.cc:740] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:21.267385  9283 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:21.281941  9283 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.267477  9458 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:21.260164  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 47372.9us
I20260709 13:03:21.282924  9458 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:21.231077  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:21.287645  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.205974  9520 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:21.288753  9580 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:21.264087  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 52219.3us
I20260709 13:03:21.282413  9283 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:21.288152  1648 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.291133  1648 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.281663  9513 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:21.255204  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:21.298084  1648 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.299754  1648 leader_election.cc:336] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.300088  1648 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.303454  1602 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:21.303124  1600 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:03:21.305387  1648 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.306156  1648 leader_election.cc:336] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.306434  1648 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.308596  2253 raft_consensus.cc:2468] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 28.
I20260709 13:03:21.265089  9602 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:21.310580  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.311054  9613 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:21.311455  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:21.250030  9170 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.312757  9251 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.312623  9170 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.313478  9606 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:21.281790  9617 consensus_queue.cc:260] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.314313  9601 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:21.314706  9601 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.315277  9601 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:21.293651  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.313915  9606 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.308833  9428 raft_consensus.cc:697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:21.317770  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:21.318300  2255 raft_consensus.cc:1275] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:03:21.324064  1648 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.325807  1573 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:21.324633  1648 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.323781  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.294924  9513 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.336638  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.340749  1601 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 16.
I20260709 13:03:21.339983  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.295063  9589 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:03:21.314998  9617 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.334091  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.282019  9512 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 13:03:21.326815  9550 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.334954  9511 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:21.326642  9622 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:21.323238  9606 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:21.327006  9251 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.314847  9170 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:21.366660  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:21.336333  9584 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:21.352510  9513 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:21.324630  9437 consensus_queue.cc:1059] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 13:03:21.364713  9623 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:21.372857  9550 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:21.397931  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 73904.6us
I20260709 13:03:21.374001  9622 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.400149  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.401075  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:21.403954  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.379614  9584 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:21.418211  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 70639.4us
I20260709 13:03:21.376624  9251 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.381712  9520 raft_consensus.cc:2804] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:21.416631  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.424189  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.427088  2257 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:21.389251  9555 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:21.431015  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.432444  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.433861  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 93963.5us
I20260709 13:03:21.396836  9589 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:21.374286  9257 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
W20260709 13:03:21.440297  1648 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.415673  9622 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:21.439847  2226 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.442193  2257 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 27. Current term is 28. Ops: [25.18-27.19]
I20260709 13:03:21.400468  9638 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:21.442708  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:21.444058  2226 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.447916  2226 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.445642  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.428776  9584 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:21.428561  9251 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:21.440356  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.429870  9623 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.449815  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.451864  2254 raft_consensus.cc:2393] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:21.451468  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.415553  9613 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 13:03:21.443921  9520 raft_consensus.cc:697] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:21.459973  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:21.449162  9638 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.455948  9623 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.480573  9550 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:21.462221  2226 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.481132  9623 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.463491  9621 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:21.404644  9428 consensus_queue.cc:237] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.455256  9632 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:21.485154  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.464485  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.500499  1574 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.491916  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.500965  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.504567  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:21.505432  1574 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.507015  1682 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:03:21.453048  9518 consensus_queue.cc:1048] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 13:03:21.507426  2226 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:21.511091  1574 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.512638  2226 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:21.551993  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 44596.9us
I20260709 13:03:21.483692  9638 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:21.508049  9567 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.503816  9337 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:21.562072  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 236299us
W20260709 13:03:21.563144  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 116582us
I20260709 13:03:21.566262  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.511902  9640 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:21.481557  9520 consensus_queue.cc:237] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.553208  9591 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.572463  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.589026  1602 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 16.
I20260709 13:03:21.590457  2261 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:21.592206  2256 raft_consensus.cc:3060] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:21.576799  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:21.586242  2226 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.592350  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.593636  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:21.593811  1681 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 25.
I20260709 13:03:21.593663  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.595292  9567 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:21.595641  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:21.559994  9372 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.596133  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:21.603554  9567 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.605046  1675 raft_consensus.cc:1240] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Rejecting Update request from peer 9b6586a864a94c019cae2d8e2987a7af for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:21.605392  9642 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.605873  9642 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.607566  1680 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:21.608034  9642 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.613162  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.573345  9621 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.617503  1675 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:21.616561  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:21.576723  9586 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.569952  9602 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:21.618435  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.627272  1602 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:21.619678  8391 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:21.622598  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:21.622779  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.629535  2261 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 24.
I20260709 13:03:21.618392  9605 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:21.656800  2261 raft_consensus.cc:1275] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:21.624157  9621 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.626551  9616 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:21.655045  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:21.592316  9283 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.626719  9603 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:03:21.623229  9553 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:03:21.681860  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:21.683218  2259 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:21.666083  9621 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.665902  9616 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.691234  2256 raft_consensus.cc:1275] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 19. (term mismatch)
I20260709 13:03:21.691721  2256 pending_rounds.cc:85] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting all ops after (but not including) 18
I20260709 13:03:21.691934  2256 pending_rounds.cc:107] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: Aborting uncommitted NO_OP operation due to leader change: 23.19
I20260709 13:03:21.692157  2256 raft_consensus.cc:2889] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.633496  9586 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.644224  9602 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.676570  9170 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.656008  9458 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:21.770352  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 147499us
W20260709 13:03:21.692528  9637 log.cc:927] Time spent T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:03:21.772524  1498 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:21.678835  9613 consensus_queue.cc:1048] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
I20260709 13:03:21.694123  9616 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:21.802393  9236 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:03:21.802901  9236 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.812827  2252 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:21.697881  9170 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:21.831105  9656 log.cc:927] Time spent T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:03:21.831948  9650 log.cc:927] Time spent T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:03:21.836478  9586 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.824551  9170 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.793639  9601 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:21.906093  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 113771us
I20260709 13:03:21.875159  9605 raft_consensus.cc:3060] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:21.924355  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 311914us
W20260709 13:03:21.920113  9660 log.cc:927] Time spent T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:03:21.903949  9603 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:03:21.929240  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:21.932390  9619 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:21.940009  9654 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:21.940841  9654 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.941247  9654 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:21.924685  9586 raft_consensus.cc:493] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.961114  1605 raft_consensus.cc:2955] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 11 to 15, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:21.965536  9283 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:21.969082  9458 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.970589  9586 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:21.973453  9251 consensus_meta.cc:287] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.002s
I20260709 13:03:21.973971  9251 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:21.975067  1676 raft_consensus.cc:1240] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:21.981148  9586 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:21.986039  9601 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:21.986605  9622 consensus_meta.cc:287] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.002s
I20260709 13:03:21.987099  9622 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.987435  9613 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:21.988240  9613 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:21.989859  9671 raft_consensus.cc:3055] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:21.990320  9671 raft_consensus.cc:740] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:21.996696  9622 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:21.999404  9584 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 13:03:21.954972  9670 consensus_queue.cc:1059] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:03:22.015498  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:21.990491  9613 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:22.018909  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:22.004038  9620 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:03:22.021016  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:22.022090  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:22.024343  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 367075us
I20260709 13:03:22.045508  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.046342  1677 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:03:22.020145  9513 consensus_meta.cc:287] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.005s
W20260709 13:03:22.020700  9617 consensus_meta.cc:287] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.002s
W20260709 13:03:22.049050  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 125775us
I20260709 13:03:22.062057  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.063555  2261 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:22.063474   431 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 1559)
I20260709 13:03:22.075464  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.076205  2252 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:22.004118  9170 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.112282  2253 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:22.039505  9584 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.121502  2252 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 27.
W20260709 13:03:22.113426  9606 consensus_meta.cc:287] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:03:22.058177  9513 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.074637  9654 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.144930  1678 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 22: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:03:22.144322  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 79957.5us
I20260709 13:03:22.146634  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.151121  1500 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:22.128994  9606 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.151937  9617 consensus_queue.cc:1059] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:03:22.175040  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.175222  9623 raft_consensus.cc:1064] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:03:22.171630  9251 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.175522  9417 raft_consensus.cc:3055] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:22.176771  9417 raft_consensus.cc:740] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.151734  9670 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.173787  9584 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.174655  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.178774  1676 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:22.175030  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:22.183472  1605 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:22.186590  2257 raft_consensus.cc:1240] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.187173  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.176402  2260 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:03:22.188493  9605 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:22.174706  9170 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:22.163398  9236 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.193128  1604 raft_consensus.cc:2393] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 20: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:03:22.193395  9675 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:22.194610  9236 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:22.156922  9638 consensus_meta.cc:287] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:03:22.163184  1677 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 27.
W20260709 13:03:22.194761  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 43740us
I20260709 13:03:22.202642  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:22.215107  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:22.216847  1574 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:22.215340  1500 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.225123  1676 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:22.226568  2261 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:22.226837  1574 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:22.225497  2260 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
W20260709 13:03:22.228410  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 775336us
I20260709 13:03:22.228832  9685 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.229506  9685 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.232614  9601 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:22.233160  9601 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:22.233935  9416 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:22.213963  9638 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.237401  9638 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.233952  9601 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.177664  9417 consensus_queue.cc:260] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:22.242679  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:22.244551  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.237391  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:22.247790  9636 log.cc:927] Time spent T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.802s	user 0.000s	sys 0.004s
I20260709 13:03:22.249238  9416 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.239645  9621 raft_consensus.cc:515] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.252089  9621 leader_election.cc:290] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:22.253198  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:22.253803  1601 raft_consensus.cc:3060] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:22.218245  9567 consensus_meta.cc:287] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.003s
I20260709 13:03:22.254474  9567 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:22.256022  9685 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.257259  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.165684  9654 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.263345  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:22.263974  1602 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:03:22.259860  1606 raft_consensus.cc:1240] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:03:22.260726  2258 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:22.260906  1607 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:03:22.262734  1608 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:03:22.173695  9513 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.279147  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.279409  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76204c6ec324b26bec0c1908a45574a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.289342  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.290163  1679 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:22.294224  1601 raft_consensus.cc:2468] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 17.
I20260709 13:03:22.296064  1649 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:22.218236  9236 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.307466  8391 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:22.309233  1500 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.233999  9657 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:22.312566  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9afdc16bf6430d9b895aefc4432c77" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:22.316008  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.317718  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.318571  1677 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8ff9782cd95483c905cd1d906f41aaf in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:22.172340  9616 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.327224  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.319322  9644 raft_consensus.cc:2804] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:22.336403  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:22.331686  2260 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:22.322526  9466 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.375901  1679 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:22.323359  9657 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 27 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:22.325704  9670 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:03:22.353863  9567 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.386760  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.389510  9679 consensus_queue.cc:1059] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:03:22.390628  9679 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:22.392920  9602 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.395413  9679 raft_consensus.cc:3055] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:22.395812  9679 raft_consensus.cc:740] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.396684  9679 consensus_queue.cc:260] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.397516  9616 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.397902  9679 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:22.330451  9617 consensus_queue.cc:1059] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:03:22.401763  9617 raft_consensus.cc:3055] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.402204  9617 raft_consensus.cc:740] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.403084  9567 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.403117  9617 consensus_queue.cc:260] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:22.404467  9686 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:03:22.404990  9617 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.405478  9567 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:22.408973  9616 consensus_queue.cc:1175] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b6586a864a94c019cae2d8e2987a7af" responder_term: 16 status { last_received { term: 16 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 16 index: 14 } }
I20260709 13:03:22.410406  9606 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.410995  9602 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:03:22.420367  2226 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.387161  2258 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:22.420946  2226 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:22.420950  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.373951  9644 raft_consensus.cc:697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:22.432723  9644 consensus_queue.cc:237] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.433645  9657 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.439637  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:22.441533  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 141661us
I20260709 13:03:22.445493  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:22.444993  1600 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:03:22.446843  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:22.447662  2226 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:22.448910  2226 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.449371  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:22.451786  1605 raft_consensus.cc:1275] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:22.453685  8391 consensus_queue.cc:1059] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:22.453861  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.454048  1573 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:22.454183  9466 consensus_queue.cc:1059] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:03:22.485291  9466 consensus_queue.cc:1243] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer 9b6586a864a94c019cae2d8e2987a7af log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:03:22.473893  9605 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:22.475235  1498 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:22.454815  9170 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:22.486889  9416 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.449117  9372 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.489547  9668 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:22.493821  9668 raft_consensus.cc:697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:22.494035  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.495144  1602 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:22.497979  2227 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:03:22.498405  2227 leader_election.cc:403] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.496544  8391 raft_consensus.cc:3055] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.498981  8391 raft_consensus.cc:740] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.501911  9668 consensus_queue.cc:237] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.505321  9591 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.512171  9170 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:22.505975  9591 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.519223  9591 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.521438  8391 consensus_queue.cc:260] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.533041  2261 raft_consensus.cc:1275] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:03:22.537503  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:22.532318  9170 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:03:22.546908  9677 consensus_queue.cc:1048] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:03:22.560863  9601 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:22.545647  9372 consensus_queue.cc:1048] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:03:22.596179  9337 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:22.609319  9601 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.594632  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.590240  1499 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:22.616048  1675 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:22.617938  9601 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.611898  9337 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.573534  9550 raft_consensus.cc:3055] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:03:22.621214  9550 raft_consensus.cc:740] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:03:22.568966  9697 log.cc:927] Time spent T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:22.616608  9622 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:22.624763  9667 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.599853  9511 consensus_queue.cc:1048] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.026s
W20260709 13:03:22.626551  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.627065  1648 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:22.630867  1648 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.637589  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:22.638438  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:22.625062  9622 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.625063  9337 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.633562  9251 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:22.648008  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.625450  9667 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.657934  1608 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:22.657191  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 51850.3us
I20260709 13:03:22.666226  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:22.622153  9550 consensus_queue.cc:260] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.668741  9584 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:22.669216  9550 raft_consensus.cc:3060] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:22.650795  1605 raft_consensus.cc:1240] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 LEADER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 27. Current term is 28. Ops: [25.18-27.19]
I20260709 13:03:22.674674  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:22.675590  1678 raft_consensus.cc:2368] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:03:22.677830  9682 raft_consensus.cc:493] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:22.678350  9682 raft_consensus.cc:515] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.681425  9622 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.687242  1499 leader_election.cc:304] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.688503  9553 raft_consensus.cc:2749] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.688966  9671 consensus_queue.cc:260] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.689523  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:22.690280  9671 raft_consensus.cc:3060] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:22.662652  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:22.698462  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.567679  9417 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:22.762416  1675 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:22.766299  1499 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:22.765938  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:22.758688  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 59536.8us
W20260709 13:03:22.777704  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.779624  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb94d58e3454c868591a7960956aa47" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.700572  9682 leader_election.cc:290] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.783631  9666 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:22.762267  9567 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.785307  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.788836  9567 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.761767  9665 consensus_queue.cc:1059] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:03:22.794777  1648 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.799204  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:22.807438  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 351817us
W20260709 13:03:22.811590  1574 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:22.783607  9683 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.085s	user 0.000s	sys 0.010s
I20260709 13:03:22.814882  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.815049  8391 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:22.810587  2226 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.812083  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:22.816229  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:22.821743  2258 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:03:22.823632  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.841116  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:22.841877  1602 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
W20260709 13:03:22.845098  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.846828  1498 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:22.849572  1675 raft_consensus.cc:1275] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:22.813923  9640 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.817330  9666 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 26 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.831699  9428 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.831710  9601 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:22.839637  9567 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.871119  1500 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:22.899063  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.866302  9667 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:22.899680  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:22.885926  9706 log.cc:927] Time spent T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:03:22.918593  9617 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:22.941385  9705 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:03:22.945448  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:22.946059  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 137553us
W20260709 13:03:22.946768  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:22.952165  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:22.869215  9638 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:03:22.918323  9553 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:22.944149  9619 raft_consensus.cc:3055] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:22.967950  9617 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.971918  1601 raft_consensus.cc:1240] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:03:22.949625  9666 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.987402  9617 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:22.963743  9672 log.cc:927] Time spent T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:22.986272  9586 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.989207  9372 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:22.990361  9372 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.991447  9586 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:22.969223  9553 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.993423  9553 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:22.994038  9586 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:22.985351  9619 raft_consensus.cc:740] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:22.997939  9619 consensus_queue.cc:260] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:22.999171  9619 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:23.012594  2226 leader_election.cc:400] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Vote denied by peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753) with higher term. Message: Invalid argument: T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af for earlier term 21. Current term is 22.
I20260709 13:03:23.014575  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:23.015164  2255 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:23.018496  9640 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:23.025884  9640 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:23.017313  9372 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:23.047907  2255 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 26.
I20260709 13:03:23.048558  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.049292  1678 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:23.050040  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.050141  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.028223  9640 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:23.059949  1499 leader_election.cc:304] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:23.066232   431 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 1559)
I20260709 13:03:23.075891  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.091037  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.076591  9236 raft_consensus.cc:2749] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:23.110525  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.111188  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.112092  9714 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:23.113596  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:23.114295  2226 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.114684  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.120368  1498 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.121223  9682 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:23.124637  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.120457  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.128597  2258 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:03:23.134644  9632 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:23.137478  9623 raft_consensus.cc:1068] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: Unable to promote non-voter 9b6586a864a94c019cae2d8e2987a7af: Illegal state: Replica b8ff9782cd95483c905cd1d906f41aaf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:23.144349  9553 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:23.146968  9553 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:23.162556  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 272936us
W20260709 13:03:23.163323  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:23.166656  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:23.168375  1574 leader_election.cc:336] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.172968  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.173118  1574 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:23.172789  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 53169.4us
W20260709 13:03:23.174989  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.175420  1648 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.156620  9714 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:23.177716  9640 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:23.182301  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.176450  9657 consensus_queue.cc:1048] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:03:23.192746  9606 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:23.197746  1681 raft_consensus.cc:1275] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:03:23.203039  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:23.174172  9638 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:23.204531  1682 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:23.218176  9492 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:23.222975  1601 raft_consensus.cc:1240] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Rejecting Update request from peer b8ff9782cd95483c905cd1d906f41aaf for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:23.224597  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:23.225214  1604 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:23.229425  1573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 54592.5us
I20260709 13:03:23.231020  9640 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:23.231622  1675 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:23.234619  2227 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.236636  9569 raft_consensus.cc:493] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.236891  9632 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:23.239080  9591 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:23.251807  1675 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:23.253234  1602 raft_consensus.cc:1275] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:23.254871  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.257899  1604 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
I20260709 13:03:23.264910  1608 raft_consensus.cc:2393] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:03:23.267760  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72028.7us
W20260709 13:03:23.270941  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.271409  1574 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:23.271471  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 71109.9us
W20260709 13:03:23.282559  1574 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.283079  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.278532  1499 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:23.300580  9638 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:23.300484  9365 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:23.299479  9601 consensus_queue.cc:1048] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:03:23.291889  9657 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:23.314399  9685 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:23.315012  9685 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.317129  9685 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.292038  9337 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:23.237164  9569 raft_consensus.cc:515] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.328613  9617 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.329351  9617 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.331401  9569 leader_election.cc:290] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.331753  9617 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.332002  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.335969  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.336987  9257 consensus_queue.cc:1048] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.337707  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.339991  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.342835  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.329509  9365 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:23.344331  9365 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:23.348963  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.355199  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87db66ba9ff145009d8e513e5d0ef1e4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.360993  8391 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:23.362068  1608 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:23.365379  1430 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.362823  1500 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:23.370465  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 195486us
W20260709 13:03:23.371752  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.375329  8391 raft_consensus.cc:2749] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:23.375458  1648 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:23.379238  1648 leader_election.cc:336] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.381210  9519 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:23.373715  1430 catalog_manager.cc:5697] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:23.376905  1499 leader_election.cc:304] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.395025  9466 raft_consensus.cc:2749] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:23.386335  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index -1 to 14, term changed from 16 to 18, NON_VOTER 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.411877  1430 catalog_manager.cc:5697] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 19, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 19 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:23.424731  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 344) took 21584 ms (client timeout 15000 ms). Trace:
W20260709 13:03:23.425187  1431 rpcz_store.cc:269] 0709 13:03:01.840712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.840996 (+   284us) service_pool.cc:224] Handling call
0709 13:03:23.424648 (+21583652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:21.215004 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:21.215637 (+   633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:21.215691 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:03:21.215717 (+    26us) tablet.cc:662] Decoding operations
0709 13:03:21.253872 (+ 38155us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:21.294643 (+ 40771us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:21.303374 (+  8731us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:21.312117 (+  8743us) tablet.cc:701] Row locks acquired
0709 13:03:21.312166 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:03:21.312353 (+   187us) write_op.cc:270] Start()
0709 13:03:21.312494 (+   141us) write_op.cc:276] Timestamp: P: 1783602201312259 usec, L: 0
0709 13:03:21.312516 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:21.415492 (+102976us) log.cc:844] Serialized 2142 byte log entry
0709 13:03:21.970935 (+555443us) op_driver.cc:464] REPLICATION: finished
0709 13:03:22.135044 (+164109us) write_op.cc:301] APPLY: starting
0709 13:03:22.135138 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:22.139977 (+  4839us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:22.140068 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:22.143056 (+  2988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:22.143270 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:03:22.143312 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:22.143550 (+   238us) log.cc:844] Serialized 57 byte log entry
0709 13:03:22.143740 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.143858 (+   118us) write_op.cc:454] Released schema lock
0709 13:03:22.143906 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:22.509979 (+366073us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54003d5754. stack: 00007f7e60a12343 00007f7e60a12240 00007f7e603a11d4 00007f7e6a0df304 00007f7e6a0df299 00007f7e63a9a571 00007f7e63b2ce28 00007f7e67567581 00007f7e67566d58 00007f7e6756b9f1 00007f7e6756b9a9 00007f7e6756b939 00007f7e6756b901 00007f7e6756ab2d 000000000038f354 000000000038f199
0709 13:03:22.510255 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.510288 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1904977,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":162922,"apply.run_cpu_time_us":7573,"apply.run_wall_time_us":14381,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25077,"num_ops":5,"prepare.queue_time_us":127940,"prepare.run_cpu_time_us":55209,"prepare.run_wall_time_us":1295182,"raft.queue_time_us":339361,"raft.run_cpu_time_us":55616,"raft.run_wall_time_us":146248,"replication_time_us":658226,"spinlock_wait_cycles":24019840,"thread_start_us":620153,"threads_started":4,"wal-append.queue_time_us":201630,"wal-append.run_cpu_time_us":40659,"wal-append.run_wall_time_us":1521594}]]}
I20260709 13:03:23.420372  1430 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:23.437458  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 46359.4us
I20260709 13:03:23.444682  1430 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 21 to 27, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 27 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.449049  1430 catalog_manager.cc:5697] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 17 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:23.394167  9553 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:03:23.445788  9682 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.460055  9682 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.462199  9682 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.464095  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:23.465904  9723 log.cc:927] Time spent T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:03:23.452984  1430 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.469628  2260 raft_consensus.cc:1275] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:23.469902  1430 catalog_manager.cc:5697] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:23.476599  1430 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.478613  1430 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 17 to 21, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.481489  1430 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.471449  9677 consensus_queue.cc:1048] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:03:23.505187  2260 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:03:23.483986  1430 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.530252  1677 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:23.529922  1430 catalog_manager.cc:5697] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:23.532270  9416 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:23.536703  1678 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:03:23.538385  9416 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:03:23.545382  1430 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.560911  1430 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: config changed from index 11 to 15, term changed from 22 to 23, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to <none>, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:23.563382  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.561758  9601 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.568898  9601 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:23.571179  9601 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:23.571761  2252 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:23.573334  1678 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:23.580271  1430 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 13 to 22, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 22 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.586745  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.583770  1430 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 22 to 27, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 27 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:23.591233  1648 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.596470  1648 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.596827  1430 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 20, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.614200  1430 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 16 to 19, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.622640  1430 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 17 to 18, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.620436  1498 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:23.626757  9644 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:23.589830  9670 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.049s
I20260709 13:03:23.638373  9569 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:23.587338  9416 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:03:23.639442  9466 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.640004  9466 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:23.640166  9550 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:23.642210  9466 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:23.645200  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.604430  9170 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:23.646131  9170 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.660705  9644 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:23.661569  1678 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:23.663744  1499 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:23.665542  9490 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:23.665930  9490 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.666254  9490 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:23.671564  9170 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:23.699746  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.700467  1608 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
W20260709 13:03:23.716667  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:23.719322  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:23.724833  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:23.731500  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.732450  1677 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 17: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:23.632762  1430 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 19 to 20, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:23.776100  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 64769.3us
I20260709 13:03:23.778095  1430 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 16 to 20, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:23.785274  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 51132.7us
I20260709 13:03:23.785115  1430 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.786705  1430 catalog_manager.cc:5697] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 19 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:23.784413  9606 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:23.795240  9732 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:23.825316  9511 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:23.826062  9511 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:23.792258  9365 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.831058  9511 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133)
I20260709 13:03:23.832383  9365 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.858273  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.846396  9365 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.870620  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.856127  9569 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.893092  9670 raft_consensus.cc:493] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.920921  9670 raft_consensus.cc:515] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.923575  9670 leader_election.cc:290] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:23.926633  9550 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.927189  9550 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.933367  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.930711  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:23.938071  1601 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:23.893612  9490 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:23.953044  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:23.961912  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ca98d137184e478468c21f485fafa4" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:23.995462  8391 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.996143  8391 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:23.929867  9569 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
W20260709 13:03:24.003193  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128127us
I20260709 13:03:24.010728  8391 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.027079  9490 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:24.031381  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 80659.4us
I20260709 13:03:24.035092  1498 leader_election.cc:304] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:24.032778  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80305.8us
I20260709 13:03:24.038960  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.040362  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.029439  9550 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.047623  8391 raft_consensus.cc:493] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:24.044114  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:24.054450  8391 raft_consensus.cc:515] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.047516  1500 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
W20260709 13:03:24.066743   431 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 1559)
W20260709 13:03:24.066923  2226 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 140 similar messages]
I20260709 13:03:24.068629  9744 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:03:24.113004  8391 leader_election.cc:290] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:24.115127  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 53405.4us
W20260709 13:03:24.122628  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 87616.1us
I20260709 13:03:24.124615  1498 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:24.166780  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.117806  9490 raft_consensus.cc:2749] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:24.237251  9619 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:24.247406  9569 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:24.251894  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 126714us
I20260709 13:03:24.256428  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.258690  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99da1afef0249c084ef81484859e823" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.259555  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.260182  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:24.258888  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:24.263720  1678 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:24.218750  9744 raft_consensus.cc:493] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:24.265843  9744 raft_consensus.cc:515] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:24.271492  9741 log.cc:927] Time spent T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:24.268093  9744 leader_election.cc:290] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:24.328653  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 72349.6us
I20260709 13:03:24.343750  1678 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
W20260709 13:03:24.346733  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 286446us
W20260709 13:03:24.348408  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 72622.3us
I20260709 13:03:24.351121  1499 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.369328  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.370275  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:24.371254  1607 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:24.368906  1498 leader_election.cc:304] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:24.373908  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.374519  1600 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 19.
I20260709 13:03:24.345789  9490 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.375427  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.347941  9520 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:24.383159  1600 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:03:24.385052  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:24.387900  1648 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:24.391494  9617 raft_consensus.cc:2749] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:24.394654  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a266117eb57049ceb80c4acd77766559" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.379855  9490 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.392068  9751 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.402985  1607 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 23.
I20260709 13:03:24.408295  9569 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.408588  9416 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.404910  9753 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:24.391249  9520 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.402218  9490 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.433831  9744 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:24.435490  9744 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:24.430497  9569 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.444041  9569 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.445156  1500 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.429898  1601 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 16.
I20260709 13:03:24.452982  9520 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:24.459846  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.427503  9753 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.435998  9744 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.466235  9569 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:03:24.479493  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 111505us
I20260709 13:03:24.488965  9569 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:24.489920  9569 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:24.473677  9753 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:24.503738  9744 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.508100  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.509617  9751 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:24.430366  9416 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:24.510934  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.512957  9416 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:24.516633  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128515us
I20260709 13:03:24.519732  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.521209  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.523931  2254 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 17: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
W20260709 13:03:24.568344  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:24.569377  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:24.578063  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.575356  1498 leader_election.cc:304] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:24.569855  9685 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.626538  9490 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.617694  9753 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:24.673112  9762 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.684860  9762 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:24.685319  9490 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:24.620890  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80807.9us
I20260709 13:03:24.686204  9753 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:24.687229  9762 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:24.597224  9749 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:24.688412  9749 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:24.692408  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.693257  1605 raft_consensus.cc:2393] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 21: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
W20260709 13:03:24.591771  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:24.583848  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 153082us
W20260709 13:03:24.694114  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 114612us
W20260709 13:03:24.694727  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.594605  9569 raft_consensus.cc:2749] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.710632  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.683182  9685 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:24.713443  9685 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:24.714821  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e185a2b036a741ffba1ca49f0dd4cce8" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.583060  9760 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.716360  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.717031  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:24.717597  1605 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.722716  9760 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.723462  2254 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:24.725090  1605 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:24.694134  9749 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:24.729732  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.727113  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:24.730957  1601 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:24.739799  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:24.747754  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.748693  1676 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 17.
I20260709 13:03:24.747946  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:24.750514  2261 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.753783  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.755722  1498 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:24.763654  1498 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:24.764817  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.768901  9569 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:24.768893  9753 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.760404  1676 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:24.770828  9753 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.771230  9753 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.771587  9753 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.780041  9490 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.780283  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.780648  9490 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:24.782853  9490 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:24.788358  9753 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.792176  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:24.792838  1681 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:24.795495  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:24.796203  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.802285  1681 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:24.803998  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0ffdd8e20a4befaef11295a994679c" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.822165  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b71784dcc643e8bb9bd12d0b0db655" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.826668  9490 raft_consensus.cc:493] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:24.829444  9490 raft_consensus.cc:515] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.830518  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:24.831159  1681 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 20.
I20260709 13:03:24.807168  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:24.813796  9753 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Requested vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.815822  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:24.833079  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:24.833189  2254 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.817816  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.831606  9490 leader_election.cc:290] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:24.835196  1605 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 21.
W20260709 13:03:24.838469  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.836390  1498 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.844947  9490 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:24.845474  9490 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
W20260709 13:03:24.845705  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:24.846124  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:24.846277  9490 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.847208  9757 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.865483  1424 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:24.867542  1500 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.867187  1424 catalog_manager.cc:5697] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 15 to 18, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 18 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.868490  9569 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:24.868834  1500 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.868996  9569 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:24.869971  9569 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } }
I20260709 13:03:24.872577  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:24.873210  1681 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.873752  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56450 (request call id 337) took 4254 ms. Trace:
I20260709 13:03:24.874737  2254 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:24.876381  1424 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 15 to 11, term changed from 23 to 22, leader changed from <none> to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:24.880241  1424 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 22, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:24.874315  1430 rpcz_store.cc:276] 0709 13:03:20.619483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.671575 (+ 52092us) service_pool.cc:224] Handling call
0709 13:03:24.873660 (+4202085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:24.230444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:24.239560 (+  9116us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:24.239595 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:03:24.239613 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:24.254702 (+ 15089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:24.254766 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:24.254796 (+    30us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:24.477418 (+222622us) tablet.cc:701] Row locks acquired
0709 13:03:24.477440 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:03:24.477597 (+   157us) write_op.cc:270] Start()
0709 13:03:24.477722 (+   125us) write_op.cc:276] Timestamp: P: 1783602204477547 usec, L: 0
0709 13:03:24.477746 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:03:24.502054 (+ 24308us) log.cc:844] Serialized 9872 byte log entry
0709 13:03:24.680432 (+178378us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.681809 (+  1377us) write_op.cc:301] APPLY: starting
0709 13:03:24.681924 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:24.698602 (+ 16678us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:24.698697 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:24.751646 (+ 52949us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:24.751998 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:03:24.752043 (+    45us) write_op.cc:312] APPLY: finished
0709 13:03:24.760601 (+  8558us) log.cc:844] Serialized 220 byte log entry
0709 13:03:24.761428 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.761632 (+   204us) write_op.cc:454] Released schema lock
0709 13:03:24.761696 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:24.762131 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.762159 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111685,"reported_tablets":46,"spinlock_wait_cycles":15616,"child_traces":[["op",{"apply.queue_time_us":1097,"apply.run_cpu_time_us":31983,"apply.run_wall_time_us":80283,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108877,"num_ops":25,"prepare.queue_time_us":221734,"prepare.run_cpu_time_us":14868,"prepare.run_wall_time_us":353355,"raft.queue_time_us":49869,"raft.run_cpu_time_us":1063,"raft.run_wall_time_us":19994,"replication_time_us":202482,"spinlock_wait_cycles":1792,"thread_start_us":283755,"threads_started":4,"wal-append.queue_time_us":125239}]]}
I20260709 13:03:24.887145   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:24.888650   431 tablet_replica.cc:333] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:24.889547   431 raft_consensus.cc:2243] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:24.893270  1498 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
I20260709 13:03:24.893177  1424 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 22 to 23, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 23 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.898775   431 raft_consensus.cc:2272] T 6791fab1eefc49d1a3e2783c89cac6a8 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.899689  9762 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:24.900247  9762 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:24.901163  9762 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:24.900509  1424 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 20, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:24.903311  1681 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 18.
I20260709 13:03:24.908116  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd52876d8a2049db9c781a36366069cc" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:24.910796  1424 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:24.898201  9670 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:24.913589  1424 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:24.916518  1648 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:24.916944  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:24.917994  9644 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:24.934055  1500 leader_election.cc:304] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:24.933640  1499 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:24.937022  1499 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:24.920272  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.915724  9670 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.912516  9744 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:03:24.942041  9550 raft_consensus.cc:2749] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:24.943017  9682 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:24.942485  9670 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:24.970685   431 tablet_replica.cc:333] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:24.971715   431 raft_consensus.cc:2243] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:24.972240   431 raft_consensus.cc:2272] T d1b71784dcc643e8bb9bd12d0b0db655 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:24.976188  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.977698   431 tablet_replica.cc:333] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:24.978657   431 raft_consensus.cc:2243] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:24.965992  9664 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:24.988482  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:24.992841   431 raft_consensus.cc:2272] T 794b13e101914a9dbf12fa727a3e9e27 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.016640  1676 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:25.018040  9619 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:25.024570  9644 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:25.042708  1605 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:25.046950  9569 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 13:03:25.081270  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:25.090840   431 tablet_replica.cc:333] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.094007  9619 raft_consensus.cc:493] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.094623  9619 raft_consensus.cc:515] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:25.100666   431 raft_consensus.cc:2243] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.120747   431 raft_consensus.cc:2272] T 14da2914452f44cca76332a550a28b6b P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.123234  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:25.128710  9619 leader_election.cc:290] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:25.129742  9670 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:25.131791  9670 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:25.139372  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53808273f23f45848ad55ddef1799643" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:25.141800  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:25.147751  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:25.161859  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:25.138125   431 tablet_replica.cc:333] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.161980  1676 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:25.162330  1605 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:25.165957  1498 leader_election.cc:304] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:25.166877   431 raft_consensus.cc:2243] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.167605   431 pending_rounds.cc:70] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Trying to abort 1 pending ops.
I20260709 13:03:25.168128   431 pending_rounds.cc:77] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305634609247559680 op_type: NO_OP noop_request { }
I20260709 13:03:25.182343   431 raft_consensus.cc:2889] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:25.184558   431 raft_consensus.cc:2272] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.193023  9762 raft_consensus.cc:2706] T 53808273f23f45848ad55ddef1799643 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Received pre-election callback for term 21 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:03:25.199059  1676 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:25.192163  1605 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ff9782cd95483c905cd1d906f41aaf in term 22.
I20260709 13:03:25.200599  1499 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf; no voters: 
W20260709 13:03:25.211911  1424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 229) took 15124 ms (client timeout 15000 ms). Trace:
I20260709 13:03:25.212425  1426 catalog_manager.cc:5697] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 14 to 15, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:25.210865  9619 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:25.215366  9619 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Becoming Leader. State: Replica: b8ff9782cd95483c905cd1d906f41aaf, State: Running, Role: LEADER
I20260709 13:03:25.216364  9619 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:25.217032   431 tablet_replica.cc:333] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.217859   431 raft_consensus.cc:2243] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.218361   431 raft_consensus.cc:2272] T 2832a231368f4f5dbf9972f28f64f60e P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.234166  1426 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 23 to 24, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 24 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.236799  1426 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.232964   431 tablet_replica.cc:333] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.238301  1426 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.239996  1426 catalog_manager.cc:5697] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:25.213475  1424 rpcz_store.cc:269] 0709 13:03:10.087359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.087831 (+   472us) service_pool.cc:224] Handling call
0709 13:03:25.211821 (+15123990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:24.930844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:24.934798 (+  3954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:24.937361 (+  2563us) write_op.cc:435] Acquired schema lock
0709 13:03:24.938820 (+  1459us) tablet.cc:662] Decoding operations
0709 13:03:24.971739 (+ 32919us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:24.971794 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:24.971821 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:03:24.986645 (+ 14824us) tablet.cc:701] Row locks acquired
0709 13:03:24.986661 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:03:24.986790 (+   129us) write_op.cc:270] Start()
0709 13:03:24.986910 (+   120us) write_op.cc:276] Timestamp: P: 1783602204986751 usec, L: 0
0709 13:03:24.986928 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:03:24.987501 (+   573us) log.cc:844] Serialized 3281 byte log entry
0709 13:03:24.991503 (+  4002us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.994727 (+  3224us) write_op.cc:301] APPLY: starting
0709 13:03:24.995195 (+   468us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:25.003810 (+  8615us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:25.003923 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:25.084964 (+ 81041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:25.096534 (+ 11570us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:03:25.096583 (+    49us) write_op.cc:312] APPLY: finished
0709 13:03:25.096859 (+   276us) log.cc:844] Serialized 81 byte log entry
0709 13:03:25.097033 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.097151 (+   118us) write_op.cc:454] Released schema lock
0709 13:03:25.097194 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:25.097532 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.097557 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52213,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":11091,"apply.run_wall_time_us":103610,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33520,"num_ops":8,"prepare.queue_time_us":320,"prepare.run_cpu_time_us":3953,"prepare.run_wall_time_us":56961,"replication_time_us":4448}]]}
I20260709 13:03:25.257658  1426 catalog_manager.cc:5697] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.271662  1426 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 22 to 24, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 24 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.273248   431 raft_consensus.cc:2243] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.273734  1426 catalog_manager.cc:5697] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.284608   431 raft_consensus.cc:2272] T 3d61a4d068974252b4a051adf9e9b27b P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.281306  1426 catalog_manager.cc:5697] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.288913   431 tablet_replica.cc:333] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.291579  1426 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 24, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 24 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.294329   431 raft_consensus.cc:2243] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.306331  9664 raft_consensus.cc:493] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.317804  9664 raft_consensus.cc:515] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:25.319962  9664 leader_election.cc:290] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:25.323022  9569 raft_consensus.cc:493] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.326195  9569 raft_consensus.cc:515] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:25.329782  9569 leader_election.cc:290] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:25.329979  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:25.336205  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:25.342442  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4390bd9839c84c1e88aa862d642a1b1e" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:25.337735  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29577369ec4664a5f1ed7e27dd3265" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:25.344822  1600 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:25.336802  1426 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 21, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 21 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.338747  1601 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:25.354696  1500 leader_election.cc:304] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:25.349285  1426 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 21 to 22, leader changed from b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.355806  9664 raft_consensus.cc:2749] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:25.355924  1500 leader_election.cc:304] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:25.357322  9762 raft_consensus.cc:2749] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:25.357661  9619 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:25.375718  9619 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:25.377591  9569 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.384617  9569 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:25.396814  9569 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:25.397825  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:25.426555   431 raft_consensus.cc:2272] T f28aac236b62437d9a0603913d696ce7 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.460930  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460ae43de4d04023a24854ca2a19da88" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:25.463920   431 tablet_replica.cc:333] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.476326  2254 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:25.473639  1430 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.481703  1430 catalog_manager.cc:5697] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.483255  1430 catalog_manager.cc:5697] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 22 to 24, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 24 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.485213  1430 catalog_manager.cc:5697] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.486495  1430 catalog_manager.cc:5697] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 20 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.488240  1430 catalog_manager.cc:5697] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 27 to 28, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 28 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.489594  1430 catalog_manager.cc:5697] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 21 to 24, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 24 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.491245  1430 catalog_manager.cc:5697] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 17, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 17 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.494472   431 raft_consensus.cc:2243] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.495357  2254 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEARNER]: Advancing to term 20
I20260709 13:03:25.496553  9682 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:25.487052  1426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 364) took 5713 ms. Trace:
I20260709 13:03:25.492944  1430 catalog_manager.cc:5697] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 20 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.502389  1430 catalog_manager.cc:5697] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 11 to 15, term changed from 22 to 24, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.506721  1500 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:25.508049   431 raft_consensus.cc:2272] T 8b12ac06d9474e6a97e219688d43cf30 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.500341  1426 rpcz_store.cc:276] 0709 13:03:19.773436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.773802 (+   366us) service_pool.cc:224] Handling call
0709 13:03:25.486986 (+5713184us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.378129 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.378630 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.378664 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:03:25.378680 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:25.379615 (+   935us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.379679 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.379708 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:03:25.380651 (+   943us) tablet.cc:701] Row locks acquired
0709 13:03:25.380671 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:25.380799 (+   128us) write_op.cc:270] Start()
0709 13:03:25.380917 (+   118us) write_op.cc:276] Timestamp: P: 1783602205380757 usec, L: 0
0709 13:03:25.380938 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:25.381557 (+   619us) log.cc:844] Serialized 4761 byte log entry
0709 13:03:25.383886 (+  2329us) op_driver.cc:464] REPLICATION: finished
0709 13:03:25.384347 (+   461us) write_op.cc:301] APPLY: starting
0709 13:03:25.384421 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:25.390973 (+  6552us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:25.391076 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:25.397481 (+  6405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:25.397685 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:03:25.397724 (+    39us) write_op.cc:312] APPLY: finished
0709 13:03:25.398025 (+   301us) log.cc:844] Serialized 113 byte log entry
0709 13:03:25.411760 (+ 13735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.412021 (+   261us) write_op.cc:454] Released schema lock
0709 13:03:25.412075 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:25.431525 (+ 19450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.431558 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53535,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":14215,"apply.run_wall_time_us":47130,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50280,"num_ops":12,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":3730,"prepare.run_wall_time_us":10351,"replication_time_us":2822}]]}
I20260709 13:03:25.510216  9619 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:25.507064  1430 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 23 to 27, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 27 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.513264  1676 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:25.514038  1430 catalog_manager.cc:5697] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 15 to 22, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.515558  1430 catalog_manager.cc:5697] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 19 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.526178  1430 catalog_manager.cc:5697] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 24 to 25, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 25 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.527153   431 tablet_replica.cc:333] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.528151   431 raft_consensus.cc:2243] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.527988  1430 catalog_manager.cc:5697] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.529404   431 raft_consensus.cc:2272] T 2d76a019fbba44c8bb56f66d12c271c5 P b8ff9782cd95483c905cd1d906f41aaf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.530977  2254 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:25.530387  1430 catalog_manager.cc:5697] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.532075  1430 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 13 to 21, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.533890  1430 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 18 to 22, leader changed from 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 22 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.535673   431 tablet_replica.cc:333] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.537385   431 raft_consensus.cc:2243] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.537182  9746 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:25.540578  1430 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:25.542119  1430 catalog_manager.cc:5697] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 19 to 21, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:25.552399  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:25.555146  9569 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:25.559880  2255 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:25.572084   431 raft_consensus.cc:2272] T dbb94d58e3454c868591a7960956aa47 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.579504  9762 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:25.592940   431 tablet_replica.cc:333] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.628134   431 raft_consensus.cc:2243] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:25.637751  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:25.638528  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:25.643296  1678 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:25.614810  9762 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:25.659221   431 raft_consensus.cc:2272] T fd52876d8a2049db9c781a36366069cc P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.666581  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 53972.8us
I20260709 13:03:25.668872  9569 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.675848  9569 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:25.677977  9569 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:25.681828  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:25.692229  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:25.692992  1605 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:25.658723  9664 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:03:25.662534  9762 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:25.732843  9786 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:25.743810   431 tablet_replica.cc:333] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.744681   431 raft_consensus.cc:2243] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.745178   431 raft_consensus.cc:2272] T e0746dbce2334050a0a5359c93c14f2c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.747746   431 tablet_replica.cc:333] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.757207   431 raft_consensus.cc:2243] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:03:25.757899  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 80711.2us
I20260709 13:03:25.762838   431 raft_consensus.cc:2272] T abe16ef1967f47ba893ba6ba999c125c P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.770905  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 100824us
I20260709 13:03:25.796463  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c2050eecb74fbbae8aea2d609c6833" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:25.796185  9619 raft_consensus.cc:1064] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: attempting to promote NON_VOTER 9b6586a864a94c019cae2d8e2987a7af to VOTER
I20260709 13:03:25.845147  9746 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:25.845824  9746 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:25.848294  9746 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:25.861328   431 tablet_replica.cc:333] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.862246   431 raft_consensus.cc:2243] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.862898   431 pending_rounds.cc:70] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Trying to abort 1 pending ops.
I20260709 13:03:25.863142   431 pending_rounds.cc:77] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf: Aborting op as it isn't in flight: id { term: 22 index: 16 } timestamp: 7305634632576217088 op_type: NO_OP noop_request { }
I20260709 13:03:25.863480   431 raft_consensus.cc:2889] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:25.863839   431 raft_consensus.cc:2272] T eb7bd80f58e444e6a587b05deed3c5f5 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.887817  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 93980.6us
I20260709 13:03:25.906565  1498 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:25.971444   431 tablet_replica.cc:333] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:25.928052  9753 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:03:25.927515  9762 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:25.977432   431 raft_consensus.cc:2243] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:25.979946  9804 log.cc:927] Time spent T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:26.012279  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 84790.1us
I20260709 13:03:26.018883  1681 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:26.019698   431 raft_consensus.cc:2272] T 7b29577369ec4664a5f1ed7e27dd3265 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.019578  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.028482   431 tablet_replica.cc:333] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.029402   431 raft_consensus.cc:2243] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.030184   431 pending_rounds.cc:70] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Trying to abort 2 pending ops.
I20260709 13:03:26.030490   431 pending_rounds.cc:77] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Aborting op as it isn't in flight: id { term: 27 index: 19 } timestamp: 7305634607228403712 op_type: NO_OP noop_request { }
I20260709 13:03:26.030900   431 raft_consensus.cc:2889] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:26.031255   431 pending_rounds.cc:77] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf: Aborting op as it isn't in flight: id { term: 25 index: 18 } timestamp: 7305634575837442048 op_type: NO_OP noop_request { }
I20260709 13:03:26.031713   431 raft_consensus.cc:2889] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:26.032548   431 raft_consensus.cc:2272] T 55c2050eecb74fbbae8aea2d609c6833 P b8ff9782cd95483c905cd1d906f41aaf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.037936   431 tablet_replica.cc:333] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.039155   431 raft_consensus.cc:2243] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.040498   431 raft_consensus.cc:2272] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.045843   431 tablet_replica.cc:333] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.048673  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.050370   431 raft_consensus.cc:2243] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.055809  2254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:26.064901  9619 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 15, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.085441   431 raft_consensus.cc:2272] T 87db66ba9ff145009d8e513e5d0ef1e4 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.088071  1678 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:03:26.100775  1499 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:26.103055  2255 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEARNER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:03:26.105474  9787 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:03:26.141314  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 151767us
W20260709 13:03:26.152647  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 136596us
W20260709 13:03:26.279953  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 174708us
W20260709 13:03:26.292088  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.288455  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.290335  9810 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.137892  9569 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.297923  9810 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.316344  9818 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:26.298575   431 tablet_replica.cc:333] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.320346   431 raft_consensus.cc:2243] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.321321   431 raft_consensus.cc:2272] T 368dba0d8eac439897c0b05b32e05500 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.327857  9805 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.328490  9805 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.330610  9805 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.335980   431 tablet_replica.cc:333] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.346946  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57c0601cf944c57a1314b6605861f28" candidate_uuid: "b8ff9782cd95483c905cd1d906f41aaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:26.348949  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.353268   431 raft_consensus.cc:2243] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.360107   431 raft_consensus.cc:2272] T df548e1d094249d5ac1f6ffa2f7d9885 P b8ff9782cd95483c905cd1d906f41aaf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:26.358181  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.355754  1601 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b8ff9782cd95483c905cd1d906f41aaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:03:26.371346   431 tablet_replica.cc:333] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.372349   431 raft_consensus.cc:2243] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.373014   431 raft_consensus.cc:2272] T e185a2b036a741ffba1ca49f0dd4cce8 P b8ff9782cd95483c905cd1d906f41aaf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.368257  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55678 (request call id 230) took 1237 ms. Trace:
W20260709 13:03:26.381810  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.380733  1430 rpcz_store.cc:276] 0709 13:03:25.130695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.134281 (+  3586us) service_pool.cc:224] Handling call
0709 13:03:26.368159 (+1233878us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.554769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.555332 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.555375 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:03:25.555394 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:25.556947 (+  1553us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.557004 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.557032 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:03:25.558452 (+  1420us) tablet.cc:701] Row locks acquired
0709 13:03:25.558475 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:03:25.558640 (+   165us) write_op.cc:270] Start()
0709 13:03:25.558774 (+   134us) write_op.cc:276] Timestamp: P: 1783602205558585 usec, L: 0
0709 13:03:25.558799 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:03:25.559507 (+   708us) log.cc:844] Serialized 7940 byte log entry
0709 13:03:25.579213 (+ 19706us) op_driver.cc:464] REPLICATION: finished
0709 13:03:25.581756 (+  2543us) write_op.cc:301] APPLY: starting
0709 13:03:25.581845 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:25.735873 (+154028us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:25.735977 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.074382 (+338405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.074659 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:03:26.074705 (+    46us) write_op.cc:312] APPLY: finished
0709 13:03:26.075092 (+   387us) log.cc:844] Serialized 180 byte log entry
0709 13:03:26.075271 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.075452 (+   181us) write_op.cc:454] Released schema lock
0709 13:03:26.075509 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:26.075831 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.075858 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52432,"reported_tablets":42,"spinlock_wait_cycles":19328,"child_traces":[["op",{"apply.queue_time_us":2286,"apply.run_cpu_time_us":27259,"apply.run_wall_time_us":494064,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83800,"num_ops":20,"prepare.queue_time_us":1035,"prepare.run_cpu_time_us":5105,"prepare.run_wall_time_us":23482,"replication_time_us":19040}]]}
I20260709 13:03:26.396479  1500 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8ff9782cd95483c905cd1d906f41aaf; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:26.396803  1428 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 19 to 24, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193). New cstate: current_term: 24 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.398348  1428 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.399210  9810 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:26.403695   431 tablet_replica.cc:333] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.404636   431 raft_consensus.cc:2243] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.405153  9810 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.405316   431 raft_consensus.cc:2272] T 4203acf1edca42708e1990f548ab96b3 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.405711  9810 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.408185  9810 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:26.413014   431 tablet_replica.cc:333] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.413908   431 raft_consensus.cc:2243] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.417961  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:26.418706  2261 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:26.419831   431 raft_consensus.cc:2272] T d36fd60901f543758f2f446ee106cf32 P b8ff9782cd95483c905cd1d906f41aaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.422726   431 tablet_replica.cc:333] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.424254  9788 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:26.423578   431 raft_consensus.cc:2243] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.426535   431 raft_consensus.cc:2272] T 82df41f800684066955da1e5fcf37da0 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.429638  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:26.444367   431 tablet_replica.cc:333] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.447750  9816 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.448565  9816 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.450120   431 raft_consensus.cc:2243] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.451117  9816 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:26.452467  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 43567.8us
I20260709 13:03:26.456105   431 raft_consensus.cc:2272] T a20d1cf89bf84cc0b80b0dceda3cad18 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.457523  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.458271  1682 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:26.459316   431 tablet_replica.cc:333] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.460251   431 raft_consensus.cc:2243] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.461328   431 raft_consensus.cc:2272] T e5c7c569add7422d840ba6ea7ea7ac47 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.463995   431 tablet_replica.cc:333] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.464769   431 raft_consensus.cc:2243] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.464488  9788 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:26.465329   431 raft_consensus.cc:2272] T d76204c6ec324b26bec0c1908a45574a P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.465893  9816 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.466511  9816 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.468901  9816 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:26.479239  9815 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.480059  9815 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.483767  9682 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 14 to 17, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.493077  9815 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.493636  1601 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 14 to 17, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.501346  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:26.503358  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.504981  9805 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:26.505399  9805 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.505833  9805 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:26.511616  2261 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 14 to 17, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.515630  1682 raft_consensus.cc:2955] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 14 to 17, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.527278   431 tablet_replica.cc:333] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.528156   431 raft_consensus.cc:2243] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.529083   431 raft_consensus.cc:2272] T 75b33947f35745f4809f8a533ebbdaf8 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.537253  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:26.541483   431 tablet_replica.cc:333] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.541486  9814 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.542554   431 raft_consensus.cc:2243] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.542244  9814 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.543165   431 raft_consensus.cc:2272] T ec0ffdd8e20a4befaef11295a994679c P b8ff9782cd95483c905cd1d906f41aaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.544929  9814 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.521356  9805 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.551527   431 tablet_replica.cc:333] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.552467   431 raft_consensus.cc:2243] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.553061   431 raft_consensus.cc:2272] T c57c0601cf944c57a1314b6605861f28 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.556161   431 tablet_replica.cc:333] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.556967   431 raft_consensus.cc:2243] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.557585   431 raft_consensus.cc:2272] T f99da1afef0249c084ef81484859e823 P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.560601   431 tablet_replica.cc:333] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
W20260709 13:03:26.561162  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.561422   431 raft_consensus.cc:2243] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.565223  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.566001  1677 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 26.
I20260709 13:03:26.583889   431 raft_consensus.cc:2272] T c0c802947c11486798c253f6688083e7 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.585354  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:26.591053  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.593281  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.593942  1677 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:26.596202   431 tablet_replica.cc:333] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.597159   431 raft_consensus.cc:2243] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.597856   431 raft_consensus.cc:2272] T 13e1eb7aa954478d88a68ebc9f886898 P b8ff9782cd95483c905cd1d906f41aaf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.600554   431 tablet_replica.cc:333] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.601295   431 raft_consensus.cc:2243] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.602370   431 raft_consensus.cc:2272] T 5b26794ff1394cec94107fd122031015 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:26.604893  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.596477  9811 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:26.606690  9811 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.607087  9811 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:26.611250   431 tablet_replica.cc:333] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.612352   431 raft_consensus.cc:2243] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.613041   431 raft_consensus.cc:2272] T 4390bd9839c84c1e88aa862d642a1b1e P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.620795   431 tablet_replica.cc:333] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.621615   431 raft_consensus.cc:2243] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.622432   431 raft_consensus.cc:2272] T 74bb1ccc79844935814ecd1a9a89fcd9 P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.629020   431 tablet_replica.cc:333] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.629839   431 raft_consensus.cc:2243] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.630450   431 raft_consensus.cc:2272] T fa9afdc16bf6430d9b895aefc4432c77 P b8ff9782cd95483c905cd1d906f41aaf [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:26.630990  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.637079  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:26.630508  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.637399   431 tablet_replica.cc:333] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
W20260709 13:03:26.639076  1648 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.639379   431 raft_consensus.cc:2243] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.639714  9815 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:26.640357  9815 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.640730  9815 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:26.642158   431 raft_consensus.cc:2272] T 967a91b43b06439992ab8ede24bc873d P b8ff9782cd95483c905cd1d906f41aaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.649103   431 tablet_replica.cc:333] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.649923   431 raft_consensus.cc:2243] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.649211  9815 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.650698  9816 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.651305  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.652092  9816 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:26.656562  1574 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:26.657670  1574 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.632462  9811 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:26.660966  1648 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.661520  9760 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.661737  9805 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.661921   431 raft_consensus.cc:2272] T 2d85e1fb5b4b419c96d985561042498a P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.663074  9810 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:26.664692  9816 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:26.665107  9815 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.666113  1648 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.667321  9760 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.671221  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:26.672421  1648 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.672914  1648 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.675303  9715 raft_consensus.cc:2749] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.676708  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:26.677280  9760 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.677798  9816 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:26.679064   431 tablet_replica.cc:333] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.679872   431 raft_consensus.cc:2243] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:26.680661  2226 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.681154   431 raft_consensus.cc:2272] T 460ae43de4d04023a24854ca2a19da88 P b8ff9782cd95483c905cd1d906f41aaf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:26.685894  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.686479  1648 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.687268  9715 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:26.688658  1682 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 22: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:26.689779  9811 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:26.690518  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:26.691112  1677 raft_consensus.cc:3060] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:03:26.694933  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.670980  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.696885  9815 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:26.697296  9815 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.697698  9815 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:26.700471  1574 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.701674  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:26.703068  2261 raft_consensus.cc:2393] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 22: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:26.701821  1677 raft_consensus.cc:2468] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 27.
I20260709 13:03:26.709478  9815 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.711786  9815 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.716495   431 tablet_replica.cc:333] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.717300   431 raft_consensus.cc:2243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.718161   431 raft_consensus.cc:2272] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b8ff9782cd95483c905cd1d906f41aaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.720999   431 tablet_replica.cc:333] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.721807   431 raft_consensus.cc:2243] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.722390   431 raft_consensus.cc:2272] T e2ca98d137184e478468c21f485fafa4 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.725323  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.726083  1677 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:26.725307  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:26.727726  1574 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.728569  1574 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.729120  9805 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:26.729344  9815 raft_consensus.cc:2804] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:26.729884  9815 raft_consensus.cc:697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 27 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
W20260709 13:03:26.729945  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:26.730692  9760 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.730916  9815 consensus_queue.cc:237] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.731272  9760 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.733665  9760 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.737428  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:26.737813  2226 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.738179  9715 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:26.739148  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14da2914452f44cca76332a550a28b6b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:26.739714  1677 raft_consensus.cc:3060] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:26.740556  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.741284   431 tablet_replica.cc:333] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.741670  9760 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.742077  9760 raft_consensus.cc:493] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.742425  9760 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.746704   431 raft_consensus.cc:2243] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.747820  9795 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.750110  9795 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.752463  9795 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.748287   431 raft_consensus.cc:2272] T 3ac98493907d499f8fa4ad8002393318 P b8ff9782cd95483c905cd1d906f41aaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.755940  1677 raft_consensus.cc:2468] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:26.757968   431 tablet_replica.cc:333] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.758756   431 raft_consensus.cc:2243] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.759521   431 raft_consensus.cc:2272] T a266117eb57049ceb80c4acd77766559 P b8ff9782cd95483c905cd1d906f41aaf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.765156  9760 raft_consensus.cc:515] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.769166  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.770774  1574 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:26.771986  1574 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.769835  1678 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:26.779277  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.779328  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:26.785714  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.787758  9805 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:26.788496  2226 leader_election.cc:336] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.779371  9795 raft_consensus.cc:2804] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:26.793335  9795 raft_consensus.cc:697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:26.794350  9795 consensus_queue.cc:237] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.795598  1426 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.787094  9815 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:26.798292  1426 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.799121  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56462 (request call id 345) took 6585 ms. Trace:
I20260709 13:03:26.801087  9815 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.805774  9815 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:26.806636  9760 leader_election.cc:290] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:26.809134   431 tablet_replica.cc:333] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf: stopping tablet replica
I20260709 13:03:26.809914   431 raft_consensus.cc:2243] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.800822  1426 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.812083  1426 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.813473  1426 catalog_manager.cc:5697] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.815531  1426 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:26.817545  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28aac236b62437d9a0603913d696ce7" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:26.816906  1426 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: true } } }
I20260709 13:03:26.819397  1677 raft_consensus.cc:3060] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.820799   431 raft_consensus.cc:2272] T 15aeeeb202e74ebd91872b6a150c5ddc P b8ff9782cd95483c905cd1d906f41aaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.801604  1428 rpcz_store.cc:276] 0709 13:03:20.213310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.213545 (+   235us) service_pool.cc:224] Handling call
0709 13:03:26.799050 (+6585505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:26.584082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:26.603037 (+ 18955us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:26.603075 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:26.603094 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:26.603512 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:26.603593 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:26.603622 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:26.603925 (+   303us) tablet.cc:701] Row locks acquired
0709 13:03:26.603943 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:26.604091 (+   148us) write_op.cc:270] Start()
0709 13:03:26.604204 (+   113us) write_op.cc:276] Timestamp: P: 1783602206604039 usec, L: 0
0709 13:03:26.604225 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:26.604914 (+   689us) log.cc:844] Serialized 929 byte log entry
0709 13:03:26.682181 (+ 77267us) op_driver.cc:464] REPLICATION: finished
0709 13:03:26.702422 (+ 20241us) write_op.cc:301] APPLY: starting
0709 13:03:26.702508 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:26.704146 (+  1638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:26.704239 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.726673 (+ 22434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.726873 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:03:26.726919 (+    46us) write_op.cc:312] APPLY: finished
0709 13:03:26.727113 (+   194us) log.cc:844] Serialized 33 byte log entry
0709 13:03:26.727273 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.727363 (+    90us) write_op.cc:454] Released schema lock
0709 13:03:26.727403 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:26.765874 (+ 38471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.765910 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50860,"reported_tablets":46,"spinlock_wait_cycles":26624,"child_traces":[["op",{"apply.queue_time_us":19945,"apply.run_cpu_time_us":4706,"apply.run_wall_time_us":63427,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12507,"num_ops":2,"prepare.queue_time_us":166702,"prepare.run_cpu_time_us":2944,"prepare.run_wall_time_us":21156,"replication_time_us":77786,"thread_start_us":156916,"threads_started":2}]]}
I20260709 13:03:26.841041  1677 raft_consensus.cc:2468] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:26.844101  2226 leader_election.cc:304] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.845283  9805 raft_consensus.cc:2804] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:26.845860  9805 raft_consensus.cc:697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:26.869685  9805 consensus_queue.cc:237] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:26.887360  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:26.868063  9815 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.890298  9815 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:26.893863  1574 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.900110  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61a4d068974252b4a051adf9e9b27b" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:26.900751  1677 raft_consensus.cc:3060] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:26.919597  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:26.934221  1677 raft_consensus.cc:2468] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:26.941848  1574 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:26.942759  9795 raft_consensus.cc:2804] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:26.943369  9795 raft_consensus.cc:697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:26.944550  9795 consensus_queue.cc:237] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:26.946983  1430 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
I20260709 13:03:26.964027  1426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56452 (request call id 365) took 1127 ms. Trace:
W20260709 13:03:26.966817  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.964483  1426 rpcz_store.cc:276] 0709 13:03:25.836730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.837643 (+   913us) service_pool.cc:224] Handling call
0709 13:03:26.963942 (+1126299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:26.832610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:26.833139 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:26.833173 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:03:26.833187 (+    14us) tablet.cc:662] Decoding operations
0709 13:03:26.833999 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:26.834062 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:26.834095 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:26.834713 (+   618us) tablet.cc:701] Row locks acquired
0709 13:03:26.834731 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:26.834875 (+   144us) write_op.cc:270] Start()
0709 13:03:26.834985 (+   110us) write_op.cc:276] Timestamp: P: 1783602206834828 usec, L: 0
0709 13:03:26.835006 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:26.835646 (+   640us) log.cc:844] Serialized 2919 byte log entry
0709 13:03:26.856979 (+ 21333us) op_driver.cc:464] REPLICATION: finished
0709 13:03:26.857383 (+   404us) write_op.cc:301] APPLY: starting
0709 13:03:26.857457 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:26.889446 (+ 31989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:26.889539 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.915339 (+ 25800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.915544 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:03:26.915591 (+    47us) write_op.cc:312] APPLY: finished
0709 13:03:26.915934 (+   343us) log.cc:844] Serialized 73 byte log entry
0709 13:03:26.936498 (+ 20564us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.936621 (+   123us) write_op.cc:454] Released schema lock
0709 13:03:26.936675 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:26.937076 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.937102 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9086,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":10877,"apply.run_wall_time_us":79653,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29330,"num_ops":7,"prepare.queue_time_us":7196,"prepare.run_cpu_time_us":3432,"prepare.run_wall_time_us":11011,"replication_time_us":21852,"spinlock_wait_cycles":2304}]]}
W20260709 13:03:26.993088  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:26.997828  9826 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:26.998562  9826 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:26.995481  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: config changed from index 14 to 17, 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } } }
W20260709 13:03:27.003722  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:27.003913  1430 catalog_manager.cc:5697] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 20 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.013464  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.014247  2255 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 27.
I20260709 13:03:27.015707  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.016721  9816 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:27.017107  9816 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.017518  9816 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:27.027663  9816 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.031667  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:27.032392  2261 raft_consensus.cc:3060] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:27.032478  9828 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.033766  9828 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.035938  9828 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:27.036074  1648 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:27.032405  9826 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:27.039655  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:27.041069  1574 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:27.041611  1573 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.044829  2261 raft_consensus.cc:2468] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 28.
I20260709 13:03:27.046239  1647 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.048764  9828 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:27.048694  9826 raft_consensus.cc:2804] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:27.051275  9826 raft_consensus.cc:697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:27.052183  9826 consensus_queue.cc:237] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.056993  1424 catalog_manager.cc:5697] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 26 to 27, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 27 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.059079  1424 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b8ff9782cd95483c905cd1d906f41aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } }
I20260709 13:03:27.061141  1424 catalog_manager.cc:5697] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 22 to 23, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 23 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.063203  1424 catalog_manager.cc:5697] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 21 to 22, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.069471  9816 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:27.116578  1648 connection.cc:573] client connection to 127.0.107.193:36133 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:03:27.158977  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.176437  9567 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.177074  9567 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.179024  9567 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.180061  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.180706  1601 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:27.181883  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:27.182716  9567 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:27.183142  9567 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.183526  9567 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.190804  9567 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.207504  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:27.208093  1601 raft_consensus.cc:3060] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.215157  1601 raft_consensus.cc:2468] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:27.216711  2227 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:27.217754  9805 raft_consensus.cc:2804] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:27.217941  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.218436  9805 raft_consensus.cc:697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:27.219653  9805 consensus_queue.cc:237] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.227124  1428 catalog_manager.cc:5697] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 27 to 28, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 28 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.229652  9567 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.238659  1678 raft_consensus.cc:1275] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:03:27.240486  9828 consensus_queue.cc:1048] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:27.245189  9814 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.245818  9814 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.256517  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.257265  1677 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
W20260709 13:03:27.258219  1574 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.258910  1682 raft_consensus.cc:1275] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:03:27.266167  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.248116  9814 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.268328  9828 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:27.268780  9828 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.269177  9828 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:27.282639  9814 consensus_queue.cc:1048] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:27.297397  9814 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.298012  9814 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.301409  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.315496  9814 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:27.328979  2226 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.329982  2226 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.344627  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:27.366428  1424 catalog_manager.cc:5697] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.338879  9828 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.379221  9828 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:27.386353  9161 tablet_copy_client.cc:1131] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.416098  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.416690  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:27.443497  1676 raft_consensus.cc:1275] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:27.457841  2255 raft_consensus.cc:1275] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:03:27.460826  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7bd80f58e444e6a587b05deed3c5f5" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:27.461663  1682 raft_consensus.cc:3060] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:27.472491  1574 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.472798  1682 raft_consensus.cc:2468] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:27.473033  1574 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.476725  9814 raft_consensus.cc:2749] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.499051  9843 consensus_queue.cc:1048] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:03:27.521957  9835 log.cc:927] Time spent T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: Append to log took a long time: real 0.060s	user 0.024s	sys 0.009s
I20260709 13:03:27.523082  9715 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.528509  1574 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:27.535552  9828 raft_consensus.cc:2804] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:27.538484  9715 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.536123  9828 raft_consensus.cc:697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:27.528100  9805 consensus_queue.cc:1048] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
W20260709 13:03:27.566869  1648 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.572151  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.578523  9828 consensus_queue.cc:237] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.581583  9715 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:27.590350  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.596103  9842 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.596836  9842 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.600368  9842 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:27.603305  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.601063  9842 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.606366  9842 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:27.619931  1648 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.621533  9842 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:27.623132  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.624681  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.626117  9842 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:27.630136  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.630290  1424 catalog_manager.cc:5697] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 22 to 23, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 23 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.637566  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.632475  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:27.632946  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 104524us
I20260709 13:03:27.639991  9850 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:27.674511  1605 raft_consensus.cc:1275] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:27.676080  9805 consensus_queue.cc:1048] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:03:27.682983  1574 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.684883  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.686565  1647 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.688688  9850 raft_consensus.cc:2749] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:27.691442  1677 raft_consensus.cc:1275] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:27.716943  9828 consensus_queue.cc:1048] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:03:27.729176  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:27.793761  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:27.827826  9842 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.828461  9842 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.828908  9715 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.829540  9715 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.830765  9842 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.831363  9760 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.831925  9760 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.834105  9760 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.834172  9850 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.835891  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.836027  9842 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.836680  9842 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.836620  1601 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 17.
I20260709 13:03:27.834738  9850 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.839216  9842 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.840793  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.838649  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.832031  9715 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:27.846163  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:27.847141  9815 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.847195  9760 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.848755  9760 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.850005  9850 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.850988  9760 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.852519  9841 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.853044  9841 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.854108  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.854720  2261 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 26.
I20260709 13:03:27.855185  9841 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.856161  9828 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.856694  9828 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.858916  9828 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.859504  9828 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.860605  9844 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.861217  9844 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.860040  9828 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.847790  9815 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.863456  9844 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:27.864075  9805 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.864560  9805 raft_consensus.cc:493] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.865041  9805 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.867002  9815 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.869356  9847 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.869966  9847 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.871958  9847 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.875835  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.877177  9858 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.880692  9858 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.887499  9857 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.888131  9857 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.882344  9805 raft_consensus.cc:515] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.884474  9760 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.891238  9760 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.893873  9760 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.864849  9828 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.896544  9847 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.897153  9847 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:27.897711  9844 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.896737  9858 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.898321  9844 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.900592  9844 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:27.902009  1648 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.902583  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.902972  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.905956  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.906626  1601 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
W20260709 13:03:27.895052  2226 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.903672  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:27.908854  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:27.909173  2226 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.907959  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:27.911252  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:27.911826  1574 leader_election.cc:336] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:27.912294  1574 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.922683  9567 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.923455  9567 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.913517  9844 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.925835  9805 leader_election.cc:290] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.933008  9805 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.933229  9847 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.927832  9844 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:27.934947  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.935401  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.935575  9844 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.936249  9805 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:27.937333  1648 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.938380  9805 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:27.939071  9850 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.925751  9567 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:27.940639  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.941243  1677 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 26.
I20260709 13:03:27.942272  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.942790  9842 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.942929  1600 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:27.943509  9849 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:27.943384  9842 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:27.944095  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368dba0d8eac439897c0b05b32e05500" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:27.944717  1605 raft_consensus.cc:3060] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.942919  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.945772  9842 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:27.943264  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.946869  9842 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:27.947436  9842 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.947911  9842 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:27.942925  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.949769  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:27.951434  9858 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:27.951974  9858 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.952446  9858 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.955051  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.954609  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:27.956656  9841 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:27.957098  9841 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.957501  9841 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.960831  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.961503  1677 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 21.
I20260709 13:03:27.963285  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.963923  1677 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:27.965494  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.956627  1601 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:27.966089  1677 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 18.
I20260709 13:03:27.963128  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:27.970481  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.970978  1605 raft_consensus.cc:2468] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 18.
I20260709 13:03:27.974689  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:27.971359  1677 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
W20260709 13:03:27.976755  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 63250.9us
I20260709 13:03:27.981065  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:27.981765  2261 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:27.971246  9760 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:27.985576  9760 raft_consensus.cc:493] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:27.985975  9760 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.988883  2227 leader_election.cc:304] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
W20260709 13:03:27.992769  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:27.996366  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:27.997067  1677 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:27.998600  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:28.001120  9567 raft_consensus.cc:2804] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:27.997520  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.001670  9567 raft_consensus.cc:697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:28.002563  9567 consensus_queue.cc:237] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.006054  9850 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.006520  9850 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.006886  9850 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.007326  9858 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.008582  9826 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.009104  9826 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.009514  9826 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.013018  9805 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.013612  9805 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.016724  9805 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.017206  9849 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.017765  9849 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.017201  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:28.018747  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 20.
I20260709 13:03:28.020639  9849 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.020964  9857 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.022651  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:28.022804  9847 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.023423  9847 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.023744  9842 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.025484  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:28.026191  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:28.023005  1574 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.026859  2261 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:03:28.029486  2226 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.030170  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.034296  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.035257  1649 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.037055  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.038008  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.039137  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.043035  9814 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.043506  9814 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.040077  9816 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:28.043941  9814 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.049429  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.051651  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:28.052592  2261 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:28.036329  9844 raft_consensus.cc:2749] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.036192  9849 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.052845  9847 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.039081  9815 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:28.056883  9815 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.057301  9815 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.047565  9801 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.058746  9801 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.059125  9801 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.043989  9816 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.056154  9849 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.060717  9857 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:28.061183  9857 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.061553  9857 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:28.060105  9816 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.062592  9849 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.067658  9850 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.072899  9795 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:28.084617  9849 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.084626  9850 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.085484  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:28.086853  9715 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.088224  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:28.096254  1601 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 18.
I20260709 13:03:28.090381  1424 catalog_manager.cc:5697] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 17 to 18, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 18 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.099041  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.101418  9715 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.103564  9850 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.104110  9850 raft_consensus.cc:493] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.104559  9850 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.110733  9814 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.092420  9795 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.117854  9795 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:28.118448  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:28.102344  9849 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.117208  9858 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.122125  9849 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:28.122611  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.069322  9841 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.125535  1601 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:28.127003  9795 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.129153  9795 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.129837  9842 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.133849  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:28.134495  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:28.135295  2255 raft_consensus.cc:2393] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:28.133688  9715 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.136519  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:28.137095  2252 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:28.138249  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:28.139343  9861 log.cc:927] Time spent T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:28.140065  9841 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.140666  9842 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:28.141119  9842 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.141538  9842 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:28.143637  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 105843us
W20260709 13:03:28.144384   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1555)
I20260709 13:03:28.144433  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:28.144583  1648 leader_election.cc:336] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.146332  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.148052  9805 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:28.152617  1648 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.153273  1648 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.155107  9842 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.163390  9857 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.169310  9826 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.171588  9826 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:28.184423  1648 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.186316  9760 raft_consensus.cc:515] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:28.187798  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 138485us
W20260709 13:03:28.223712  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 124762us
W20260709 13:03:28.224169  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 79839.2us
I20260709 13:03:28.186568  9801 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:28.257511  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 48818.4us
I20260709 13:03:28.257438  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.258567  9801 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.203485  9816 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.224525  9760 leader_election.cc:290] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.262461  9858 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:28.262950  9858 raft_consensus.cc:493] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.263482  9858 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:28.263873  9816 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.201381  9815 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.265882  9815 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.199131  9857 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.240844  9842 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.188560  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:28.266975  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 78498.8us
I20260709 13:03:28.268102  9801 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:28.268510  9801 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.268918  9801 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:28.269740  9848 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.270303  9848 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:28.272783  1574 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.273221  1574 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.244688  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b26794ff1394cec94107fd122031015" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
W20260709 13:03:28.274199  1574 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.248237  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:28.248564  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac98493907d499f8fa4ad8002393318" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:28.275012  2252 raft_consensus.cc:3060] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.275502  9848 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.275074  2255 raft_consensus.cc:3060] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.249918  9850 raft_consensus.cc:515] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.278092  9814 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.278607  9850 leader_election.cc:290] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.279503  1605 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 19: Already voted for candidate 428f0180c2cd487c8b48e91f14dff65d in this term.
I20260709 13:03:28.198276  2261 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 27: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:28.274328  1601 raft_consensus.cc:3060] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.247000  9805 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.284861  2252 raft_consensus.cc:2468] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:28.284682  9805 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:28.273270  1648 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.300705  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
W20260709 13:03:28.320516  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 47268.4us
I20260709 13:03:28.295374  9760 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
W20260709 13:03:28.297116  2226 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.296020  1601 raft_consensus.cc:2468] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 21.
I20260709 13:03:28.320850  1682 raft_consensus.cc:2393] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 27: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:28.323376  9760 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.324330  9841 raft_consensus.cc:2749] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:28.325578  9760 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:28.290342  9805 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.310130  2255 raft_consensus.cc:2468] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:28.291610  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:28.312695  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:28.331660  1605 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:28.308992  9858 raft_consensus.cc:515] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.318621  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:28.332943  1677 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:28.302119  9801 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.333774  1678 raft_consensus.cc:2393] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:28.315750  1647 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:28.327966  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:28.320680  1574 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.335131  2226 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.335827  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.341073  9858 leader_election.cc:290] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:28.335186  9801 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:28.342474  2226 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.343324  2226 leader_election.cc:336] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.335858  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.344107  1648 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.344334  9867 raft_consensus.cc:2804] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:28.344564  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.347798  9867 raft_consensus.cc:697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:28.348727  9867 consensus_queue.cc:237] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.348759  9866 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:03:28.353341  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:28.353865  1601 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.355672  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:28.356274  2261 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:28.357577  2227 leader_election.cc:304] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:28.357954  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bb1ccc79844935814ecd1a9a89fcd9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:28.358587  1607 raft_consensus.cc:3060] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.361249  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.362162  9866 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.367882  1601 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:28.375075  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
W20260709 13:03:28.376389  1648 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.377478  2255 raft_consensus.cc:3060] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:28.377564  1648 leader_election.cc:336] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.380894  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.381642  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:28.382266  1601 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 19.
I20260709 13:03:28.382820  1607 raft_consensus.cc:2468] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
I20260709 13:03:28.387287  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.391358  1573 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:28.400444  9801 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:28.400920  9801 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.401419  9801 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:28.408563  9801 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.396517  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:28.412544  1678 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
W20260709 13:03:28.411758  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.413825  1424 catalog_manager.cc:5697] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 19 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.416520  1574 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.417339  1574 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.417739  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.420471  9841 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:28.421627  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.422405  9801 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:28.430034  9867 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:28.430487  9867 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8ff9782cd95483c905cd1d906f41aaf)
I20260709 13:03:28.430845  9867 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:28.438081  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.438935  9867 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:28.446967  1648 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.447990  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 60755.5us
W20260709 13:03:28.448511  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.448977  1574 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.449438  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:28.449854  1574 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.450253  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.450562  1574 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.451960  9801 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.381526  9805 raft_consensus.cc:2804] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:28.453187  1574 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.453806  1574 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.453985  9805 raft_consensus.cc:697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:28.454564  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.455319  1574 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.455801  9867 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:28.456849  1574 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.455228  9805 consensus_queue.cc:237] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.395766  1647 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:28.468998  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 73306.9us
I20260709 13:03:28.469676  9850 raft_consensus.cc:2804] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:28.470217  9850 raft_consensus.cc:697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:28.471050  9850 consensus_queue.cc:237] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.472172  1649 leader_election.cc:304] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.473848  9866 raft_consensus.cc:2804] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:28.474323  9866 raft_consensus.cc:697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:28.475526  9866 consensus_queue.cc:237] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:28.479421  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 80306.4us
W20260709 13:03:28.480057  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.483937  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c7c569add7422d840ba6ea7ea7ac47" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.494302  1678 raft_consensus.cc:3060] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:28.502570  1678 raft_consensus.cc:2468] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
W20260709 13:03:28.505874  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.506879  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.508183  9760 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.526904  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aeeeb202e74ebd91872b6a150c5ddc" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:28.527776  2252 raft_consensus.cc:3060] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:28.486068  2255 raft_consensus.cc:2468] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
W20260709 13:03:28.488077  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:28.575043  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 86793.6us
I20260709 13:03:28.577668  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:28.581970  1601 raft_consensus.cc:3060] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:28.584774  1574 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.539476  1678 raft_consensus.cc:1275] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:28.544021  2252 raft_consensus.cc:2468] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:28.622921  1428 catalog_manager.cc:5697] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 21 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.653218  1601 raft_consensus.cc:2468] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:03:28.541342  2226 leader_election.cc:336] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:28.655792  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:28.654973  1424 catalog_manager.cc:5697] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.657070  1678 raft_consensus.cc:2393] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 21: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:28.660879  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df548e1d094249d5ac1f6ffa2f7d9885" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.661685  1678 raft_consensus.cc:3060] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:28.669401  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.675130  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.676102  1682 raft_consensus.cc:2393] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 428f0180c2cd487c8b48e91f14dff65d in current term 19: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:28.676430  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c802947c11486798c253f6688083e7" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.676783  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "967a91b43b06439992ab8ede24bc873d" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.677407  1675 raft_consensus.cc:3060] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:28.678331  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bf9f3ae6ad4d89af59a7b75960caa6" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:28.679075  1681 raft_consensus.cc:3060] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.677546  1676 raft_consensus.cc:3060] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:28.691102  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 149652us
W20260709 13:03:28.693943  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 50135.8us
I20260709 13:03:28.706661  1675 raft_consensus.cc:2468] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 23.
I20260709 13:03:28.707780  1678 raft_consensus.cc:2468] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 24.
I20260709 13:03:28.711889  2227 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:28.713267  9805 raft_consensus.cc:2764] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:03:28.721160  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:28.730847  9801 consensus_queue.cc:1048] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:28.732805  1574 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.750370  9841 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:28.747421  1676 raft_consensus.cc:2468] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:28.750547  1681 raft_consensus.cc:2468] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 22.
I20260709 13:03:28.751822  1424 catalog_manager.cc:5697] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 19 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.763561  1574 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.772450  9841 raft_consensus.cc:2749] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:28.777779  2226 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:28.807780  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.819192  1649 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.820446  9866 raft_consensus.cc:2804] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:28.821013  9866 raft_consensus.cc:697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:28.822201  9866 consensus_queue.cc:237] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.830724  1647 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.833212  1573 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.834339  9850 raft_consensus.cc:2804] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:28.836573  9815 raft_consensus.cc:2804] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:28.837170  9815 raft_consensus.cc:697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:28.838228  9815 consensus_queue.cc:237] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.848624  1574 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.849304  9850 raft_consensus.cc:697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:28.850735  9850 consensus_queue.cc:237] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:28.861860  9801 raft_consensus.cc:2804] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:28.862514  9801 raft_consensus.cc:697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:28.863557  9801 consensus_queue.cc:237] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:28.879572  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.881728  9858 raft_consensus.cc:2749] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:03:28.885008  2226 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.893128  2252 raft_consensus.cc:1275] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:28.910106  9805 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:28.945911  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 60988.6us
I20260709 13:03:28.945279  1424 catalog_manager.cc:5697] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.947218  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:28.950348  9805 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.950387  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.969087  9805 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:28.969636  9805 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.970016  9805 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:28.956949  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.970556  9876 consensus_queue.cc:1048] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
W20260709 13:03:28.975561  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.976536  1424 catalog_manager.cc:5697] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 19 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.991621  2226 leader_election.cc:304] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:28.992782  9858 raft_consensus.cc:2804] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:28.993361  9858 raft_consensus.cc:697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:28.994589  9858 consensus_queue.cc:237] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:29.016585  2255 raft_consensus.cc:1275] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:29.023452  1574 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:29.028610  9841 raft_consensus.cc:2804] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:29.029261  9841 raft_consensus.cc:697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:29.030385  9841 consensus_queue.cc:237] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:29.048943  1574 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:29.064458  9867 consensus_queue.cc:1048] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:03:29.065539  1600 raft_consensus.cc:1275] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:29.070786  9883 raft_consensus.cc:2804] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:29.068550  1424 catalog_manager.cc:5697] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 22 to 23, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 23 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.087527  1600 raft_consensus.cc:1275] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:29.089244  9876 consensus_queue.cc:1048] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:29.071527  9883 raft_consensus.cc:697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:29.102061  9883 consensus_queue.cc:237] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:29.115252  9760 consensus_queue.cc:1048] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:03:29.120240  1648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111) [suppressed 273 similar messages]
I20260709 13:03:29.076056  9805 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:29.125712  9805 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:29.127103  1430 catalog_manager.cc:5697] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 20 to 21, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.145812   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:29.177194  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 128403us
I20260709 13:03:29.195169  1574 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:29.197795  9888 raft_consensus.cc:2804] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:29.198388  9888 raft_consensus.cc:697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:29.199460  9888 consensus_queue.cc:237] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:29.260780  1428 catalog_manager.cc:5697] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 22 to 23, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 23 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:29.277505  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:29.287182  1605 raft_consensus.cc:1275] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:29.305624  1601 raft_consensus.cc:1275] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:29.302742  1424 catalog_manager.cc:5697] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 23 to 24, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 24 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.307883  9858 consensus_queue.cc:1048] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:29.308341  1424 catalog_manager.cc:5697] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 19, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 19 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.313071  2258 raft_consensus.cc:1275] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:29.323107  9874 consensus_queue.cc:1048] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:29.323961  9883 consensus_queue.cc:1048] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:03:29.337728  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 61409.4us
W20260709 13:03:29.349035  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 71524.9us
I20260709 13:03:29.357287  1604 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 13:03:29.358228  2226 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:29.374212  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.387617  2226 leader_election.cc:336] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:29.397599  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.381675  9850 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
W20260709 13:03:29.419659  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.426566  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.436043  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.437141  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.454571  2226 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:29.455354  1681 raft_consensus.cc:1275] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:03:29.478971  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.504871  1424 catalog_manager.cc:5697] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 21 to 22, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 22 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.529881  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:29.530550  1677 raft_consensus.cc:3060] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:29.547075  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.547122  1574 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.551406  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.515594  9883 consensus_queue.cc:1048] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:03:29.555478  1677 raft_consensus.cc:2468] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 23.
I20260709 13:03:29.563958  1677 raft_consensus.cc:1275] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:03:29.605360  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.631474  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.632201  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.632615  1574 consensus_peers.cc:597] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.643035  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42185, user_credentials={real_user=slave}} blocked reactor thread for 82921.6us
W20260709 13:03:29.675323  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:29.698989  1677 raft_consensus.cc:1275] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:29.705333  2226 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:29.708513  1676 raft_consensus.cc:1275] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:29.720788  2261 raft_consensus.cc:1275] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:29.721808  9895 raft_consensus.cc:2804] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:29.742707  9895 raft_consensus.cc:697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:29.743759  9895 consensus_queue.cc:237] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:29.746647  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:29.726228  1676 raft_consensus.cc:1275] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:29.726845  9896 consensus_queue.cc:1048] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:03:29.728292  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:29.728920  9881 consensus_queue.cc:1048] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:29.731673  9842 consensus_queue.cc:1048] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:29.736685  9801 consensus_queue.cc:1048] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:29.763116  9801 consensus_queue.cc:1048] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:03:29.812299  1574 consensus_peers.cc:597] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.878962  1430 catalog_manager.cc:5697] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 21 to 23, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 23 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:29.990118  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:30.023867  9881 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.024572  9881 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:30.026682  9881 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:30.028177  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:30.029225  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 19.
I20260709 13:03:30.030500  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:30.031344  9815 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:30.031733  9815 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.032071  9815 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.040223  9815 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:30.045773  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82df41f800684066955da1e5fcf37da0" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:30.046379  2261 raft_consensus.cc:3060] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.055097  2261 raft_consensus.cc:2468] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 428f0180c2cd487c8b48e91f14dff65d in term 20.
I20260709 13:03:30.058255  9815 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:30.062075  1573 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af; no voters: 
I20260709 13:03:30.063949  9888 raft_consensus.cc:2804] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:30.064567  9888 raft_consensus.cc:697] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Becoming Leader. State: Replica: 428f0180c2cd487c8b48e91f14dff65d, State: Running, Role: LEADER
I20260709 13:03:30.065510  9888 consensus_queue.cc:237] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:30.146332   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:30.175503  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.190711  1424 catalog_manager.cc:5697] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d reported cstate change: term changed from 18 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194). New cstate: current_term: 20 leader_uuid: "428f0180c2cd487c8b48e91f14dff65d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.248792  9878 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.249435  9878 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:30.251801  9878 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:30.267552  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:30.268412  1601 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 19.
W20260709 13:03:30.300902  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:30.309955  9866 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.311074  9866 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:30.312844  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.313757  9866 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:30.315805  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:30.316641  2260 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 27.
I20260709 13:03:30.319597  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:30.326016  1648 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:30.340126  9874 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:30.340745  9874 raft_consensus.cc:493] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.341154  9874 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:30.357026  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:30.367321  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:30.368844  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:30.368602  1574 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:30.378614  9866 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:30.379092  9866 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.379462  9866 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:30.391089  1676 raft_consensus.cc:1275] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Refusing update from remote peer 9b6586a864a94c019cae2d8e2987a7af: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:30.388830  9874 raft_consensus.cc:515] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:30.418738  9858 consensus_queue.cc:1048] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:30.421481  9866 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:30.427917  9866 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:30.441818  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:30.453150  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:30.453780  1648 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:30.483028  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fd60901f543758f2f446ee106cf32" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:30.483742  2260 raft_consensus.cc:3060] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:30.523849  2260 raft_consensus.cc:2468] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 28.
I20260709 13:03:30.551880  1647 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:30.555737  9867 raft_consensus.cc:2804] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:30.556439  9867 raft_consensus.cc:697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:30.557549  9867 consensus_queue.cc:237] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 26.21, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:30.560776  1648 leader_election.cc:336] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:30.580976  9874 leader_election.cc:290] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Requested vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:30.586732  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.612910  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4203acf1edca42708e1990f548ab96b3" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d"
I20260709 13:03:30.613691  1601 raft_consensus.cc:3060] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.617216  1424 catalog_manager.cc:5697] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 26 to 28, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 28 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.621058  1601 raft_consensus.cc:2468] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
I20260709 13:03:30.628232  2258 raft_consensus.cc:1275] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Refusing update from remote peer 428f0180c2cd487c8b48e91f14dff65d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:30.630038  9887 consensus_queue.cc:1048] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:30.633399  1649 leader_election.cc:304] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b; no voters: b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:30.634867  9866 raft_consensus.cc:2804] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:30.635358  9866 raft_consensus.cc:697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:30.636196  9866 consensus_queue.cc:237] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:30.724856  1424 catalog_manager.cc:5697] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 18 to 20, leader changed from b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 20 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:30.758000  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:30.758525  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.803184  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.825702  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:30.845094  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.880612  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:30.944479  2260 raft_consensus.cc:1275] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 26 index: 21. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260709 13:03:30.946316  9926 consensus_queue.cc:1048] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
W20260709 13:03:30.961445  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.021404  1600 raft_consensus.cc:1275] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:31.024340  9842 consensus_queue.cc:1048] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:31.040802  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.064273  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.110142  9932 log.cc:927] Time spent T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:31.117959  1421 maintenance_manager.cc:419] P 3fc8854ff8e34244b91acf19f7f50f8a: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033395
W20260709 13:03:31.147935   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:31.178802  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.210814  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.298199  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:31.365773  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.386422  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:31.560460  1420 maintenance_manager.cc:643] P 3fc8854ff8e34244b91acf19f7f50f8a: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.441s	user 0.056s	sys 0.001s Metrics: {"bytes_written":10740,"delete_count":0,"lbm_write_time_us":1300,"lbm_writes_lt_1ms":8,"reinsert_count":0,"update_count":410}
I20260709 13:03:31.562702  1421 maintenance_manager.cc:419] P 3fc8854ff8e34244b91acf19f7f50f8a: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.464694
W20260709 13:03:32.148767   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:32.379757  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 818989us
I20260709 13:03:32.572533  9941 raft_consensus.cc:493] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.573119  9941 raft_consensus.cc:515] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:32.575217  9866 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:32.575865  9866 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:32.580919  9866 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:32.586802  9936 raft_consensus.cc:493] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:32.587450  9936 raft_consensus.cc:515] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.590109  9936 leader_election.cc:290] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:32.621183  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794b13e101914a9dbf12fa727a3e9e27" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.670876  9888 raft_consensus.cc:493] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.671590  9888 raft_consensus.cc:515] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.675356  9888 leader_election.cc:290] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:32.675999  9888 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.676687  9888 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.679868  9888 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:32.701604  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08001b37e0 after lost signal to thread 434
W20260709 13:03:32.702692  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080039f760 after lost signal to thread 1466
I20260709 13:03:32.697094  1420 maintenance_manager.cc:643] P 3fc8854ff8e34244b91acf19f7f50f8a: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.128s	user 0.140s	sys 0.000s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":31294,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":202050,"dirs.run_cpu_time_us":359,"dirs.run_wall_time_us":360,"lbm_read_time_us":208003,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":24,"lbm_write_time_us":2440,"lbm_writes_lt_1ms":13,"peak_mem_usage":612522,"reinsert_count":0,"thread_start_us":241148,"threads_started":1,"update_count":410}
W20260709 13:03:32.736290  2227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 114972us
W20260709 13:03:32.741731  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 49651.4us
I20260709 13:03:32.750187  9941 leader_election.cc:290] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.757091  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:32.763607  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800304720 after lost signal to thread 1633
W20260709 13:03:32.765422  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7de0 after lost signal to thread 1707
W20260709 13:03:32.766641  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08001b48a0 after lost signal to thread 2285
I20260709 13:03:32.767207  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:32.758352  9942 raft_consensus.cc:493] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.768150  9942 raft_consensus.cc:515] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } attrs { replace: true } } peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.770963  9942 leader_election.cc:290] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:32.775799  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800225700 after lost signal to thread 9867
W20260709 13:03:32.776273  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08002256a0 after lost signal to thread 9874
W20260709 13:03:32.776773  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080039b660 after lost signal to thread 9931
I20260709 13:03:32.788257  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.791042  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293a667c8bb4fdbb1fa97aaeba1cfc1" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:32.797453  1648 leader_election.cc:336] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:32.800277  1648 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:32.803124  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.801017  1648 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:32.778995  9947 raft_consensus.cc:493] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
W20260709 13:03:32.806777  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:32.807282  9951 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:32.789076  9938 raft_consensus.cc:493] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:32.796733  9896 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.809298  9896 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.811522  9896 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.798502  9858 raft_consensus.cc:493] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.813355  9858 raft_consensus.cc:515] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.815377  9858 leader_election.cc:290] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.821239  9938 raft_consensus.cc:515] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.824018  9938 leader_election.cc:290] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:32.827137  9950 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.828464  9896 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.829070  9896 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.831964  9896 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.844475  9896 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.845131  9896 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.847429  9896 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.848001  9947 raft_consensus.cc:515] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } attrs { replace: true } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.850909  9947 leader_election.cc:290] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.827826  9950 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.858489  9950 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:32.807550  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:32.860159  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52678.2us
W20260709 13:03:32.861887  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 53181.9us
I20260709 13:03:32.865387  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b33947f35745f4809f8a533ebbdaf8" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.871121  9949 raft_consensus.cc:493] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9b6586a864a94c019cae2d8e2987a7af)
I20260709 13:03:32.873428  9949 raft_consensus.cc:515] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.875583  9949 leader_election.cc:290] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:32.876375  9942 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.876665  9858 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.877206  9942 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.877261  9858 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.879307  9858 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.879323  9942 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.882380  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.871253  9950 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.884964  9950 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.887496  9950 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.865407  9896 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:32.889055  9896 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:32.891489  9896 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:32.892482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.894654  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.898094  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
I20260709 13:03:32.895757  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:32.925879  1648 leader_election.cc:336] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:32.928872  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d85e1fb5b4b419c96d985561042498a" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.930320  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bacb2b5d0c24f8685d90eeadc14dce3" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.931499  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76a019fbba44c8bb56f66d12c271c5" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.933874  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d1cf89bf84cc0b80b0dceda3cad18" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.937536  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6791fab1eefc49d1a3e2783c89cac6a8" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:32.941865  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986af52b7e6d4c60a353dbc998405797" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.955502  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2832a231368f4f5dbf9972f28f64f60e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.960942  1574 leader_election.cc:304] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:32.962783  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b401d5a3c6a44966a0c0a7453f379808" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.964143  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b12ac06d9474e6a97e219688d43cf30" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.973484  9946 raft_consensus.cc:2749] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:32.973388  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cddab79a6054062949d1d1c2453cc06" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.975214  1574 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:32.978703  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0746dbce2334050a0a5359c93c14f2c" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.985670  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:32.986987  9946 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:32.994974  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe16ef1967f47ba893ba6ba999c125c" candidate_uuid: "428f0180c2cd487c8b48e91f14dff65d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:32.994647  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e1eb7aa954478d88a68ebc9f886898" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:33.011051  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:33.015252  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e796444a6ddd47bd9129de2ab82200a6" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "428f0180c2cd487c8b48e91f14dff65d" is_pre_election: true
W20260709 13:03:32.992295  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.022858  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.023633  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.024224  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.024787  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:33.045894  2226 leader_election.cc:304] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:33.064265  1574 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:33.067483  1647 leader_election.cc:304] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.074994  9951 raft_consensus.cc:2749] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:33.077693  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.078574  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.079120  1574 leader_election.cc:336] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.079598  1574 leader_election.cc:304] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.081676  9952 raft_consensus.cc:2749] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:33.087013  9946 raft_consensus.cc:2749] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:33.088195  1574 leader_election.cc:336] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:33.089581  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:33.097064  1647 leader_election.cc:304] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.098132  9936 raft_consensus.cc:2749] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.082428  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:33.114624  9952 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:33.125901  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:33.133440  9952 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:33.134927  2226 leader_election.cc:304] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:33.146255  9896 raft_consensus.cc:2749] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:33.147984  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:33.149295   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1555)
I20260709 13:03:33.159436  9952 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:33.161428  2226 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:33.164218  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 68553.9us
W20260709 13:03:33.165930  1574 leader_election.cc:336] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.167204  9952 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:33.169405  2226 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:33.166555  1574 leader_election.cc:304] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 428f0180c2cd487c8b48e91f14dff65d; no voters: 9b6586a864a94c019cae2d8e2987a7af, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.181818  9946 raft_consensus.cc:2749] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:33.185065  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:33.186362  9952 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:33.280369  2226 leader_election.cc:336] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:33.281592  2226 leader_election.cc:336] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.282143  2226 leader_election.cc:304] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:33.325094  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.327124  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.327732  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:33.372787  9952 raft_consensus.cc:2749] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:03:33.375285  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 93551.2us
W20260709 13:03:33.376907  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.377664  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:33.411693  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:33.426859  9952 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:33.428541  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 51652.7us
W20260709 13:03:33.429207  2226 leader_election.cc:336] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:33.442564  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.443194  1574 consensus_peers.cc:597] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.444667  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 56265.9us
W20260709 13:03:33.445717  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.482038  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 52858.5us
W20260709 13:03:33.482735  2226 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.483208  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.483989  9952 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:33.485185  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:33.485653  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:33.486390  9952 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:33.487905  1574 consensus_peers.cc:597] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.606961  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.749738  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.803251  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.921569  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:33.957489  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.969364  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:33.990953  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:33.991673  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.110939  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.159225   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:34.172003  1574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111) [suppressed 346 similar messages]
W20260709 13:03:34.248391  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:34.254226  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.309715  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:34.358549  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.371006  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.374784  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 53489.8us
W20260709 13:03:34.447242  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.487641  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.563586  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:34.743389  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.747092  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.914407  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.950505  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:34.952392  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:35.086057  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.094954  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.142036  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.162987   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:36.007619  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.097345  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.103487  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.104177  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.104861  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.105957  1574 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.163915   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:36.173858  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.174922  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.175534  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.175979  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.179708  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.180790  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.193002  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.197099  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:36.478646  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:36.530043  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.572607  1574 consensus_peers.cc:597] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.597716  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.682816  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.683511  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.703233  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.707684  1574 consensus_peers.cc:597] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:36.837733  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.946393  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08003aeac0 after lost signal to thread 434
W20260709 13:03:36.947567  2282 debug-util.cc:398] Leaking SignalData structure 0x7b0800329de0 after lost signal to thread 1466
W20260709 13:03:36.949015  2282 debug-util.cc:398] Leaking SignalData structure 0x7b080015cc00 after lost signal to thread 1633
W20260709 13:03:36.950356  2282 debug-util.cc:398] Leaking SignalData structure 0x7b0800258de0 after lost signal to thread 1707
W20260709 13:03:36.951607  2282 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba4a0 after lost signal to thread 2285
W20260709 13:03:36.993307  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.059089  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.070284  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.070565  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.078613  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.087786  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.091076  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.164456   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:37.381047  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:37.417812  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.496717  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:37.546043  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.549362  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.558602  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:37.587447  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.734323  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.833911  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.839646  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:37.960587  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.021839  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.052510  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.070466  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.097746  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.128482  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.165009   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:38.237866  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.266072  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.289683  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.292368  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.389757  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.441461  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.503338  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.565637  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 48241.8us
W20260709 13:03:38.596354  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.620457  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.682274  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.772091  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36091, user_credentials={real_user=slave}} blocked reactor thread for 88662.9us
W20260709 13:03:38.842507  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.890522  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.909444  1574 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.918828  1574 consensus_peers.cc:597] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.893181  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.925282  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.052284  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.121735  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.165750   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:39.174840  2226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111) [suppressed 401 similar messages]
W20260709 13:03:39.175426  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.211687  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.225003  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.390166  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.403436  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.406776  1574 consensus_peers.cc:597] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.424925  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.579455  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.582612  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.587738  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.643678  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.646634  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.166438   431 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:40.456439  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 93275.1us
W20260709 13:03:40.469816  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.470567  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.476094  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.517572  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.518465  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.519142  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.525116  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.534420  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.674849  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.713619  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.715293  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.818384  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.842976  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.877171  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.913473  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.951761  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.971927  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.066946  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.068938  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.143332  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.167791   431 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1555)
W20260709 13:03:41.274242  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.292990  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.312023  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2940 after lost signal to thread 434
W20260709 13:03:41.313238  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001ace80 after lost signal to thread 1466
W20260709 13:03:41.314702  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003358a0 after lost signal to thread 1633
W20260709 13:03:41.317232  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800214f20 after lost signal to thread 1707
W20260709 13:03:41.318493  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080032f020 after lost signal to thread 2285
W20260709 13:03:41.410900  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.504278  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.517166  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.541071  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.555599  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.579288  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.588027  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.749759  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.753129  1574 consensus_peers.cc:597] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.856297  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:41.857375  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.929318  1574 consensus_peers.cc:597] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.946372  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.945557  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:41.975973  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:41.998523  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.133459  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.146011  2226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36133, user_credentials={real_user=slave}} blocked reactor thread for 122701us
W20260709 13:03:42.159507  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41753, user_credentials={real_user=slave}} blocked reactor thread for 126304us
W20260709 13:03:42.161296  1574 consensus_peers.cc:597] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.253994  1574 consensus_peers.cc:597] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.295645  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:42.296828  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.447469  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.523487  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.579418  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.637929  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.678009  1574 consensus_peers.cc:597] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.718101  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.798498  1574 consensus_peers.cc:597] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:42.899255  1574 consensus_peers.cc:597] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:42.973536  1574 consensus_peers.cc:597] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.030910  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.078848  1574 consensus_peers.cc:597] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.102878  1574 consensus_peers.cc:597] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.130923  1574 consensus_peers.cc:597] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.217046  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.225908  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.342108  1574 consensus_peers.cc:597] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.344606  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.372741  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.389791  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.406894  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.442823  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.526858  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.598197   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:43.646023  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.682344  1574 consensus_peers.cc:597] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.851634  1574 consensus_peers.cc:597] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.859059  1574 consensus_peers.cc:597] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.903216  1648 consensus_peers.cc:597] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.923642   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:43.983287  1649 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.985837  2227 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.990432  2227 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.001905  1574 consensus_peers.cc:597] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.013204  1649 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.014375  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:44.028155   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.029898   431 tablet_replica.cc:333] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.030913   431 raft_consensus.cc:2243] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.032826   431 raft_consensus.cc:2272] T 794b13e101914a9dbf12fa727a3e9e27 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.035869   431 tablet_replica.cc:333] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
W20260709 13:03:44.036377  1649 consensus_peers.cc:597] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.036922   431 raft_consensus.cc:2243] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.038266   431 raft_consensus.cc:2272] T d1b71784dcc643e8bb9bd12d0b0db655 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.041204   431 tablet_replica.cc:333] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.042210   431 raft_consensus.cc:2243] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.043340   431 raft_consensus.cc:2272] T c2dc6f62776f4719aaae2fc36e4d078e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.046314   431 tablet_replica.cc:333] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.047348   431 raft_consensus.cc:2243] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.048027   431 raft_consensus.cc:2272] T 2cddab79a6054062949d1d1c2453cc06 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.051554   431 tablet_replica.cc:333] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.052584   431 raft_consensus.cc:2243] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.053870   431 raft_consensus.cc:2272] T 3d61a4d068974252b4a051adf9e9b27b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.057360   431 tablet_replica.cc:333] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.058238   431 raft_consensus.cc:2243] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.058794   431 raft_consensus.cc:2272] T 53808273f23f45848ad55ddef1799643 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.061663   431 tablet_replica.cc:333] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.062508   431 raft_consensus.cc:2243] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.063668   431 raft_consensus.cc:2272] T 2832a231368f4f5dbf9972f28f64f60e P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.064231  2227 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.066427   431 tablet_replica.cc:333] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.067369   431 raft_consensus.cc:2243] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.068845   431 raft_consensus.cc:2272] T 14da2914452f44cca76332a550a28b6b P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.071595   431 tablet_replica.cc:333] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.072538   431 raft_consensus.cc:2243] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.073189   431 raft_consensus.cc:2272] T 6a63db4a447849f8a1a34a53cd5ccefa P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.076104   431 tablet_replica.cc:333] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.076939   431 raft_consensus.cc:2243] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.077657   431 raft_consensus.cc:2272] T dbb94d58e3454c868591a7960956aa47 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.081367  1649 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.083464   431 tablet_replica.cc:333] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.084556   431 raft_consensus.cc:2243] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.085423   431 raft_consensus.cc:2272] T fd52876d8a2049db9c781a36366069cc P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.087093  1648 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.091209  1649 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.095326  2227 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.099886  1574 consensus_peers.cc:597] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:44.088902   431 tablet_replica.cc:333] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.101189   431 raft_consensus.cc:2243] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.102272   431 raft_consensus.cc:2272] T 12bf9f3ae6ad4d89af59a7b75960caa6 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.105672   431 tablet_replica.cc:333] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.106523   431 raft_consensus.cc:2243] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.115433   431 raft_consensus.cc:2272] T abe16ef1967f47ba893ba6ba999c125c P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.124380   431 tablet_replica.cc:333] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
W20260709 13:03:44.127529  1649 consensus_peers.cc:597] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.130656   431 raft_consensus.cc:2243] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.132030   431 raft_consensus.cc:2272] T e796444a6ddd47bd9129de2ab82200a6 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.134501  1649 consensus_peers.cc:597] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.140204   431 tablet_replica.cc:333] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.140941   431 raft_consensus.cc:2243] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.141961   431 raft_consensus.cc:2272] T eb7bd80f58e444e6a587b05deed3c5f5 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.144068   431 tablet_replica.cc:333] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.144742   431 raft_consensus.cc:2243] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.145437   431 raft_consensus.cc:2272] T 986af52b7e6d4c60a353dbc998405797 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.148480   431 tablet_replica.cc:333] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.149892   431 raft_consensus.cc:2243] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.151067   431 raft_consensus.cc:2272] T c57c0601cf944c57a1314b6605861f28 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.153949   431 tablet_replica.cc:333] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.155503   431 raft_consensus.cc:2243] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.156857   431 raft_consensus.cc:2272] T 055cfab17a334683a9350a659118ac99 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.157860  1649 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.159801   431 tablet_replica.cc:333] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.160596   431 raft_consensus.cc:2243] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.161559   431 raft_consensus.cc:2272] T 01534d11942740ccb67a981fcde65180 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.163697   431 tablet_replica.cc:333] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.164427   431 raft_consensus.cc:2243] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.165620   431 raft_consensus.cc:2272] T df548e1d094249d5ac1f6ffa2f7d9885 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.167917   431 tablet_replica.cc:333] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.168550   431 raft_consensus.cc:2243] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.169759   431 raft_consensus.cc:2272] T e185a2b036a741ffba1ca49f0dd4cce8 P 428f0180c2cd487c8b48e91f14dff65d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.171978   431 tablet_replica.cc:333] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.172776   431 raft_consensus.cc:2243] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.173707   431 raft_consensus.cc:2272] T 4203acf1edca42708e1990f548ab96b3 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.177623   431 tablet_replica.cc:333] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.178265   431 raft_consensus.cc:2243] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.179339   431 raft_consensus.cc:2272] T 724d710084f24dcaa0170aeb7fb5ffc9 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.182453   431 tablet_replica.cc:333] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.183357   431 raft_consensus.cc:2243] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.184242   431 raft_consensus.cc:2272] T 7b29577369ec4664a5f1ed7e27dd3265 P 428f0180c2cd487c8b48e91f14dff65d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.184535  1574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111) [suppressed 442 similar messages]
I20260709 13:03:44.187700   431 tablet_replica.cc:333] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.188762   431 raft_consensus.cc:2243] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.190047   431 raft_consensus.cc:2272] T 55c2050eecb74fbbae8aea2d609c6833 P 428f0180c2cd487c8b48e91f14dff65d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.193318   431 tablet_replica.cc:333] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.194110   431 raft_consensus.cc:2243] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.195312   431 raft_consensus.cc:2272] T 5b26794ff1394cec94107fd122031015 P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.198144   431 tablet_replica.cc:333] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.198746   431 raft_consensus.cc:2243] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.199249   431 raft_consensus.cc:2272] T 4390bd9839c84c1e88aa862d642a1b1e P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.201244   431 tablet_replica.cc:333] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.201798   431 raft_consensus.cc:2243] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.202361   431 raft_consensus.cc:2272] T 368dba0d8eac439897c0b05b32e05500 P 428f0180c2cd487c8b48e91f14dff65d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.204731   431 tablet_replica.cc:333] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.205586   431 raft_consensus.cc:2243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.206271   431 raft_consensus.cc:2272] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.209159   431 tablet_replica.cc:333] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.209946   431 raft_consensus.cc:2243] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.210703   431 raft_consensus.cc:2272] T fa9afdc16bf6430d9b895aefc4432c77 P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.217904   431 tablet_replica.cc:333] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.218822   431 raft_consensus.cc:2243] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.220140   431 raft_consensus.cc:2272] T 967a91b43b06439992ab8ede24bc873d P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.220433  1648 consensus_peers.cc:597] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:44.221601  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:44.224570   431 tablet_replica.cc:333] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.225459   431 raft_consensus.cc:2243] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.226778   431 raft_consensus.cc:2272] T 15aeeeb202e74ebd91872b6a150c5ddc P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.231585   431 tablet_replica.cc:333] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.232499   431 raft_consensus.cc:2243] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.233706   431 raft_consensus.cc:2272] T c0c802947c11486798c253f6688083e7 P 428f0180c2cd487c8b48e91f14dff65d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.235715  1649 consensus_peers.cc:597] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.238689   431 tablet_replica.cc:333] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.239712   431 raft_consensus.cc:2243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.242350   431 raft_consensus.cc:2272] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.245765   431 tablet_replica.cc:333] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.246563   431 raft_consensus.cc:2243] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.247463   431 raft_consensus.cc:2272] T 74bb1ccc79844935814ecd1a9a89fcd9 P 428f0180c2cd487c8b48e91f14dff65d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.246672  1649 consensus_peers.cc:597] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.250226   431 tablet_replica.cc:333] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.251026   431 raft_consensus.cc:2243] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.252383   431 raft_consensus.cc:2272] T d76204c6ec324b26bec0c1908a45574a P 428f0180c2cd487c8b48e91f14dff65d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.257292   431 tablet_replica.cc:333] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.258044   431 raft_consensus.cc:2243] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:44.258052  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:44.258540  2227 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.259351   431 raft_consensus.cc:2272] T 75b33947f35745f4809f8a533ebbdaf8 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.263286   431 tablet_replica.cc:333] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.264050   431 raft_consensus.cc:2243] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.265027   431 raft_consensus.cc:2272] T ec0ffdd8e20a4befaef11295a994679c P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.271356   431 tablet_replica.cc:333] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.272073   431 raft_consensus.cc:2243] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.273298   431 raft_consensus.cc:2272] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 428f0180c2cd487c8b48e91f14dff65d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.275436   431 tablet_replica.cc:333] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.276094   431 raft_consensus.cc:2243] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.276682   431 raft_consensus.cc:2272] T b401d5a3c6a44966a0c0a7453f379808 P 428f0180c2cd487c8b48e91f14dff65d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.279168   431 tablet_replica.cc:333] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.279688   431 raft_consensus.cc:2243] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.280686   431 raft_consensus.cc:2272] T 2d85e1fb5b4b419c96d985561042498a P 428f0180c2cd487c8b48e91f14dff65d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.282757   431 tablet_replica.cc:333] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.283270   431 raft_consensus.cc:2243] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.284147   431 raft_consensus.cc:2272] T 460ae43de4d04023a24854ca2a19da88 P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.286244   431 tablet_replica.cc:333] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.286741   431 raft_consensus.cc:2243] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.287652   431 raft_consensus.cc:2272] T a1cc245b7bc74c4689e1a1db6fa21301 P 428f0180c2cd487c8b48e91f14dff65d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.289659   431 tablet_replica.cc:333] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.290163   431 raft_consensus.cc:2243] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.291122   431 raft_consensus.cc:2272] T 82df41f800684066955da1e5fcf37da0 P 428f0180c2cd487c8b48e91f14dff65d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.293787   431 tablet_replica.cc:333] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
I20260709 13:03:44.294682   431 raft_consensus.cc:2243] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.296065   431 raft_consensus.cc:2272] T a266117eb57049ceb80c4acd77766559 P 428f0180c2cd487c8b48e91f14dff65d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.299036   431 tablet_replica.cc:333] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d: stopping tablet replica
W20260709 13:03:44.298998  1649 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.299943   431 raft_consensus.cc:2243] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.301067   431 raft_consensus.cc:2272] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 428f0180c2cd487c8b48e91f14dff65d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.321424  2227 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.327508  1649 consensus_peers.cc:597] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.372567  1648 consensus_peers.cc:597] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.395818  1649 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.410662  1649 consensus_peers.cc:597] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.426936  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:44.433120  1649 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.464828  2227 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.470018  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.491523  1648 consensus_peers.cc:597] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.525763  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.544938  1648 consensus_peers.cc:597] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:44.621364  1648 consensus_peers.cc:597] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:44.754113  1648 consensus_peers.cc:597] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:44.938787  1648 consensus_peers.cc:597] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:44.951798  1648 consensus_peers.cc:597] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.027423  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.065696  1648 consensus_peers.cc:597] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.151316 10008 raft_consensus.cc:493] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.151978 10008 raft_consensus.cc:515] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.154548 10008 leader_election.cc:290] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:45.163090  1648 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.164790  1649 leader_election.cc:336] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.165238  1649 leader_election.cc:304] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.166102 10020 raft_consensus.cc:2749] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:45.228865 10008 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.229491 10008 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.232205 10008 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.234467  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:45.239939  1649 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.240579  1649 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:45.241444 10020 raft_consensus.cc:2749] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:45.280017 10021 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.280737 10021 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.282332 10020 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.282925 10020 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.283394 10021 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.285185 10020 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.287163  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
W20260709 13:03:45.292416  2227 leader_election.cc:336] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.292901  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.294898  2226 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:45.295981  9999 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.296607  9999 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.299000  9999 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.299536  9999 raft_consensus.cc:2749] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:45.300694 10025 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.301355 10025 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.303658 10025 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:45.306005  2227 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.307622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
W20260709 13:03:45.309391  2227 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.310098  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.315048  2226 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:45.320376 10021 raft_consensus.cc:2749] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:45.319041  2226 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:45.324826 10021 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:45.330195  1649 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.330668  1649 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:45.335937 10008 raft_consensus.cc:2749] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:45.338529  1648 consensus_peers.cc:597] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:45.342564 10008 raft_consensus.cc:493] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.343047 10008 raft_consensus.cc:515] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.345021 10008 leader_election.cc:290] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.349923 10020 raft_consensus.cc:493] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.350467 10020 raft_consensus.cc:515] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.352660 10020 leader_election.cc:290] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:45.355333  1648 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.358434  1649 leader_election.cc:336] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.358834  1648 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.358923  1649 leader_election.cc:304] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.359881 10020 raft_consensus.cc:2749] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:45.364253  1649 leader_election.cc:336] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.364778  1649 leader_election.cc:304] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.365576 10020 raft_consensus.cc:2749] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.400761 10008 raft_consensus.cc:493] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.401305 10008 raft_consensus.cc:515] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.403342 10008 leader_election.cc:290] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:45.407868  1648 leader_election.cc:336] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.408692  1649 leader_election.cc:336] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.409071  1649 leader_election.cc:304] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.409685 10008 raft_consensus.cc:2749] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.411720 10008 raft_consensus.cc:493] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.412179 10008 raft_consensus.cc:515] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.414719 10008 leader_election.cc:290] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.419592 10008 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:45.420102  1649 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.420207 10008 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.421563 10021 raft_consensus.cc:493] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.422109 10021 raft_consensus.cc:515] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.424348 10021 leader_election.cc:290] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.427599 10008 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.429085 10021 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.429759 10021 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.431921 10021 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.437704  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:45.438406  2256 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
W20260709 13:03:45.439832  2227 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.439909  1649 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.441643  2226 leader_election.cc:336] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.442164  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.446355  2226 leader_election.cc:304] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.447052 10025 raft_consensus.cc:2749] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.447052 10020 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:45.448549 10020 raft_consensus.cc:493] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.449220 10020 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:45.444145  1648 leader_election.cc:336] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.452934  1648 leader_election.cc:304] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.453856 10008 raft_consensus.cc:2749] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:45.454631  2226 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.458841 10008 raft_consensus.cc:493] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.459625 10008 raft_consensus.cc:515] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.462307 10008 leader_election.cc:290] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.464735 10025 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.465343 10025 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.467626 10025 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.475721 10020 raft_consensus.cc:515] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.477880  2226 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.472527  2227 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.482085  2227 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.482898 10025 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:45.482461  1649 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.484493 10008 raft_consensus.cc:493] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.485050 10008 raft_consensus.cc:515] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.487315 10008 leader_election.cc:290] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.487179 10025 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
W20260709 13:03:45.488238  1649 leader_election.cc:336] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.488587 10025 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.491112 10025 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:45.494252  1648 leader_election.cc:336] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.494771  1648 leader_election.cc:304] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.498145 10020 leader_election.cc:290] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:45.499641  2226 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.500516  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055cfab17a334683a9350a659118ac99" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:45.501145  2255 raft_consensus.cc:3060] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.502101 10008 raft_consensus.cc:2749] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:45.506073 10020 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.506673 10020 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.509130  2255 raft_consensus.cc:2468] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
W20260709 13:03:45.512984  1648 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.512249  2227 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.514743  2227 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.513461 10020 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:45.516669  1649 leader_election.cc:336] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.517218  1649 leader_election.cc:304] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.519467 10025 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.520728 10008 raft_consensus.cc:2749] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.522207  1647 leader_election.cc:304] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.523483  9992 raft_consensus.cc:2804] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:45.524053  9992 raft_consensus.cc:697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:45.524982  9992 consensus_queue.cc:237] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.531106  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:45.531863  2260 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 20.
W20260709 13:03:45.535071  2227 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.535612  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.535022  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:45.536437 10025 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.537585 10008 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:45.537961 10008 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.538305 10008 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:45.544812  1649 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.546100 10020 raft_consensus.cc:493] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.546705 10020 raft_consensus.cc:515] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
W20260709 13:03:45.553848  1648 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.554487  9992 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.555364  9992 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.557682  9992 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.561097 10020 leader_election.cc:290] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.561918  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:45.562723  2260 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:45.561439  1424 catalog_manager.cc:5697] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 21 to 22, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 22 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.565300  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:45.566457 10020 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:45.566850 10020 raft_consensus.cc:493] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.567251 10020 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:45.568676 10021 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.569242 10021 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.571440 10021 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.573746  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.574421  1682 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 27.
I20260709 13:03:45.564270 10008 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.576668  1648 consensus_peers.cc:597] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.578498  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dc6f62776f4719aaae2fc36e4d078e" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:45.579264  2260 raft_consensus.cc:3060] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:45.583182  2227 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.588195 10021 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.589015 10020 raft_consensus.cc:515] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.588979 10021 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.591611 10020 leader_election.cc:290] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.600706 10020 raft_consensus.cc:493] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.601264 10020 raft_consensus.cc:515] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.603221 10021 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.604099  2255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724d710084f24dcaa0170aeb7fb5ffc9" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:45.604734  2255 raft_consensus.cc:3060] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:45.610184  9992 raft_consensus.cc:493] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.610719  9992 raft_consensus.cc:515] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.612452 10021 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.613066 10021 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.613482  9992 leader_election.cc:290] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.614035  9992 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.614984 10021 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.614696  9992 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.618012  2227 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.618599  1648 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.603354 10020 leader_election.cc:290] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.619581  9992 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
W20260709 13:03:45.625356  2227 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.626412  1648 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.626309  2255 raft_consensus.cc:2468] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 25.
I20260709 13:03:45.631968  2260 raft_consensus.cc:2468] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 21.
I20260709 13:03:45.632583 10008 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.636905 10025 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.644706 10025 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.647177 10025 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.641548  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.649917 10025 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:45.650369 10025 raft_consensus.cc:493] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.650792 10025 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:03:45.653620  1649 leader_election.cc:336] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.654446  1649 leader_election.cc:336] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.660643 10020 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.661764  1649 leader_election.cc:304] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.662171 10020 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.664469  1649 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.665832 10020 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.666292 10020 raft_consensus.cc:2749] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:45.662784  1648 consensus_peers.cc:597] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:45.669216  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.670244  1682 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 22.
I20260709 13:03:45.670750  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:45.671550  2260 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 23.
I20260709 13:03:45.673210  1647 leader_election.cc:304] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:45.674198  1647 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.675195 10031 raft_consensus.cc:2804] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:45.677098 10020 raft_consensus.cc:2804] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:45.677810 10020 raft_consensus.cc:697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:45.679061 10021 raft_consensus.cc:493] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.678841 10020 consensus_queue.cc:237] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.675750 10031 raft_consensus.cc:697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:45.679607 10021 raft_consensus.cc:515] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.680414 10031 consensus_queue.cc:237] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.682405 10021 leader_election.cc:290] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:45.685092  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af" is_pre_election: true
I20260709 13:03:45.685745  2256 raft_consensus.cc:2468] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 22.
W20260709 13:03:45.691668  2227 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.691854 10008 raft_consensus.cc:493] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.692335 10008 raft_consensus.cc:515] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } }
I20260709 13:03:45.695223 10008 leader_election.cc:290] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:45.700263  1648 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:45.704695  1649 leader_election.cc:336] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.705612  1649 leader_election.cc:336] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.687990  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.706048  1649 leader_election.cc:304] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.710842 10031 raft_consensus.cc:2749] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:45.710987  1649 leader_election.cc:336] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.711516  1649 leader_election.cc:304] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.707042  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
I20260709 13:03:45.713354 10031 raft_consensus.cc:2749] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:45.724743  1649 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.725016  1424 catalog_manager.cc:5697] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 24 to 25, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 25 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.708835 10025 raft_consensus.cc:515] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.727161  1424 catalog_manager.cc:5697] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 20 to 21, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 21 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:45.718601  2227 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.709249  2226 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.729427 10021 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.722394  9992 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:45.731218  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.731624  9992 raft_consensus.cc:493] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.732079 10021 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:45.732185  9992 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:45.732587 10021 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.733405 10021 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:45.743291  9992 raft_consensus.cc:515] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.723897   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:45.745254  9992 leader_election.cc:290] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.723893  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 
W20260709 13:03:45.743687  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.747468  2226 leader_election.cc:336] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:45.747848 10008 raft_consensus.cc:2804] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:45.748106  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.748315 10008 raft_consensus.cc:493] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.748746 10008 raft_consensus.cc:3060] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:45.749042  1682 raft_consensus.cc:2393] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 24: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
I20260709 13:03:45.750370 10025 leader_election.cc:290] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.751497  2256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01534d11942740ccb67a981fcde65180" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:45.752048  2256 raft_consensus.cc:3060] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:45.755427 10008 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.755820  2227 leader_election.cc:336] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:45.757954  1649 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.747880  2226 leader_election.cc:304] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
W20260709 13:03:45.759460  1649 leader_election.cc:336] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.759881  1649 leader_election.cc:304] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:45.760118  9999 raft_consensus.cc:2749] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:03:45.762542 10031 raft_consensus.cc:2749] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:45.768363  2256 raft_consensus.cc:2468] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88b12b461734b3aa6a3da4f5c22c79b in term 24.
I20260709 13:03:45.770258  2226 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:45.780435 10008 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196:42185)
I20260709 13:03:45.782254 10021 raft_consensus.cc:515] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
W20260709 13:03:45.789441  1649 leader_election.cc:336] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.790719  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cc245b7bc74c4689e1a1db6fa21301" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:45.791266  1682 raft_consensus.cc:3060] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:45.788806 10025 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.794550 10035 raft_consensus.cc:2749] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:45.794487 10025 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.796746 10025 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.784255 10021 leader_election.cc:290] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.800107  1682 raft_consensus.cc:2468] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 28.
I20260709 13:03:45.802076  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" is_pre_election: true
I20260709 13:03:45.802812  1676 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 24.
W20260709 13:03:45.804358  2227 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.804942  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:45.806783  1682 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b6586a864a94c019cae2d8e2987a7af in current term 23: Already voted for candidate b88b12b461734b3aa6a3da4f5c22c79b in this term.
W20260709 13:03:45.807698  1649 leader_election.cc:336] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.808799  1647 leader_election.cc:304] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.807749  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc13e5cfc8a48a5b9eebe70f2e4e68b" candidate_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9b6586a864a94c019cae2d8e2987a7af"
I20260709 13:03:45.809937  2260 raft_consensus.cc:2393] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b88b12b461734b3aa6a3da4f5c22c79b in current term 23: Already voted for candidate 9b6586a864a94c019cae2d8e2987a7af in this term.
I20260709 13:03:45.809816 10036 raft_consensus.cc:2804] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:45.810767 10036 raft_consensus.cc:697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Becoming Leader. State: Replica: b88b12b461734b3aa6a3da4f5c22c79b, State: Running, Role: LEADER
I20260709 13:03:45.811717 10036 consensus_queue.cc:237] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.817786  2226 leader_election.cc:304] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.818957 10021 raft_consensus.cc:2804] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:45.819572 10021 raft_consensus.cc:697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
W20260709 13:03:45.820441  2227 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.820560 10021 consensus_queue.cc:237] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.832229  1647 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d, 9b6586a864a94c019cae2d8e2987a7af
I20260709 13:03:45.834448  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.835271 10025 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:45.835671 10025 raft_consensus.cc:493] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting leader election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:45.835748  2226 leader_election.cc:304] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:45.836170 10025 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:45.836567 10035 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.837478 10008 raft_consensus.cc:2749] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.845093 10025 raft_consensus.cc:515] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.851338  1424 catalog_manager.cc:5697] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 27 to 28, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 28 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.864785  1426 catalog_manager.cc:5697] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b reported cstate change: term changed from 23 to 24, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195). New cstate: current_term: 24 leader_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:45.870890  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.873534  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.880772  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8322d0fcf8904d3f8e1b6f9d1f2db7ba" candidate_uuid: "9b6586a864a94c019cae2d8e2987a7af" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b88b12b461734b3aa6a3da4f5c22c79b"
I20260709 13:03:45.881433  1682 raft_consensus.cc:3060] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:45.888276  1648 consensus_peers.cc:597] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:45.890877  2227 leader_election.cc:336] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:45.906402  1682 raft_consensus.cc:2468] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b6586a864a94c019cae2d8e2987a7af in term 25.
I20260709 13:03:45.909183  2226 leader_election.cc:304] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af, b88b12b461734b3aa6a3da4f5c22c79b; no voters: 428f0180c2cd487c8b48e91f14dff65d
I20260709 13:03:45.910167 10021 raft_consensus.cc:2804] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:45.910771 10021 raft_consensus.cc:697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 LEADER]: Becoming Leader. State: Replica: 9b6586a864a94c019cae2d8e2987a7af, State: Running, Role: LEADER
I20260709 13:03:45.878063 10025 leader_election.cc:290] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 election: Requested vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:45.912667 10021 consensus_queue.cc:237] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:45.921835   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:45.929443  1426 catalog_manager.cc:5697] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af reported cstate change: term changed from 24 to 25, leader changed from 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194) to 9b6586a864a94c019cae2d8e2987a7af (127.0.107.196). New cstate: current_term: 25 leader_uuid: "9b6586a864a94c019cae2d8e2987a7af" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:45.968366  2226 consensus_peers.cc:597] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:45.995375   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:45.996610   431 tablet_replica.cc:333] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:45.997632   431 raft_consensus.cc:2243] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:45.998329   431 raft_consensus.cc:2272] T d1b71784dcc643e8bb9bd12d0b0db655 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.001420   431 tablet_replica.cc:333] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.002425   431 raft_consensus.cc:2243] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.003221   431 raft_consensus.cc:2272] T 3d61a4d068974252b4a051adf9e9b27b P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.005611  2260 raft_consensus.cc:1275] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Refusing update from remote peer b88b12b461734b3aa6a3da4f5c22c79b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:46.006095   431 tablet_replica.cc:333] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.006951   431 raft_consensus.cc:2243] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.006910 10036 consensus_queue.cc:1048] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:46.007895   431 raft_consensus.cc:2272] T 6791fab1eefc49d1a3e2783c89cac6a8 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.010607   431 tablet_replica.cc:333] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.011904   431 raft_consensus.cc:2243] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.013046   431 raft_consensus.cc:2272] T 2cddab79a6054062949d1d1c2453cc06 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.015750   431 tablet_replica.cc:333] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.017282   431 raft_consensus.cc:2243] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.018683   431 pending_rounds.cc:70] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Trying to abort 1 pending ops.
I20260709 13:03:46.019096   431 pending_rounds.cc:77] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305634716425900032 op_type: NO_OP noop_request { }
I20260709 13:03:46.019587   431 raft_consensus.cc:2889] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:46.020017   431 raft_consensus.cc:2272] T c2dc6f62776f4719aaae2fc36e4d078e P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.022593  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.025413   431 tablet_replica.cc:333] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.026314   431 raft_consensus.cc:2243] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.027043   431 raft_consensus.cc:2272] T 794b13e101914a9dbf12fa727a3e9e27 P b88b12b461734b3aa6a3da4f5c22c79b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.029731   431 tablet_replica.cc:333] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.030496   431 raft_consensus.cc:2243] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.031520   431 raft_consensus.cc:2272] T b401d5a3c6a44966a0c0a7453f379808 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.035066   431 tablet_replica.cc:333] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
W20260709 13:03:46.035094  1648 consensus_peers.cc:597] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.036052   431 raft_consensus.cc:2243] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.036813   431 raft_consensus.cc:2272] T a1cc245b7bc74c4689e1a1db6fa21301 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.039714   431 tablet_replica.cc:333] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.040529   431 raft_consensus.cc:2243] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.041098   431 raft_consensus.cc:2272] T 14da2914452f44cca76332a550a28b6b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.043706   431 tablet_replica.cc:333] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.044595   431 raft_consensus.cc:2243] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.045684   431 raft_consensus.cc:2272] T dbb94d58e3454c868591a7960956aa47 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.048494   431 tablet_replica.cc:333] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.049371   431 raft_consensus.cc:2243] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.050561   431 raft_consensus.cc:2272] T e0746dbce2334050a0a5359c93c14f2c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.049381  1649 consensus_peers.cc:597] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.055706   431 tablet_replica.cc:333] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.056635   431 raft_consensus.cc:2243] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.057756   431 raft_consensus.cc:2272] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.060727   431 tablet_replica.cc:333] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.061506   431 raft_consensus.cc:2243] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.062316   431 raft_consensus.cc:2272] T f28aac236b62437d9a0603913d696ce7 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.064512   431 tablet_replica.cc:333] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.065033   431 raft_consensus.cc:2243] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.066061   431 raft_consensus.cc:2272] T 8b12ac06d9474e6a97e219688d43cf30 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.068202   431 tablet_replica.cc:333] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.068953   431 raft_consensus.cc:2243] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 LEADER]: Raft consensus shutting down.
W20260709 13:03:46.069681  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.070446   431 raft_consensus.cc:2272] T 2d76a019fbba44c8bb56f66d12c271c5 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.073151   431 tablet_replica.cc:333] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.073926   431 raft_consensus.cc:2243] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.074962   431 raft_consensus.cc:2272] T 6a63db4a447849f8a1a34a53cd5ccefa P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.077256   431 tablet_replica.cc:333] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.077767   431 raft_consensus.cc:2243] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.078562   431 raft_consensus.cc:2272] T 87db66ba9ff145009d8e513e5d0ef1e4 P b88b12b461734b3aa6a3da4f5c22c79b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.080416   431 tablet_replica.cc:333] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.081070   431 raft_consensus.cc:2243] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.081578   431 raft_consensus.cc:2272] T 12bf9f3ae6ad4d89af59a7b75960caa6 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.083922   431 tablet_replica.cc:333] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.084692   431 raft_consensus.cc:2243] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.085351   431 raft_consensus.cc:2272] T eb7bd80f58e444e6a587b05deed3c5f5 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.087417  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.087971   431 tablet_replica.cc:333] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.088843   431 raft_consensus.cc:2243] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.089953   431 raft_consensus.cc:2272] T 986af52b7e6d4c60a353dbc998405797 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.092572   431 tablet_replica.cc:333] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.093343   431 raft_consensus.cc:2243] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.094468   431 raft_consensus.cc:2272] T e796444a6ddd47bd9129de2ab82200a6 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.097254   431 tablet_replica.cc:333] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.098093   431 raft_consensus.cc:2243] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.099090   431 raft_consensus.cc:2272] T 75b33947f35745f4809f8a533ebbdaf8 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.101245   431 tablet_replica.cc:333] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.101850   431 raft_consensus.cc:2243] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.102393   431 raft_consensus.cc:2272] T ec0ffdd8e20a4befaef11295a994679c P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.104408   431 tablet_replica.cc:333] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.104947   431 raft_consensus.cc:2243] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.105918   431 raft_consensus.cc:2272] T 055cfab17a334683a9350a659118ac99 P b88b12b461734b3aa6a3da4f5c22c79b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.108592   431 tablet_replica.cc:333] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.109414   431 raft_consensus.cc:2243] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.110373   431 raft_consensus.cc:2272] T 7b29577369ec4664a5f1ed7e27dd3265 P b88b12b461734b3aa6a3da4f5c22c79b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.112761   431 tablet_replica.cc:333] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
W20260709 13:03:46.113037  2226 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:46.113363   431 raft_consensus.cc:2243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.114406   431 raft_consensus.cc:2272] T 5bacb2b5d0c24f8685d90eeadc14dce3 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.116688   431 tablet_replica.cc:333] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.117259   431 raft_consensus.cc:2243] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.118132   431 raft_consensus.cc:2272] T a20d1cf89bf84cc0b80b0dceda3cad18 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.120217   431 tablet_replica.cc:333] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.120787   431 raft_consensus.cc:2243] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.121244   431 raft_consensus.cc:2272] T e5c7c569add7422d840ba6ea7ea7ac47 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.123116   431 tablet_replica.cc:333] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.123663   431 raft_consensus.cc:2243] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.124595   431 raft_consensus.cc:2272] T fa9afdc16bf6430d9b895aefc4432c77 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.127048   431 tablet_replica.cc:333] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.127985   431 raft_consensus.cc:2243] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.128618   431 raft_consensus.cc:2272] T 967a91b43b06439992ab8ede24bc873d P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.130887   431 tablet_replica.cc:333] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.131623   431 raft_consensus.cc:2243] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.132347   431 raft_consensus.cc:2272] T c0c802947c11486798c253f6688083e7 P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.134932   431 tablet_replica.cc:333] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.135735   431 raft_consensus.cc:2243] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.137233   431 raft_consensus.cc:2272] T 2832a231368f4f5dbf9972f28f64f60e P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.139812   431 tablet_replica.cc:333] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.140566   431 raft_consensus.cc:2243] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.141222   431 raft_consensus.cc:2272] T c57c0601cf944c57a1314b6605861f28 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.143778   431 tablet_replica.cc:333] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
W20260709 13:03:46.144405  2226 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.144584   431 raft_consensus.cc:2243] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.145849   431 raft_consensus.cc:2272] T f99da1afef0249c084ef81484859e823 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.148741   431 tablet_replica.cc:333] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.149706   431 raft_consensus.cc:2243] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.150579   431 pending_rounds.cc:70] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Trying to abort 1 pending ops.
I20260709 13:03:46.150823   431 pending_rounds.cc:77] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305634716396003328 op_type: NO_OP noop_request { }
I20260709 13:03:46.151191   431 raft_consensus.cc:2889] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:46.151525   431 raft_consensus.cc:2272] T 724d710084f24dcaa0170aeb7fb5ffc9 P b88b12b461734b3aa6a3da4f5c22c79b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.154155   431 tablet_replica.cc:333] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.154812   431 raft_consensus.cc:2243] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.155731   431 raft_consensus.cc:2272] T 4203acf1edca42708e1990f548ab96b3 P b88b12b461734b3aa6a3da4f5c22c79b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.158578   431 tablet_replica.cc:333] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.159246   431 raft_consensus.cc:2243] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.159859   431 raft_consensus.cc:2272] T 13e1eb7aa954478d88a68ebc9f886898 P b88b12b461734b3aa6a3da4f5c22c79b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.162084   431 tablet_replica.cc:333] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.162798   431 raft_consensus.cc:2243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.164053   431 raft_consensus.cc:2272] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.166327   431 tablet_replica.cc:333] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.166858   431 raft_consensus.cc:2243] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.167384   431 raft_consensus.cc:2272] T e2ca98d137184e478468c21f485fafa4 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.169286   431 tablet_replica.cc:333] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.169876   431 raft_consensus.cc:2243] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.170724   431 raft_consensus.cc:2272] T 3ac98493907d499f8fa4ad8002393318 P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.173007   431 tablet_replica.cc:333] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.173688   431 raft_consensus.cc:2243] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:03:46.174463  2226 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.175177   431 raft_consensus.cc:2272] T 2d85e1fb5b4b419c96d985561042498a P b88b12b461734b3aa6a3da4f5c22c79b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.177084   431 tablet_replica.cc:333] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.177580   431 raft_consensus.cc:2243] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.178254   431 pending_rounds.cc:70] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Trying to abort 1 pending ops.
I20260709 13:03:46.178409   431 pending_rounds.cc:77] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b: Aborting op as it isn't in flight: id { term: 24 index: 18 } timestamp: 7305634717006712832 op_type: NO_OP noop_request { }
I20260709 13:03:46.178661   431 raft_consensus.cc:2889] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:46.178956   431 raft_consensus.cc:2272] T 01534d11942740ccb67a981fcde65180 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.181232   431 tablet_replica.cc:333] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.181759   431 raft_consensus.cc:2243] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.182339   431 raft_consensus.cc:2272] T df548e1d094249d5ac1f6ffa2f7d9885 P b88b12b461734b3aa6a3da4f5c22c79b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.184234   431 tablet_replica.cc:333] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.184864   431 raft_consensus.cc:2243] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.185720   431 raft_consensus.cc:2272] T d36fd60901f543758f2f446ee106cf32 P b88b12b461734b3aa6a3da4f5c22c79b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.187561   431 tablet_replica.cc:333] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.188038   431 raft_consensus.cc:2243] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.188520   431 raft_consensus.cc:2272] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P b88b12b461734b3aa6a3da4f5c22c79b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.190459   431 tablet_replica.cc:333] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b: stopping tablet replica
I20260709 13:03:46.190902   431 raft_consensus.cc:2243] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.191752   431 raft_consensus.cc:2272] T 74bb1ccc79844935814ecd1a9a89fcd9 P b88b12b461734b3aa6a3da4f5c22c79b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.257684  2226 consensus_peers.cc:597] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.263275  2226 consensus_peers.cc:597] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.336360  2227 consensus_peers.cc:597] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.370692  2226 consensus_peers.cc:597] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.411538  2226 consensus_peers.cc:597] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:46.420733  2227 consensus_peers.cc:597] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.436064  2227 consensus_peers.cc:597] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.439651  2226 consensus_peers.cc:597] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Couldn't send request to peer b88b12b461734b3aa6a3da4f5c22c79b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.529536  2226 consensus_peers.cc:597] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:46.533100  2227 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.662119  2227 consensus_peers.cc:597] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.690668  2226 consensus_peers.cc:597] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:46.815287  2227 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.834785  2227 consensus_peers.cc:597] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.941344  2227 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.945689  2226 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:47.013396 10021 raft_consensus.cc:493] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:47.013967 10021 raft_consensus.cc:515] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.016156 10021 leader_election.cc:290] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:47.020673  2227 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:47.021139  2226 leader_election.cc:336] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:47.021550  2226 leader_election.cc:304] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.022238 10021 raft_consensus.cc:2749] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.031622 10021 raft_consensus.cc:493] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.032157 10021 raft_consensus.cc:515] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.034229 10021 leader_election.cc:290] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:47.038571  2226 leader_election.cc:336] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
W20260709 13:03:47.039043  2227 leader_election.cc:336] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.039495  2227 leader_election.cc:304] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.040510 10021 raft_consensus.cc:2749] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:47.116602  2226 consensus_peers.cc:597] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:47.136518 10021 raft_consensus.cc:493] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:47.137108 10021 raft_consensus.cc:515] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.140266 10021 leader_election.cc:290] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:47.143411  2226 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:47.144804  2227 leader_election.cc:336] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.145229  2227 leader_election.cc:304] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.145886 10035 raft_consensus.cc:2749] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:47.153406   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:47.186215 10021 raft_consensus.cc:493] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.187050 10035 raft_consensus.cc:493] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.186972 10021 raft_consensus.cc:515] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.187712 10035 raft_consensus.cc:515] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.189486 10021 leader_election.cc:290] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.189867 10035 leader_election.cc:290] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:47.196935  2227 leader_election.cc:336] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:47.197600  2227 leader_election.cc:336] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:47.198763  2226 leader_election.cc:336] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.199332  2226 leader_election.cc:304] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.200179 10035 raft_consensus.cc:2749] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:47.201233  2226 leader_election.cc:336] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.201742  2226 leader_election.cc:304] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.202481 10035 raft_consensus.cc:2749] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:47.217878  2226 consensus_peers.cc:597] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.238927  2227 consensus_peers.cc:597] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af -> Peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Couldn't send request to peer 428f0180c2cd487c8b48e91f14dff65d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:47.266435 10035 raft_consensus.cc:493] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:47.267221 10035 raft_consensus.cc:515] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.269599   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:47.270210 10035 leader_election.cc:290] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
I20260709 13:03:47.274339 10035 raft_consensus.cc:493] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.275229 10035 raft_consensus.cc:515] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.276777 10021 raft_consensus.cc:493] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 428f0180c2cd487c8b48e91f14dff65d)
I20260709 13:03:47.279672 10021 raft_consensus.cc:515] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.280718 10035 leader_election.cc:290] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:47.278237  2226 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:47.282022 10021 leader_election.cc:290] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091)
W20260709 13:03:47.282806  2227 leader_election.cc:336] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.283382  2227 leader_election.cc:304] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.284236 10021 raft_consensus.cc:2749] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:47.289955  2227 leader_election.cc:336] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:47.290855  2226 leader_election.cc:336] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.292711  2226 leader_election.cc:304] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
W20260709 13:03:47.293596  2227 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
W20260709 13:03:47.294132  2226 leader_election.cc:336] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:47.294636  2226 leader_election.cc:304] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.294356 10035 raft_consensus.cc:2749] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:47.295794 10035 raft_consensus.cc:2749] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:47.307284 10044 raft_consensus.cc:493] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.310894 10021 raft_consensus.cc:493] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.311956 10021 raft_consensus.cc:515] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.312332 10035 raft_consensus.cc:493] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.310207 10044 raft_consensus.cc:515] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.314484 10035 raft_consensus.cc:515] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.341241 10045 raft_consensus.cc:493] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.341818 10045 raft_consensus.cc:515] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.344970 10045 leader_election.cc:290] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.346056 10044 leader_election.cc:290] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:47.346309  2226 consensus_peers.cc:597] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af -> Peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Couldn't send request to peer b8ff9782cd95483c905cd1d906f41aaf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:47.346802 10021 leader_election.cc:290] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.348934 10035 leader_election.cc:290] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
W20260709 13:03:47.352344  2226 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
W20260709 13:03:47.352975  2226 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
W20260709 13:03:47.353377  2226 leader_election.cc:336] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
W20260709 13:03:47.354238  2226 leader_election.cc:336] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:47.354547  2226 leader_election.cc:304] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.355135 10044 raft_consensus.cc:2749] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:47.355911  2227 leader_election.cc:336] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.356244  2227 leader_election.cc:304] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.356890 10044 raft_consensus.cc:2749] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:47.355304  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:47.361266  2226 leader_election.cc:336] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.361708  2226 leader_election.cc:304] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.363643 10044 raft_consensus.cc:2749] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.365348   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:47.366297   431 tablet_replica.cc:333] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
W20260709 13:03:47.366815  2227 leader_election.cc:336] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.367277   431 raft_consensus.cc:2243] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.368124   431 raft_consensus.cc:2272] T 5293a667c8bb4fdbb1fa97aaeba1cfc1 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.367302  2227 leader_election.cc:304] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.369133 10044 raft_consensus.cc:2749] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:47.371834   431 tablet_replica.cc:333] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.372926   431 raft_consensus.cc:2243] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.373869   431 raft_consensus.cc:2272] T 6a63db4a447849f8a1a34a53cd5ccefa P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.378537   431 tablet_replica.cc:333] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.379621   431 raft_consensus.cc:2243] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.380335   431 raft_consensus.cc:2272] T 15aeeeb202e74ebd91872b6a150c5ddc P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.381944 10044 raft_consensus.cc:493] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.382566 10044 raft_consensus.cc:515] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.383773   431 tablet_replica.cc:333] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.384626   431 raft_consensus.cc:2243] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.384953 10044 leader_election.cc:290] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.385440   431 raft_consensus.cc:2272] T e796444a6ddd47bd9129de2ab82200a6 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.388561   431 tablet_replica.cc:333] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.389567   431 raft_consensus.cc:2243] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.390493   431 raft_consensus.cc:2272] T 2d85e1fb5b4b419c96d985561042498a P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.391351  2226 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:47.392059  2226 leader_election.cc:336] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.392508  2226 leader_election.cc:304] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.393265 10044 raft_consensus.cc:2749] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:47.393960   431 tablet_replica.cc:333] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.394297 10044 raft_consensus.cc:493] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.394889   431 raft_consensus.cc:2243] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.394868 10044 raft_consensus.cc:515] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "428f0180c2cd487c8b48e91f14dff65d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.395759   431 raft_consensus.cc:2272] T b401d5a3c6a44966a0c0a7453f379808 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.398231 10044 leader_election.cc:290] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.399802   431 tablet_replica.cc:333] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.399871 10044 raft_consensus.cc:493] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.400842   431 raft_consensus.cc:2243] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.401209 10044 raft_consensus.cc:515] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.401607   431 raft_consensus.cc:2272] T 01534d11942740ccb67a981fcde65180 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.402915  2227 leader_election.cc:336] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 428f0180c2cd487c8b48e91f14dff65d (127.0.107.194:36091): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111)
I20260709 13:03:47.404794   431 tablet_replica.cc:333] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.405619   431 raft_consensus.cc:2243] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.406248   431 raft_consensus.cc:2272] T 055cfab17a334683a9350a659118ac99 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.403362 10044 leader_election.cc:290] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.409034   431 tablet_replica.cc:333] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.409955   431 raft_consensus.cc:2243] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.411099   431 raft_consensus.cc:2272] T 13e1eb7aa954478d88a68ebc9f886898 P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.411558  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
W20260709 13:03:47.412456  2226 leader_election.cc:336] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.412874  2226 leader_election.cc:304] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: 428f0180c2cd487c8b48e91f14dff65d, b88b12b461734b3aa6a3da4f5c22c79b
I20260709 13:03:47.413606 10044 raft_consensus.cc:2749] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:47.413760  2226 leader_election.cc:336] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.414034   431 tablet_replica.cc:333] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.414295  2226 leader_election.cc:304] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.414978   431 raft_consensus.cc:2243] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.415110 10044 raft_consensus.cc:2749] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.415750   431 raft_consensus.cc:2272] T 8b12ac06d9474e6a97e219688d43cf30 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.418176   431 tablet_replica.cc:333] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.418870   431 raft_consensus.cc:2243] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.419426   431 raft_consensus.cc:2272] T 2d76a019fbba44c8bb56f66d12c271c5 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.421587   431 tablet_replica.cc:333] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.422139   431 raft_consensus.cc:2243] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.423245   431 raft_consensus.cc:2272] T 6791fab1eefc49d1a3e2783c89cac6a8 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.423281 10035 raft_consensus.cc:493] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b88b12b461734b3aa6a3da4f5c22c79b)
I20260709 13:03:47.423861 10035 raft_consensus.cc:515] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8ff9782cd95483c905cd1d906f41aaf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36133 } } peers { permanent_uuid: "b88b12b461734b3aa6a3da4f5c22c79b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41753 } } peers { permanent_uuid: "9b6586a864a94c019cae2d8e2987a7af" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42185 } attrs { promote: false } }
I20260709 13:03:47.425995 10035 leader_election.cc:290] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133), b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753)
I20260709 13:03:47.426931   431 tablet_replica.cc:333] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.427826   431 raft_consensus.cc:2243] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.428987   431 raft_consensus.cc:2272] T fd52876d8a2049db9c781a36366069cc P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.431926   431 tablet_replica.cc:333] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.432896   431 raft_consensus.cc:2243] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.433548   431 raft_consensus.cc:2272] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.435179  2226 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8ff9782cd95483c905cd1d906f41aaf (127.0.107.193:36133): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36133: connect: Connection refused (error 111)
I20260709 13:03:47.436172   431 tablet_replica.cc:333] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
W20260709 13:03:47.436285  2226 leader_election.cc:336] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b88b12b461734b3aa6a3da4f5c22c79b (127.0.107.195:41753): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41753: connect: Connection refused (error 111)
I20260709 13:03:47.436967   431 raft_consensus.cc:2243] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.436977  2226 leader_election.cc:304] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b6586a864a94c019cae2d8e2987a7af; no voters: b88b12b461734b3aa6a3da4f5c22c79b, b8ff9782cd95483c905cd1d906f41aaf
I20260709 13:03:47.437486   431 raft_consensus.cc:2272] T 724d710084f24dcaa0170aeb7fb5ffc9 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.437784  2226 raft_consensus.cc:2686] T d36fd60901f543758f2f446ee106cf32 P 9b6586a864a94c019cae2d8e2987a7af: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:47.440110   431 tablet_replica.cc:333] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.440754   431 raft_consensus.cc:2243] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.441210   431 raft_consensus.cc:2272] T c2dc6f62776f4719aaae2fc36e4d078e P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.443400   431 tablet_replica.cc:333] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.443958   431 raft_consensus.cc:2243] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.444605   431 raft_consensus.cc:2272] T 2832a231368f4f5dbf9972f28f64f60e P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.446765   431 tablet_replica.cc:333] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.447369   431 raft_consensus.cc:2243] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.447829   431 raft_consensus.cc:2272] T f99da1afef0249c084ef81484859e823 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.450109   431 tablet_replica.cc:333] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.450724   431 raft_consensus.cc:2243] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.451329   431 raft_consensus.cc:2272] T 460ae43de4d04023a24854ca2a19da88 P 9b6586a864a94c019cae2d8e2987a7af [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.453677   431 tablet_replica.cc:333] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.454216   431 raft_consensus.cc:2243] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.455011   431 raft_consensus.cc:2272] T e2ca98d137184e478468c21f485fafa4 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.457252   431 tablet_replica.cc:333] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.457798   431 raft_consensus.cc:2243] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.458320   431 raft_consensus.cc:2272] T e185a2b036a741ffba1ca49f0dd4cce8 P 9b6586a864a94c019cae2d8e2987a7af [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.460182   431 tablet_replica.cc:333] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.460783   431 raft_consensus.cc:2243] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.461577   431 raft_consensus.cc:2272] T 87db66ba9ff145009d8e513e5d0ef1e4 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.463582   431 tablet_replica.cc:333] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.464099   431 raft_consensus.cc:2243] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.464895   431 raft_consensus.cc:2272] T 368dba0d8eac439897c0b05b32e05500 P 9b6586a864a94c019cae2d8e2987a7af [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.467020   431 tablet_replica.cc:333] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.467525   431 raft_consensus.cc:2243] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.467971   431 raft_consensus.cc:2272] T 5bacb2b5d0c24f8685d90eeadc14dce3 P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.469813   431 tablet_replica.cc:333] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.470288   431 raft_consensus.cc:2243] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.470871   431 raft_consensus.cc:2272] T 82df41f800684066955da1e5fcf37da0 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.472976   431 tablet_replica.cc:333] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.473479   431 raft_consensus.cc:2243] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.473935   431 raft_consensus.cc:2272] T a20d1cf89bf84cc0b80b0dceda3cad18 P 9b6586a864a94c019cae2d8e2987a7af [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.475761   431 tablet_replica.cc:333] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.476253   431 raft_consensus.cc:2243] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.477210   431 pending_rounds.cc:70] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Trying to abort 1 pending ops.
I20260709 13:03:47.477371   431 pending_rounds.cc:77] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af: Aborting op as it isn't in flight: id { term: 28 index: 18 } timestamp: 7305634716989751296 op_type: NO_OP noop_request { }
I20260709 13:03:47.477617   431 raft_consensus.cc:2889] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:47.477860   431 raft_consensus.cc:2272] T a1cc245b7bc74c4689e1a1db6fa21301 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.479739   431 tablet_replica.cc:333] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.480299   431 raft_consensus.cc:2243] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.480820   431 raft_consensus.cc:2272] T 986af52b7e6d4c60a353dbc998405797 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.482779   431 tablet_replica.cc:333] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.483294   431 raft_consensus.cc:2243] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.484045   431 raft_consensus.cc:2272] T f28aac236b62437d9a0603913d696ce7 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.486006   431 tablet_replica.cc:333] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.486518   431 raft_consensus.cc:2243] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.487090   431 raft_consensus.cc:2272] T e0746dbce2334050a0a5359c93c14f2c P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.489243   431 tablet_replica.cc:333] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.489744   431 raft_consensus.cc:2243] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.490206   431 raft_consensus.cc:2272] T 2cddab79a6054062949d1d1c2453cc06 P 9b6586a864a94c019cae2d8e2987a7af [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.492148   431 tablet_replica.cc:333] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.492697   431 raft_consensus.cc:2243] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.493245   431 raft_consensus.cc:2272] T d76204c6ec324b26bec0c1908a45574a P 9b6586a864a94c019cae2d8e2987a7af [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.495504   431 tablet_replica.cc:333] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.496135   431 raft_consensus.cc:2243] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.497115   431 raft_consensus.cc:2272] T a266117eb57049ceb80c4acd77766559 P 9b6586a864a94c019cae2d8e2987a7af [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.499997   431 tablet_replica.cc:333] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.500828   431 raft_consensus.cc:2243] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.502029   431 raft_consensus.cc:2272] T 3ac98493907d499f8fa4ad8002393318 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.504853   431 tablet_replica.cc:333] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.505442   431 raft_consensus.cc:2243] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.506039   431 raft_consensus.cc:2272] T 8dc13e5cfc8a48a5b9eebe70f2e4e68b P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.507984   431 tablet_replica.cc:333] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.508602   431 raft_consensus.cc:2243] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.509832   431 raft_consensus.cc:2272] T abe16ef1967f47ba893ba6ba999c125c P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.512565   431 tablet_replica.cc:333] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.513231   431 raft_consensus.cc:2243] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.514139   431 raft_consensus.cc:2272] T 53808273f23f45848ad55ddef1799643 P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.516217   431 tablet_replica.cc:333] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.516748   431 raft_consensus.cc:2243] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.517285   431 raft_consensus.cc:2272] T 55c2050eecb74fbbae8aea2d609c6833 P 9b6586a864a94c019cae2d8e2987a7af [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.519337   431 tablet_replica.cc:333] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.519819   431 raft_consensus.cc:2243] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.520682   431 raft_consensus.cc:2272] T 5b26794ff1394cec94107fd122031015 P 9b6586a864a94c019cae2d8e2987a7af [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.522610   431 tablet_replica.cc:333] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.523105   431 raft_consensus.cc:2243] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.523977   431 raft_consensus.cc:2272] T 4390bd9839c84c1e88aa862d642a1b1e P 9b6586a864a94c019cae2d8e2987a7af [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.526362   431 tablet_replica.cc:333] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.526993   431 raft_consensus.cc:2243] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.528265   431 pending_rounds.cc:70] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Trying to abort 1 pending ops.
I20260709 13:03:47.528539   431 pending_rounds.cc:77] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af: Aborting op as it isn't in flight: id { term: 25 index: 18 } timestamp: 7305634717349277696 op_type: NO_OP noop_request { }
I20260709 13:03:47.528859   431 raft_consensus.cc:2889] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:47.529265   431 raft_consensus.cc:2272] T 8322d0fcf8904d3f8e1b6f9d1f2db7ba P 9b6586a864a94c019cae2d8e2987a7af [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.531585   431 tablet_replica.cc:333] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af: stopping tablet replica
I20260709 13:03:47.532040   431 raft_consensus.cc:2243] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.532869   431 raft_consensus.cc:2272] T e5c7c569add7422d840ba6ea7ea7ac47 P 9b6586a864a94c019cae2d8e2987a7af [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.932379   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:48.007581   431 master.cc:562] Master@127.0.107.254:41741 shutting down...
W20260709 13:03:48.041419  1480 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:48.041752  1480 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:48.041967  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:03:48.045166   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.045744   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.046039   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3fc8854ff8e34244b91acf19f7f50f8a: stopping tablet replica
I20260709 13:03:48.249869   431 master.cc:584] Master@127.0.107.254:41741 shutdown complete.
I20260709 13:03:48.290158   431 test_util.cc:182] -----------------------------------------------
I20260709 13:03:48.290406   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601936857634-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (267545 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:48.293651   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45551
I20260709 13:03:48.294802   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:48.301098 10048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.301098 10047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.301910 10050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.302702   431 server_base.cc:1061] running on GCE node
I20260709 13:03:48.305976   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:48.306195   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:48.306347   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602228306328 us; error 0 us; skew 500 ppm
I20260709 13:03:48.306926   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:48.309587   431 webserver.cc:533] Webserver started at http://127.0.107.254:37405/ using document root <none> and password file <none>
I20260709 13:03:48.310078   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:48.310272   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:48.310547   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:48.311762   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "4bf765e26dce43228243ec94afa24335"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.316524   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:48.320132 10055 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.320984   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:48.321345   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "4bf765e26dce43228243ec94afa24335"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.321722   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:48.343825   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:48.345268   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:48.387238   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45551
I20260709 13:03:48.387336 10106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45551 every 8 connection(s)
I20260709 13:03:48.391664 10107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.402484 10107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335: Bootstrap starting.
I20260709 13:03:48.407783 10107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.412711 10107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335: No bootstrap required, opened a new log
I20260709 13:03:48.415143 10107 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER }
I20260709 13:03:48.415623 10107 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.415868 10107 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf765e26dce43228243ec94afa24335, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.416534 10107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER }
I20260709 13:03:48.417021 10107 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:48.417248 10107 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:48.417505 10107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.422390 10107 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER }
I20260709 13:03:48.422937 10107 leader_election.cc:304] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bf765e26dce43228243ec94afa24335; no voters: 
I20260709 13:03:48.424300 10107 leader_election.cc:290] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:48.424739 10110 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.426012 10110 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 1 LEADER]: Becoming Leader. State: Replica: 4bf765e26dce43228243ec94afa24335, State: Running, Role: LEADER
I20260709 13:03:48.426733 10110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER }
I20260709 13:03:48.427502 10107 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:48.431363 10112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bf765e26dce43228243ec94afa24335. Latest consensus state: current_term: 1 leader_uuid: "4bf765e26dce43228243ec94afa24335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER } }
I20260709 13:03:48.431820 10112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:48.433542 10111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bf765e26dce43228243ec94afa24335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf765e26dce43228243ec94afa24335" member_type: VOTER } }
I20260709 13:03:48.434293 10111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:48.436841 10116 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:48.441815 10116 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:48.443089   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:48.450460 10116 catalog_manager.cc:1383] Generated new cluster ID: aa6c9a86965c43bdb0e381a234e3257f
I20260709 13:03:48.450773 10116 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:48.467623 10116 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:48.469095 10116 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:48.484234 10116 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335: Generated new TSK 0
I20260709 13:03:48.484865 10116 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:48.509965   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:48.515921 10128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.516710 10129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.518945 10131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.519876   431 server_base.cc:1061] running on GCE node
I20260709 13:03:48.521948   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:48.522145   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:48.522307   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602228522289 us; error 0 us; skew 500 ppm
I20260709 13:03:48.522840   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:48.525308   431 webserver.cc:533] Webserver started at http://127.0.107.193:45247/ using document root <none> and password file <none>
I20260709 13:03:48.525781   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:48.525944   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:48.526162   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:48.527318   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.532156   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:48.535655 10136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.536435   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:03:48.536772   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.537062   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:48.547428   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:48.548643   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:48.550041   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:48.552244   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:48.552491   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.552714   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:48.552907   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.595501   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35805
I20260709 13:03:48.595608 10198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35805 every 8 connection(s)
I20260709 13:03:48.600296   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:48.606813 10203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.607802 10204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.611111 10206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.612828   431 server_base.cc:1061] running on GCE node
I20260709 13:03:48.612926 10199 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45551
I20260709 13:03:48.613392 10199 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:48.614177 10199 heartbeater.cc:507] Master 127.0.107.254:45551 requested a full tablet report, sending...
I20260709 13:03:48.615712   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:48.615978   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:48.616149   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602228616133 us; error 0 us; skew 500 ppm
I20260709 13:03:48.616266 10072 ts_manager.cc:194] Registered new tserver with Master: 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:48.616839   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:48.618325 10072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53952
I20260709 13:03:48.619944   431 webserver.cc:533] Webserver started at http://127.0.107.194:44637/ using document root <none> and password file <none>
I20260709 13:03:48.620540   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:48.620765   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:48.621022   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:48.622329   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "caa864648e614090be53d8ece3cd29b7"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.627535   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:48.631346 10211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.632216   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:48.632565   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "caa864648e614090be53d8ece3cd29b7"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.632858   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:48.653510   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:48.654810   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:48.656422   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:48.658854   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:48.659161   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.659477   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:48.659654   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.703135   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33927
I20260709 13:03:48.703253 10273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33927 every 8 connection(s)
I20260709 13:03:48.707975   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:48.716653 10277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.716954 10278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.722918 10274 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45551
I20260709 13:03:48.723642 10274 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:48.724843 10274 heartbeater.cc:507] Master 127.0.107.254:45551 requested a full tablet report, sending...
W20260709 13:03:48.725157 10280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.725703   431 server_base.cc:1061] running on GCE node
I20260709 13:03:48.726711   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:48.726953   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:48.727109   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602228727098 us; error 0 us; skew 500 ppm
I20260709 13:03:48.727470 10072 ts_manager.cc:194] Registered new tserver with Master: caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:48.727591   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:48.729367 10072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53964
I20260709 13:03:48.730823   431 webserver.cc:533] Webserver started at http://127.0.107.195:46839/ using document root <none> and password file <none>
I20260709 13:03:48.731446   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:48.731637   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:48.731931   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:48.733214   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.739269   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:03:48.742983 10285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.743739   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:48.744060   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.744367   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:48.758898   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:48.760365   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:48.762040   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:48.764642   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:48.764892   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.765130   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:48.765306   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.811484   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45585
I20260709 13:03:48.811672 10347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45585 every 8 connection(s)
I20260709 13:03:48.816916   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:48.823199 10351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.824172 10352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:48.827629 10354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:48.828047   431 server_base.cc:1061] running on GCE node
I20260709 13:03:48.829946 10348 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45551
I20260709 13:03:48.830103   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:48.830448   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:48.830529 10348 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:48.830746   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602228830723 us; error 0 us; skew 500 ppm
I20260709 13:03:48.831660   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:48.831647 10348 heartbeater.cc:507] Master 127.0.107.254:45551 requested a full tablet report, sending...
I20260709 13:03:48.878106 10072 ts_manager.cc:194] Registered new tserver with Master: b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:48.883540   431 webserver.cc:533] Webserver started at http://127.0.107.196:44769/ using document root <none> and password file <none>
I20260709 13:03:48.884301 10072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53976
I20260709 13:03:48.884658   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:48.885037   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:48.885520   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:48.887837   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-3-root/instance:
uuid: "c4b5b492fca940a3883a22eec56a4f9f"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.893894   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:48.897967 10360 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.898790   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:03:48.899091   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-3-root
uuid: "c4b5b492fca940a3883a22eec56a4f9f"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:03:48.899387   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:48.924535   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:48.925928   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:48.927326   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:48.930068   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:48.930289   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.930544   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:48.930864   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:48.976424   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:35853
I20260709 13:03:48.976634 10422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:35853 every 8 connection(s)
I20260709 13:03:48.993844 10423 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45551
I20260709 13:03:48.994295 10423 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:48.995167 10423 heartbeater.cc:507] Master 127.0.107.254:45551 requested a full tablet report, sending...
I20260709 13:03:48.997467 10072 ts_manager.cc:194] Registered new tserver with Master: c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:48.998443   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01814539s
I20260709 13:03:48.999083 10072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53984
I20260709 13:03:49.027325 10072 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53996:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:49.283308 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 389b7d02e091434d92c8b6ed3ad13c15 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:49.285216 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389b7d02e091434d92c8b6ed3ad13c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.289606 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 2de7767ee77c4969bba8c9350190f185 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:49.291564 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de7767ee77c4969bba8c9350190f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.293624 10311 tablet_service.cc:1511] Processing CreateTablet for tablet feaf74617ea14c089e379068bd362ac8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:49.295254 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf74617ea14c089e379068bd362ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.302111 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 82534bc4cd7045f6a24502bff235976d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:49.303928 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82534bc4cd7045f6a24502bff235976d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.306124 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 4c269356f5284edabf474b9034c8da3f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:49.310099 10308 tablet_service.cc:1511] Processing CreateTablet for tablet 7d927f3c7f024383ae5d8d4e018327fa (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:49.313297 10307 tablet_service.cc:1511] Processing CreateTablet for tablet 60f8b0aa61814f979d50f80c58aa1da9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:49.314998 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 2de7767ee77c4969bba8c9350190f185 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:49.316233 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d927f3c7f024383ae5d8d4e018327fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.317814 10238 tablet_service.cc:1511] Processing CreateTablet for tablet 2969d49bd76040d8afcb37a6dcf16976 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:49.319567 10238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2969d49bd76040d8afcb37a6dcf16976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.320704 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c269356f5284edabf474b9034c8da3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.322005 10237 tablet_service.cc:1511] Processing CreateTablet for tablet feaf74617ea14c089e379068bd362ac8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:49.323391 10307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f8b0aa61814f979d50f80c58aa1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.323701 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf74617ea14c089e379068bd362ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.325871 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 82534bc4cd7045f6a24502bff235976d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:49.327976 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de7767ee77c4969bba8c9350190f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.328778 10234 tablet_service.cc:1511] Processing CreateTablet for tablet 7d927f3c7f024383ae5d8d4e018327fa (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:49.333042 10235 tablet_service.cc:1511] Processing CreateTablet for tablet ff063a758e5e46bb8e8277d3b6d4ee07 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:49.333186 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 7f990deb05e0436ab18c7ac796c66c3a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:49.334813 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d927f3c7f024383ae5d8d4e018327fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.336397 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f990deb05e0436ab18c7ac796c66c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.336781 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 60f8b0aa61814f979d50f80c58aa1da9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:49.338346 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f8b0aa61814f979d50f80c58aa1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.340595 10388 tablet_service.cc:1511] Processing CreateTablet for tablet 389b7d02e091434d92c8b6ed3ad13c15 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:49.340950 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 2969d49bd76040d8afcb37a6dcf16976 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:49.342054 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389b7d02e091434d92c8b6ed3ad13c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.343075 10386 tablet_service.cc:1511] Processing CreateTablet for tablet feaf74617ea14c089e379068bd362ac8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:49.343982 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 287703ffe0634dd5a45da31c0ad95de9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:49.345659 10164 tablet_service.cc:1511] Processing CreateTablet for tablet 389b7d02e091434d92c8b6ed3ad13c15 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:49.346513 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 7f990deb05e0436ab18c7ac796c66c3a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:49.347374 10164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389b7d02e091434d92c8b6ed3ad13c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.348908 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 7d927f3c7f024383ae5d8d4e018327fa (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:49.347007 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 4c269356f5284edabf474b9034c8da3f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:49.353514 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2969d49bd76040d8afcb37a6dcf16976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.355079 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf74617ea14c089e379068bd362ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.354944 10163 tablet_service.cc:1511] Processing CreateTablet for tablet 2de7767ee77c4969bba8c9350190f185 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:49.357698 10162 tablet_service.cc:1511] Processing CreateTablet for tablet 2969d49bd76040d8afcb37a6dcf16976 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:49.358806 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 287703ffe0634dd5a45da31c0ad95de9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:49.359333 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2969d49bd76040d8afcb37a6dcf16976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.360252 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287703ffe0634dd5a45da31c0ad95de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.360762 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d927f3c7f024383ae5d8d4e018327fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.361629 10161 tablet_service.cc:1511] Processing CreateTablet for tablet 82534bc4cd7045f6a24502bff235976d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:49.345548 10385 tablet_service.cc:1511] Processing CreateTablet for tablet ff063a758e5e46bb8e8277d3b6d4ee07 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:49.363072 10161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82534bc4cd7045f6a24502bff235976d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.363559 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff063a758e5e46bb8e8277d3b6d4ee07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.364609 10305 tablet_service.cc:1511] Processing CreateTablet for tablet 2e11d29a68964be6ba9535eba55c272e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:49.365875 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c269356f5284edabf474b9034c8da3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.366044 10305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e11d29a68964be6ba9535eba55c272e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.367281 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82534bc4cd7045f6a24502bff235976d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.367559 10159 tablet_service.cc:1511] Processing CreateTablet for tablet 4c269356f5284edabf474b9034c8da3f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:49.368968 10159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c269356f5284edabf474b9034c8da3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.370054 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 7f990deb05e0436ab18c7ac796c66c3a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:49.371469 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f990deb05e0436ab18c7ac796c66c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.372534 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 287703ffe0634dd5a45da31c0ad95de9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:49.373607 10158 tablet_service.cc:1511] Processing CreateTablet for tablet 60f8b0aa61814f979d50f80c58aa1da9 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:49.374985 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f8b0aa61814f979d50f80c58aa1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.375458 10231 tablet_service.cc:1511] Processing CreateTablet for tablet 2e11d29a68964be6ba9535eba55c272e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:49.365653 10160 tablet_service.cc:1511] Processing CreateTablet for tablet ff063a758e5e46bb8e8277d3b6d4ee07 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:49.377168 10160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff063a758e5e46bb8e8277d3b6d4ee07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.378214 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f990deb05e0436ab18c7ac796c66c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.380674 10163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de7767ee77c4969bba8c9350190f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.384891 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287703ffe0634dd5a45da31c0ad95de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.394414 10230 tablet_service.cc:1511] Processing CreateTablet for tablet 16b86688c0044287ad4812aa1134a0c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:49.415421 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff063a758e5e46bb8e8277d3b6d4ee07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.416803 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e11d29a68964be6ba9535eba55c272e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.417579 10230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b86688c0044287ad4812aa1134a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.420701 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287703ffe0634dd5a45da31c0ad95de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.432668 10304 tablet_service.cc:1511] Processing CreateTablet for tablet 16b86688c0044287ad4812aa1134a0c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:49.434526 10304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b86688c0044287ad4812aa1134a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:49.439368 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:49.468613 10155 tablet_service.cc:1511] Processing CreateTablet for tablet 16b86688c0044287ad4812aa1134a0c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:49.470218 10155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b86688c0044287ad4812aa1134a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.472527 10379 tablet_service.cc:1511] Processing CreateTablet for tablet 60901c3e414849a18fdd33dbe5c1f878 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:49.474118 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60901c3e414849a18fdd33dbe5c1f878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.463582 10380 tablet_service.cc:1511] Processing CreateTablet for tablet 2e11d29a68964be6ba9535eba55c272e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:49.482124 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e11d29a68964be6ba9535eba55c272e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.549505 10312 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf286bda5432ba867269e864dfd32 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:49.550973 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf286bda5432ba867269e864dfd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.572517 10163 tablet_service.cc:1511] Processing CreateTablet for tablet 60901c3e414849a18fdd33dbe5c1f878 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:49.594367 10163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60901c3e414849a18fdd33dbe5c1f878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.594918 10443 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:49.598691 10388 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf286bda5432ba867269e864dfd32 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:49.600092 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf286bda5432ba867269e864dfd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.606637 10308 tablet_service.cc:1511] Processing CreateTablet for tablet 86dad9027a254289ad29f258e8fbf67b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:49.617480 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 86dad9027a254289ad29f258e8fbf67b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:49.619000 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dad9027a254289ad29f258e8fbf67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.621300 10199 heartbeater.cc:499] Master 127.0.107.254:45551 was elected leader, sending a full tablet report...
I20260709 13:03:49.622949 10156 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf286bda5432ba867269e864dfd32 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:49.624486 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf286bda5432ba867269e864dfd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.620643 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 60901c3e414849a18fdd33dbe5c1f878 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:49.625991 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60901c3e414849a18fdd33dbe5c1f878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.640795 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 86dad9027a254289ad29f258e8fbf67b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:49.641959 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 713471af698942b9b05f26e036e3bf4e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:49.646692 10444 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:49.646509 10443 tablet_bootstrap.cc:654] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.655372 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713471af698942b9b05f26e036e3bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.663324 10444 tablet_bootstrap.cc:654] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.652279 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dad9027a254289ad29f258e8fbf67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.668054 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dad9027a254289ad29f258e8fbf67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.691602 10231 tablet_service.cc:1511] Processing CreateTablet for tablet 713471af698942b9b05f26e036e3bf4e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:49.693120 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713471af698942b9b05f26e036e3bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.698448 10445 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:49.721362 10443 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:49.721994 10443 ts_tablet_manager.cc:1403] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.010s
I20260709 13:03:49.723875 10446 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:49.723927 10445 tablet_bootstrap.cc:654] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.720968 10383 tablet_service.cc:1511] Processing CreateTablet for tablet d7187ede0b76425593900305a48a4aa2 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:49.726490 10443 raft_consensus.cc:359] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:49.729612 10443 raft_consensus.cc:385] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.724121 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 713471af698942b9b05f26e036e3bf4e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:49.730852 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713471af698942b9b05f26e036e3bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.732053 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7187ede0b76425593900305a48a4aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.732537 10274 heartbeater.cc:499] Master 127.0.107.254:45551 was elected leader, sending a full tablet report...
I20260709 13:03:49.739497 10446 tablet_bootstrap.cc:654] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.741647 10444 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:49.730012 10443 raft_consensus.cc:740] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.745230 10155 tablet_service.cc:1511] Processing CreateTablet for tablet d7187ede0b76425593900305a48a4aa2 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:49.748868 10155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7187ede0b76425593900305a48a4aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.749390 10231 tablet_service.cc:1511] Processing CreateTablet for tablet d7187ede0b76425593900305a48a4aa2 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:49.750552 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7187ede0b76425593900305a48a4aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.756924 10380 tablet_service.cc:1511] Processing CreateTablet for tablet a7608db3fe6943948ba234b016c7f8b8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:49.758402 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7608db3fe6943948ba234b016c7f8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.748857 10443 consensus_queue.cc:260] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:49.748883 10444 ts_tablet_manager.cc:1403] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.035s
I20260709 13:03:49.762596 10312 tablet_service.cc:1511] Processing CreateTablet for tablet a7608db3fe6943948ba234b016c7f8b8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:49.773721 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7608db3fe6943948ba234b016c7f8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.776705 10161 tablet_service.cc:1511] Processing CreateTablet for tablet a7608db3fe6943948ba234b016c7f8b8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:49.778088 10161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7608db3fe6943948ba234b016c7f8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.781354 10235 tablet_service.cc:1511] Processing CreateTablet for tablet 41a65ec678174d949e2450a98c0f072b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:49.782749 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a65ec678174d949e2450a98c0f072b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.783903 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 289c2698ec0e4ce5aa73380329eaeb85 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:49.784807 10379 tablet_service.cc:1511] Processing CreateTablet for tablet 41a65ec678174d949e2450a98c0f072b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:49.785401 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289c2698ec0e4ce5aa73380329eaeb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.786298 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a65ec678174d949e2450a98c0f072b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.785977 10162 tablet_service.cc:1511] Processing CreateTablet for tablet 289c2698ec0e4ce5aa73380329eaeb85 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:49.787385 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289c2698ec0e4ce5aa73380329eaeb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.795961 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 289c2698ec0e4ce5aa73380329eaeb85 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:49.799971 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 41a65ec678174d949e2450a98c0f072b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:49.801296 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a65ec678174d949e2450a98c0f072b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.801930 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289c2698ec0e4ce5aa73380329eaeb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.819164 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 38417199a01548d58b4afa4478c87a09 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:49.823367 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38417199a01548d58b4afa4478c87a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.823482 10444 raft_consensus.cc:359] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:49.824424 10444 raft_consensus.cc:385] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.824725 10444 raft_consensus.cc:740] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.825590 10444 consensus_queue.cc:260] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:49.834623 10446 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:49.835227 10446 ts_tablet_manager.cc:1403] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.028s
I20260709 13:03:49.836711 10443 ts_tablet_manager.cc:1434] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.114s	user 0.014s	sys 0.010s
I20260709 13:03:49.839224 10446 raft_consensus.cc:359] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:49.839980 10446 raft_consensus.cc:385] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.848374 10445 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:49.848948 10445 ts_tablet_manager.cc:1403] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.001s
I20260709 13:03:49.852628 10443 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:49.840258 10446 raft_consensus.cc:740] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.857358 10446 consensus_queue.cc:260] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:49.861413 10445 raft_consensus.cc:359] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:49.862246 10445 raft_consensus.cc:385] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.862548 10445 raft_consensus.cc:740] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.863325 10445 consensus_queue.cc:260] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:49.864123 10451 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.864768 10451 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:49.866882 10443 tablet_bootstrap.cc:654] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.867558 10451 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:49.869089 10155 tablet_service.cc:1511] Processing CreateTablet for tablet 38417199a01548d58b4afa4478c87a09 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:49.881428 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 74aa2caa4cef407db88d87691e1e3e3c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:03:49.882812 10200 tablet.cc:2406] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:49.883937 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 74aa2caa4cef407db88d87691e1e3e3c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:49.882845 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74aa2caa4cef407db88d87691e1e3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.887115 10308 tablet_service.cc:1511] Processing CreateTablet for tablet f34d9d4b33884f7e8f29d0379b00614f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:49.888823 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34d9d4b33884f7e8f29d0379b00614f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.889787 10348 heartbeater.cc:499] Master 127.0.107.254:45551 was elected leader, sending a full tablet report...
I20260709 13:03:49.898535 10156 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3edbb4b0647f8a4c252423178ce18 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:49.902240 10312 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3edbb4b0647f8a4c252423178ce18 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:49.903738 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3edbb4b0647f8a4c252423178ce18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.870427 10155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38417199a01548d58b4afa4478c87a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.915207 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3edbb4b0647f8a4c252423178ce18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.917148 10446 ts_tablet_manager.cc:1434] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.014s
I20260709 13:03:49.922104 10446 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:49.922950 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 38417199a01548d58b4afa4478c87a09 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:49.924463 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38417199a01548d58b4afa4478c87a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.933530 10423 heartbeater.cc:499] Master 127.0.107.254:45551 was elected leader, sending a full tablet report...
I20260709 13:03:49.934077 10231 tablet_service.cc:1511] Processing CreateTablet for tablet f34d9d4b33884f7e8f29d0379b00614f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:49.935521 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34d9d4b33884f7e8f29d0379b00614f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.940713 10444 ts_tablet_manager.cc:1434] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.179s	user 0.017s	sys 0.021s
I20260709 13:03:49.941983 10444 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:49.944574 10236 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3edbb4b0647f8a4c252423178ce18 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:49.946008 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3edbb4b0647f8a4c252423178ce18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.948953 10444 tablet_bootstrap.cc:654] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.940459 10158 tablet_service.cc:1511] Processing CreateTablet for tablet daa66713733740428121c8683ffb7c90 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:49.952152 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74aa2caa4cef407db88d87691e1e3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.962141 10446 tablet_bootstrap.cc:654] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.964344 10239 tablet_service.cc:1511] Processing CreateTablet for tablet daa66713733740428121c8683ffb7c90 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:49.971247 10311 tablet_service.cc:1511] Processing CreateTablet for tablet bd84114c08b54e2892bb67e63f67b987 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:49.990845 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa66713733740428121c8683ffb7c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.997124 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84114c08b54e2892bb67e63f67b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.004104 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:50.006808 10137 leader_election.cc:343] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.008041 10162 tablet_service.cc:1511] Processing CreateTablet for tablet bd84114c08b54e2892bb67e63f67b987 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:50.010673 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84114c08b54e2892bb67e63f67b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.012399 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa66713733740428121c8683ffb7c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.021633 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 74aa2caa4cef407db88d87691e1e3e3c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:50.030822 10379 tablet_service.cc:1511] Processing CreateTablet for tablet f34d9d4b33884f7e8f29d0379b00614f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:50.033142 10385 tablet_service.cc:1511] Processing CreateTablet for tablet bd84114c08b54e2892bb67e63f67b987 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:50.034747 10443 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:50.022519 10380 tablet_service.cc:1511] Processing CreateTablet for tablet daa66713733740428121c8683ffb7c90 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:50.035336 10443 ts_tablet_manager.cc:1403] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.183s	user 0.034s	sys 0.006s
I20260709 13:03:50.034808 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74aa2caa4cef407db88d87691e1e3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.036586 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34d9d4b33884f7e8f29d0379b00614f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.038645 10443 raft_consensus.cc:359] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.039451 10443 raft_consensus.cc:385] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.039759 10443 raft_consensus.cc:740] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.040244 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa66713733740428121c8683ffb7c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.043203 10235 tablet_service.cc:1511] Processing CreateTablet for tablet 07e39f05718844ce83488f64c90de17b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:50.044608 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e39f05718844ce83488f64c90de17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.052668 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84114c08b54e2892bb67e63f67b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.036127 10453 raft_consensus.cc:493] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.056839 10453 raft_consensus.cc:515] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.059650 10453 leader_election.cc:290] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:50.087590 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 07e39f05718844ce83488f64c90de17b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:50.089136 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e39f05718844ce83488f64c90de17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.097517 10446 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:50.098405 10446 ts_tablet_manager.cc:1403] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.019s
I20260709 13:03:50.104756 10444 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:50.105346 10444 ts_tablet_manager.cc:1403] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.005s
I20260709 13:03:50.106478 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 07e39f05718844ce83488f64c90de17b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:50.107867 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e39f05718844ce83488f64c90de17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.108333 10446 raft_consensus.cc:359] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.109061 10446 raft_consensus.cc:385] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.065133 10443 consensus_queue.cc:260] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.106926 10445 ts_tablet_manager.cc:1434] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.258s	user 0.032s	sys 0.021s
I20260709 13:03:50.110416 10445 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:50.113124 10443 ts_tablet_manager.cc:1434] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:03:50.114148 10443 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:50.115188 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 13a5c8e6908849eba50516a7beb99556 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:50.109364 10446 raft_consensus.cc:740] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.121061 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 13a5c8e6908849eba50516a7beb99556 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:50.122359 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a5c8e6908849eba50516a7beb99556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.122840 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 037e0166c77b44e4b4fcf5ec317fc05c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:50.124069 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037e0166c77b44e4b4fcf5ec317fc05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.146886 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:50.147658 10398 raft_consensus.cc:2468] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:50.149142 10140 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.149991 10451 raft_consensus.cc:2804] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.150372 10451 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.150712 10451 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.151530 10443 tablet_bootstrap.cc:654] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.156966 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 037e0166c77b44e4b4fcf5ec317fc05c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:50.157757 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 037e0166c77b44e4b4fcf5ec317fc05c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:50.158421 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037e0166c77b44e4b4fcf5ec317fc05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.164433 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037e0166c77b44e4b4fcf5ec317fc05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.177178 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 13a5c8e6908849eba50516a7beb99556 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:50.179550 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a5c8e6908849eba50516a7beb99556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.180761 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a5c8e6908849eba50516a7beb99556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.190004 10451 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.196592 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:50.196771 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:50.198345 10212 leader_election.cc:343] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.196040 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
W20260709 13:03:50.198997 10137 leader_election.cc:343] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.199317 10398 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.122807 10446 consensus_queue.cc:260] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.208725 10446 ts_tablet_manager.cc:1434] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.002s
I20260709 13:03:50.209856 10446 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:50.203151 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 21b734032a14447b91008890f867d801 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:50.224499 10444 raft_consensus.cc:359] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.192260 10451 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:50.226935 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.230259 10174 raft_consensus.cc:2468] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:50.230859 10162 tablet_service.cc:1511] Processing CreateTablet for tablet 21b734032a14447b91008890f867d801 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:50.228464 10379 tablet_service.cc:1511] Processing CreateTablet for tablet 21b734032a14447b91008890f867d801 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:50.232230 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b734032a14447b91008890f867d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.233170 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b734032a14447b91008890f867d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.234884 10445 tablet_bootstrap.cc:654] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.235841 10239 tablet_service.cc:1511] Processing CreateTablet for tablet e981dc5ffbe9413a941979a7e31690e1 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:50.243018 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e981dc5ffbe9413a941979a7e31690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.237923 10398 raft_consensus.cc:2468] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:50.244701 10140 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.245904 10451 raft_consensus.cc:2804] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.237216 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b734032a14447b91008890f867d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.237893 10215 leader_election.cc:304] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.249967 10453 raft_consensus.cc:2804] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.250486 10453 raft_consensus.cc:493] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.250883 10453 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.253116 10308 tablet_service.cc:1511] Processing CreateTablet for tablet e981dc5ffbe9413a941979a7e31690e1 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:50.255703 10459 raft_consensus.cc:493] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.256300 10459 raft_consensus.cc:515] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.261317 10459 leader_election.cc:290] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:50.226436 10444 raft_consensus.cc:385] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.281011 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e981dc5ffbe9413a941979a7e31690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.288523 10443 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:50.295789 10446 tablet_bootstrap.cc:654] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.279331 10444 raft_consensus.cc:740] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.297083 10444 consensus_queue.cc:260] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.299400 10444 ts_tablet_manager.cc:1434] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.194s	user 0.004s	sys 0.003s
I20260709 13:03:50.260186 10453 raft_consensus.cc:515] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.301389 10453 leader_election.cc:290] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:50.301092 10156 tablet_service.cc:1511] Processing CreateTablet for tablet f48ec6559166499ca5242a577701f114 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:50.302152 10443 ts_tablet_manager.cc:1403] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.188s	user 0.039s	sys 0.017s
I20260709 13:03:50.302542 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48ec6559166499ca5242a577701f114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.305311 10443 raft_consensus.cc:359] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.307904 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:50.311708 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:50.312459 10174 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.274814 10451 raft_consensus.cc:697] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
W20260709 13:03:50.317926 10212 leader_election.cc:343] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.319641 10231 tablet_service.cc:1511] Processing CreateTablet for tablet f48ec6559166499ca5242a577701f114 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:50.320477 10444 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:50.320979 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48ec6559166499ca5242a577701f114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.297598 10384 tablet_service.cc:1511] Processing CreateTablet for tablet e981dc5ffbe9413a941979a7e31690e1 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:50.306531 10443 raft_consensus.cc:385] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.329516 10444 tablet_bootstrap.cc:654] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.329375 10451 consensus_queue.cc:237] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.329452 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e981dc5ffbe9413a941979a7e31690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.329320 10443 raft_consensus.cc:740] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.336580 10174 raft_consensus.cc:2468] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:50.337000 10443 consensus_queue.cc:260] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.338786 10312 tablet_service.cc:1511] Processing CreateTablet for tablet f48ec6559166499ca5242a577701f114 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:50.340130 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48ec6559166499ca5242a577701f114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.340770 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9543c32b3846c78cd39da12cdbf781 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:50.341997 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9543c32b3846c78cd39da12cdbf781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.344672 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9543c32b3846c78cd39da12cdbf781 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:50.345036 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 1325c482dbf64578a5799209e1af6370 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:50.346033 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9543c32b3846c78cd39da12cdbf781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.346314 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1325c482dbf64578a5799209e1af6370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.353629 10443 ts_tablet_manager.cc:1434] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 13:03:50.353812 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9543c32b3846c78cd39da12cdbf781 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:50.354914 10443 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:50.355325 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9543c32b3846c78cd39da12cdbf781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.363216 10158 tablet_service.cc:1511] Processing CreateTablet for tablet 1325c482dbf64578a5799209e1af6370 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:50.365039 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1325c482dbf64578a5799209e1af6370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.365131 10379 tablet_service.cc:1511] Processing CreateTablet for tablet 1325c482dbf64578a5799209e1af6370 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:50.366524 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1325c482dbf64578a5799209e1af6370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.370044 10215 leader_election.cc:304] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.374724 10453 raft_consensus.cc:2804] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.375243 10453 raft_consensus.cc:697] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:50.376035 10453 consensus_queue.cc:237] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.375749 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 9c69db33a1ce4b1894e7cc946d24270c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:50.384564 10071 catalog_manager.cc:5697] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.387720 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:50.397745 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 9c69db33a1ce4b1894e7cc946d24270c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:50.399240 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c69db33a1ce4b1894e7cc946d24270c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:50.399911 10287 leader_election.cc:343] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.403146 10446 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:50.403699 10446 ts_tablet_manager.cc:1403] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.194s	user 0.019s	sys 0.000s
I20260709 13:03:50.406740 10446 raft_consensus.cc:359] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.407475 10446 raft_consensus.cc:385] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.407745 10446 raft_consensus.cc:740] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.408617 10460 raft_consensus.cc:493] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.409125 10460 raft_consensus.cc:515] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.409914 10452 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.410404 10452 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.411525 10460 leader_election.cc:290] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:50.413158 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c69db33a1ce4b1894e7cc946d24270c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.413079 10452 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:50.410337 10443 tablet_bootstrap.cc:654] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.425354 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.426056 10174 raft_consensus.cc:2468] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:50.427258 10215 leader_election.cc:304] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
W20260709 13:03:50.442520 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:50.442320 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 2c96e8c718214d359041be0247dd3c4b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:50.421650 10446 consensus_queue.cc:260] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.443871 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c96e8c718214d359041be0247dd3c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.454988 10453 raft_consensus.cc:2804] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.455559 10453 raft_consensus.cc:493] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.455912 10453 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.465193 10445 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:50.465922 10445 ts_tablet_manager.cc:1403] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.356s	user 0.023s	sys 0.011s
I20260709 13:03:50.466871 10446 ts_tablet_manager.cc:1434] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.003s
I20260709 13:03:50.468077 10446 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:50.467075 10444 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:50.468813 10444 ts_tablet_manager.cc:1403] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.024s
I20260709 13:03:50.471983 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 2c96e8c718214d359041be0247dd3c4b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:50.473253 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c96e8c718214d359041be0247dd3c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.474061 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 2c96e8c718214d359041be0247dd3c4b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:50.480414 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c96e8c718214d359041be0247dd3c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.479947 10444 raft_consensus.cc:359] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.485183 10072 catalog_manager.cc:5697] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.480901 10444 raft_consensus.cc:385] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.493080 10445 raft_consensus.cc:359] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.494964 10308 tablet_service.cc:1511] Processing CreateTablet for tablet b7cf8b715d234c44aac72258d0bac01f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:50.499818 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cf8b715d234c44aac72258d0bac01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.480857 10453 raft_consensus.cc:515] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.497391 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 26b3af5323c84e73b6cc311b8e672e92 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:50.501667 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b3af5323c84e73b6cc311b8e672e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.497711 10162 tablet_service.cc:1511] Processing CreateTablet for tablet 26b3af5323c84e73b6cc311b8e672e92 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:50.505043 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b3af5323c84e73b6cc311b8e672e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.506017 10446 tablet_bootstrap.cc:654] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.508782 10445 raft_consensus.cc:385] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.524142 10445 raft_consensus.cc:740] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.524029 10380 tablet_service.cc:1511] Processing CreateTablet for tablet 26b3af5323c84e73b6cc311b8e672e92 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:50.525290 10445 consensus_queue.cc:260] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.525902 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b3af5323c84e73b6cc311b8e672e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.528075 10445 ts_tablet_manager.cc:1434] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:03:50.524027 10386 tablet_service.cc:1511] Processing CreateTablet for tablet b7cf8b715d234c44aac72258d0bac01f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:50.530339 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 9c69db33a1ce4b1894e7cc946d24270c (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:50.498751 10444 raft_consensus.cc:740] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.540481 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cf8b715d234c44aac72258d0bac01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.540850 10157 tablet_service.cc:1511] Processing CreateTablet for tablet b7cf8b715d234c44aac72258d0bac01f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:50.541498 10233 tablet_service.cc:1511] Processing CreateTablet for tablet bae79c759a874e5ab8c3a59dbde5aa0e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:50.542160 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cf8b715d234c44aac72258d0bac01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.542737 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae79c759a874e5ab8c3a59dbde5aa0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.547037 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c69db33a1ce4b1894e7cc946d24270c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.552805 10444 consensus_queue.cc:260] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.554842 10453 leader_election.cc:290] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:50.556090 10445 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:50.559101 10444 ts_tablet_manager.cc:1434] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.090s	user 0.002s	sys 0.006s
I20260709 13:03:50.560487 10444 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:50.556103 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:50.561630 10174 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.580619 10306 tablet_service.cc:1511] Processing CreateTablet for tablet bae79c759a874e5ab8c3a59dbde5aa0e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:50.582032 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae79c759a874e5ab8c3a59dbde5aa0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.592329 10174 raft_consensus.cc:2468] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:50.593699 10215 leader_election.cc:304] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:50.594594 10453 raft_consensus.cc:2804] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.595359 10453 raft_consensus.cc:697] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:50.596213 10453 consensus_queue.cc:237] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.604803 10452 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.605381 10452 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.606925 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 14f42bc2234743f1bf7ae96281ec598b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:50.607815 10452 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:50.609179 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f42bc2234743f1bf7ae96281ec598b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.620201 10459 raft_consensus.cc:493] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.620833 10459 raft_consensus.cc:515] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:50.621316 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 14f42bc2234743f1bf7ae96281ec598b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:50.622403 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f42bc2234743f1bf7ae96281ec598b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.622641 10459 leader_election.cc:290] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:50.623301 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:50.628255 10156 tablet_service.cc:1511] Processing CreateTablet for tablet f33497a7cce7475fb1f48d994ccdb42e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:50.628527 10443 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:50.629617 10384 tablet_service.cc:1511] Processing CreateTablet for tablet f33497a7cce7475fb1f48d994ccdb42e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:50.630518 10443 ts_tablet_manager.cc:1403] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.015s
I20260709 13:03:50.631877 10237 tablet_service.cc:1511] Processing CreateTablet for tablet f33497a7cce7475fb1f48d994ccdb42e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:50.633229 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33497a7cce7475fb1f48d994ccdb42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.635218 10443 raft_consensus.cc:359] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.636274 10443 raft_consensus.cc:385] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.636739 10443 raft_consensus.cc:740] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.627511 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:50.638792 10443 consensus_queue.cc:260] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:50.639614 10287 leader_election.cc:343] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.630612 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33497a7cce7475fb1f48d994ccdb42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.631912 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33497a7cce7475fb1f48d994ccdb42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.647692 10446 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:50.648241 10446 ts_tablet_manager.cc:1403] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.010s
I20260709 13:03:50.651436 10446 raft_consensus.cc:359] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.652124 10446 raft_consensus.cc:385] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.652568 10446 raft_consensus.cc:740] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.653613 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:50.653820 10446 consensus_queue.cc:260] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.655376 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:50.656337 10445 tablet_bootstrap.cc:654] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.657898 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:50.658269 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 5590ebc0addd48ceb9f37bffbe5de9c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:50.659914 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590ebc0addd48ceb9f37bffbe5de9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.660339 10383 tablet_service.cc:1511] Processing CreateTablet for tablet bae79c759a874e5ab8c3a59dbde5aa0e (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:50.663303 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 5590ebc0addd48ceb9f37bffbe5de9c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:50.643399 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 14f42bc2234743f1bf7ae96281ec598b (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:50.662583 10446 ts_tablet_manager.cc:1434] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:50.641705 10443 ts_tablet_manager.cc:1434] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:03:50.669334 10446 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:50.655391 10444 tablet_bootstrap.cc:654] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.667953 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae79c759a874e5ab8c3a59dbde5aa0e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:50.675637 10215 leader_election.cc:343] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.677459 10215 leader_election.cc:343] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.679339 10289 leader_election.cc:343] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.679961 10289 leader_election.cc:304] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:50.680653 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f42bc2234743f1bf7ae96281ec598b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.680894 10459 raft_consensus.cc:2749] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:50.681859 10289 leader_election.cc:343] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.682418 10289 leader_election.cc:304] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:50.675936 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590ebc0addd48ceb9f37bffbe5de9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.683161 10459 raft_consensus.cc:2749] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.695636 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.697408 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.706557 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:50.707345 10453 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.707883 10453 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
W20260709 13:03:50.708411 10364 leader_election.cc:343] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.708941 10443 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:03:50.709144 10362 leader_election.cc:343] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.709617 10362 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:50.710512 10453 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:50.711468 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:50.711938 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.713152 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:50.710562 10452 raft_consensus.cc:2749] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.715116 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 5590ebc0addd48ceb9f37bffbe5de9c8 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:50.719465 10306 tablet_service.cc:1511] Processing CreateTablet for tablet e27f9cdf5f7448b1b83691579db44a27 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:50.722254 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27f9cdf5f7448b1b83691579db44a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.721935 10233 tablet_service.cc:1511] Processing CreateTablet for tablet e27f9cdf5f7448b1b83691579db44a27 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:50.722667 10380 tablet_service.cc:1511] Processing CreateTablet for tablet e27f9cdf5f7448b1b83691579db44a27 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:50.723361 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27f9cdf5f7448b1b83691579db44a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.723910 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27f9cdf5f7448b1b83691579db44a27. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:50.713474 10215 leader_election.cc:343] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.724777 10361 leader_election.cc:343] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.724916 10212 leader_election.cc:343] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.725442 10364 leader_election.cc:343] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.727445 10212 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.728403 10453 raft_consensus.cc:2749] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.735245 10364 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.736950 10452 raft_consensus.cc:2749] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.739981 10158 tablet_service.cc:1511] Processing CreateTablet for tablet b795492ea96e4371835f5f4cacaf9141 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:50.741086 10446 tablet_bootstrap.cc:654] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.742445 10239 tablet_service.cc:1511] Processing CreateTablet for tablet b795492ea96e4371835f5f4cacaf9141 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:50.743897 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b795492ea96e4371835f5f4cacaf9141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.744117 10308 tablet_service.cc:1511] Processing CreateTablet for tablet b795492ea96e4371835f5f4cacaf9141 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:50.745544 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b795492ea96e4371835f5f4cacaf9141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.753808 10379 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:50.755358 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.776875 10162 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:50.772755 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590ebc0addd48ceb9f37bffbe5de9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.779147 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.787014 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b795492ea96e4371835f5f4cacaf9141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.788285 10445 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:50.788883 10445 ts_tablet_manager.cc:1403] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.233s	user 0.022s	sys 0.015s
I20260709 13:03:50.793087 10445 raft_consensus.cc:359] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.794354 10445 raft_consensus.cc:385] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.794757 10445 raft_consensus.cc:740] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.795917 10445 consensus_queue.cc:260] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.800571 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:50.801971 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1a9d1c53c442ff8ea9c6cdbd02031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.807070 10443 tablet_bootstrap.cc:654] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.817899 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e7f66e663495dac8f9b10d847b0f6 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:50.773242 10071 catalog_manager.cc:5697] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.819568 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e7f66e663495dac8f9b10d847b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.808847 10445 ts_tablet_manager.cc:1434] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:03:50.821544 10380 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e7f66e663495dac8f9b10d847b0f6 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:50.822984 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e7f66e663495dac8f9b10d847b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.825048 10445 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:50.829100 10459 raft_consensus.cc:493] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.829666 10459 raft_consensus.cc:515] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.837291 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:50.840446 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e7f66e663495dac8f9b10d847b0f6 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:50.841908 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e7f66e663495dac8f9b10d847b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.842696 10233 tablet_service.cc:1511] Processing CreateTablet for tablet fc4d416a3b0a41bb80cd831c381eb1bf (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:50.844687 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4d416a3b0a41bb80cd831c381eb1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.845526 10459 leader_election.cc:290] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:50.849156 10445 tablet_bootstrap.cc:654] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.851536 10444 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:50.852202 10444 ts_tablet_manager.cc:1403] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.292s	user 0.020s	sys 0.006s
I20260709 13:03:50.853157 10451 raft_consensus.cc:493] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.853689 10451 raft_consensus.cc:515] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:50.857645 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:03:50.859272 10140 leader_election.cc:343] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.856112 10451 leader_election.cc:290] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:50.866168 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.867093 10173 raft_consensus.cc:2393] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:50.869139 10289 leader_election.cc:304] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:50.873363 10459 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.873540 10379 tablet_service.cc:1511] Processing CreateTablet for tablet fc4d416a3b0a41bb80cd831c381eb1bf (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:50.875016 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4d416a3b0a41bb80cd831c381eb1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.878881 10444 raft_consensus.cc:359] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.879781 10444 raft_consensus.cc:385] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.862315 10308 tablet_service.cc:1511] Processing CreateTablet for tablet fc4d416a3b0a41bb80cd831c381eb1bf (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:50.880100 10444 raft_consensus.cc:740] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.883265 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4d416a3b0a41bb80cd831c381eb1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.890496 10453 raft_consensus.cc:493] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.891058 10453 raft_consensus.cc:515] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:50.893256 10453 leader_election.cc:290] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:50.892889 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 78e7bbdd88eb4f6ea262e8951785f78a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:50.895669 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:50.896332 10386 tablet_service.cc:1511] Processing CreateTablet for tablet b03c643c1bde4551be180d6ce6a7f407 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:50.897694 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03c643c1bde4551be180d6ce6a7f407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.899154 10312 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d6f0a40934634966942872cb2fcc3 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:50.899349 10383 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d6f0a40934634966942872cb2fcc3 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:50.900799 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d6f0a40934634966942872cb2fcc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:50.900956 10212 leader_election.cc:343] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.903506 10311 tablet_service.cc:1511] Processing CreateTablet for tablet dff683367d884f7799d765efa95a0c5a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:50.905592 10384 tablet_service.cc:1511] Processing CreateTablet for tablet dff683367d884f7799d765efa95a0c5a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:50.906932 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff683367d884f7799d765efa95a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.907889 10304 tablet_service.cc:1511] Processing CreateTablet for tablet 136327a8d9d14b05838f2e67d241c7f7 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:50.912091 10385 tablet_service.cc:1511] Processing CreateTablet for tablet d884577f53054c19b81aad58eca5d459 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:50.912695 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 13eea7ab12e34becb6bc5d54471e2677 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:50.914268 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d884577f53054c19b81aad58eca5d459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.918781 10310 tablet_service.cc:1511] Processing CreateTablet for tablet d27c8a705d134d5f96385dc1ed5aaa3d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:50.919579 10388 tablet_service.cc:1511] Processing CreateTablet for tablet 13eea7ab12e34becb6bc5d54471e2677 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:50.920943 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eea7ab12e34becb6bc5d54471e2677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.923261 10382 tablet_service.cc:1511] Processing CreateTablet for tablet d27c8a705d134d5f96385dc1ed5aaa3d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:50.923596 10307 tablet_service.cc:1511] Processing CreateTablet for tablet 50a00d13ac4c46b980527f87fe684f46 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:50.924741 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27c8a705d134d5f96385dc1ed5aaa3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.929503 10305 tablet_service.cc:1511] Processing CreateTablet for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:50.933727 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 05527a68e23b4b8e93c8f818819cc68a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:50.934291 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:50.934960 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05527a68e23b4b8e93c8f818819cc68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.935585 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:50.888361 10137 consensus_peers.cc:597] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.946666 10137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 58534.4us
I20260709 13:03:50.947973 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:50.953590 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 78e7bbdd88eb4f6ea262e8951785f78a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:50.955003 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e7bbdd88eb4f6ea262e8951785f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.955340 10234 tablet_service.cc:1511] Processing CreateTablet for tablet d27c8a705d134d5f96385dc1ed5aaa3d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:50.956560 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27c8a705d134d5f96385dc1ed5aaa3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.956727 10307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a00d13ac4c46b980527f87fe684f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.958707 10305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.953841 10239 tablet_service.cc:1511] Processing CreateTablet for tablet b03c643c1bde4551be180d6ce6a7f407 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:50.959785 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 05527a68e23b4b8e93c8f818819cc68a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:50.963249 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e7bbdd88eb4f6ea262e8951785f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.963714 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03c643c1bde4551be180d6ce6a7f407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.963593 10444 consensus_queue.cc:260] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:50.965585 10445 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:50.965941 10444 ts_tablet_manager.cc:1434] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 13:03:50.966390 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05527a68e23b4b8e93c8f818819cc68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.967265 10230 tablet_service.cc:1511] Processing CreateTablet for tablet 50a00d13ac4c46b980527f87fe684f46 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:50.967411 10237 tablet_service.cc:1511] Processing CreateTablet for tablet dff683367d884f7799d765efa95a0c5a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:50.969230 10235 tablet_service.cc:1511] Processing CreateTablet for tablet d884577f53054c19b81aad58eca5d459 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:50.966112 10445 ts_tablet_manager.cc:1403] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.003s
W20260709 13:03:50.970937 10215 leader_election.cc:343] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.978124 10215 leader_election.cc:304] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:50.978649 10230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a00d13ac4c46b980527f87fe684f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.979153 10453 raft_consensus.cc:2749] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.979756 10460 consensus_queue.cc:1048] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.969100 10231 tablet_service.cc:1511] Processing CreateTablet for tablet 136327a8d9d14b05838f2e67d241c7f7 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:50.982133 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136327a8d9d14b05838f2e67d241c7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.981913 10451 consensus_queue.cc:1048] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.984978 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff683367d884f7799d765efa95a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.994475 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d884577f53054c19b81aad58eca5d459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.000128 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27c8a705d134d5f96385dc1ed5aaa3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.005395 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 78e7bbdd88eb4f6ea262e8951785f78a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:51.005695 10162 tablet_service.cc:1511] Processing CreateTablet for tablet b03c643c1bde4551be180d6ce6a7f407 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:51.007494 10157 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d6f0a40934634966942872cb2fcc3 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:51.009622 10155 tablet_service.cc:1511] Processing CreateTablet for tablet 136327a8d9d14b05838f2e67d241c7f7 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:51.011819 10161 tablet_service.cc:1511] Processing CreateTablet for tablet d884577f53054c19b81aad58eca5d459 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:51.015872 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e7bbdd88eb4f6ea262e8951785f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.016908 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d6f0a40934634966942872cb2fcc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.021354 10162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03c643c1bde4551be180d6ce6a7f407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.022089 10161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d884577f53054c19b81aad58eca5d459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.024160 10155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136327a8d9d14b05838f2e67d241c7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.015383 10444 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.041711 10159 tablet_service.cc:1511] Processing CreateTablet for tablet 13eea7ab12e34becb6bc5d54471e2677 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:51.049790 10159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eea7ab12e34becb6bc5d54471e2677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.052755 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eea7ab12e34becb6bc5d54471e2677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.067699 10446 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.080591 10304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136327a8d9d14b05838f2e67d241c7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.085820 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff683367d884f7799d765efa95a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.073294 10459 raft_consensus.cc:2749] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.095671 10445 raft_consensus.cc:359] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.097121 10460 consensus_queue.cc:1048] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.102749 10443 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.099514 10156 tablet_service.cc:1511] Processing CreateTablet for tablet 50a00d13ac4c46b980527f87fe684f46 (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:51.101693 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d6f0a40934634966942872cb2fcc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.105923 10157 tablet_service.cc:1511] Processing CreateTablet for tablet 05527a68e23b4b8e93c8f818819cc68a (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:51.100467 10445 raft_consensus.cc:385] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.108148 10445 raft_consensus.cc:740] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.115568 10445 consensus_queue.cc:260] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.117619 10158 tablet_service.cc:1511] Processing CreateTablet for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d (DEFAULT_TABLE table=test-workload [id=f7e6fbab7dd44a2c84c308dadfd72729]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:51.119470 10445 ts_tablet_manager.cc:1434] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.002s
I20260709 13:03:51.120007 10443 ts_tablet_manager.cc:1403] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.411s	user 0.021s	sys 0.018s
I20260709 13:03:51.120528 10156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a00d13ac4c46b980527f87fe684f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.082564 10446 ts_tablet_manager.cc:1403] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.412s	user 0.016s	sys 0.015s
I20260709 13:03:51.123823 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a72a81e18bd4f33ab1f087ecbd1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.125248 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.126261 10445 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.132889 10157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05527a68e23b4b8e93c8f818819cc68a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:51.135226 10138 leader_election.cc:343] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.125160 10443 raft_consensus.cc:359] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.143472 10445 tablet_bootstrap.cc:654] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.148550 10138 leader_election.cc:304] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:51.154516 10451 raft_consensus.cc:2749] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.166219 10460 consensus_queue.cc:1048] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.182356 10446 raft_consensus.cc:359] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.184424 10444 tablet_bootstrap.cc:654] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.148779 10443 raft_consensus.cc:385] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.198468 10446 raft_consensus.cc:385] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:51.198084 10493 log.cc:927] Time spent T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:03:51.205250 10443 raft_consensus.cc:740] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.214251 10446 raft_consensus.cc:740] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
W20260709 13:03:51.223366 10215 consensus_peers.cc:597] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 -> Peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Couldn't send request to peer c4b5b492fca940a3883a22eec56a4f9f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.229837 10446 consensus_queue.cc:260] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.257715 10443 consensus_queue.cc:260] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.278870 10443 ts_tablet_manager.cc:1434] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.005s
I20260709 13:03:51.280004 10443 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.289311 10445 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.289932 10445 ts_tablet_manager.cc:1403] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.032s
I20260709 13:03:51.300920 10446 ts_tablet_manager.cc:1434] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.171s	user 0.004s	sys 0.008s
I20260709 13:03:51.302353 10446 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.317776 10459 raft_consensus.cc:493] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.318463 10459 raft_consensus.cc:515] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.321270 10445 raft_consensus.cc:359] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.322098 10445 raft_consensus.cc:385] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.322398 10445 raft_consensus.cc:740] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.323608 10459 leader_election.cc:290] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:51.322503 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:51.326722 10056 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 51074.1us
W20260709 13:03:51.327553 10212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 81154us
W20260709 13:03:51.329226 10289 leader_election.cc:343] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.332146 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.333105 10249 raft_consensus.cc:2468] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:51.334316 10287 leader_election.cc:304] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:51.338718 10443 tablet_bootstrap.cc:654] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.339952 10444 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.340458 10444 ts_tablet_manager.cc:1403] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.341s	user 0.021s	sys 0.006s
I20260709 13:03:51.341266 10459 raft_consensus.cc:2804] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.341676 10459 raft_consensus.cc:493] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.341986 10459 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.342211 10446 tablet_bootstrap.cc:654] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.343331 10444 raft_consensus.cc:359] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.351714 10444 raft_consensus.cc:385] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.355471 10444 raft_consensus.cc:740] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.330047 10445 consensus_queue.cc:260] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.358904 10504 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.359614 10504 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.356998 10444 consensus_queue.cc:260] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.362736 10504 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.364246 10444 ts_tablet_manager.cc:1434] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 13:03:51.364467 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.365866 10459 raft_consensus.cc:515] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.367211 10444 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.368917 10459 leader_election.cc:290] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
W20260709 13:03:51.366005 10215 leader_election.cc:343] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.368856 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:51.370065 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:51.370643 10249 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.370842 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.371557 10398 raft_consensus.cc:2468] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:51.372869 10215 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
W20260709 13:03:51.373602 10289 leader_election.cc:343] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.374025 10504 raft_consensus.cc:2804] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.374471 10504 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.374819 10504 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.376884 10445 ts_tablet_manager.cc:1434] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.004s
I20260709 13:03:51.377990 10445 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.379587 10443 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.380152 10443 ts_tablet_manager.cc:1403] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.001s
I20260709 13:03:51.381080 10444 tablet_bootstrap.cc:654] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.383296 10443 raft_consensus.cc:359] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.384248 10443 raft_consensus.cc:385] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.384354 10445 tablet_bootstrap.cc:654] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.392644 10452 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.385295 10249 raft_consensus.cc:2468] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:51.410996 10452 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.411928 10287 leader_election.cc:304] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:51.394532 10444 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.391116 10504 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.413792 10444 ts_tablet_manager.cc:1403] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 13:03:51.414116 10507 raft_consensus.cc:2804] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.414698 10507 raft_consensus.cc:697] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:51.416769 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:51.415623 10507 consensus_queue.cc:237] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.417559 10398 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.417166 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:51.386999 10446 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.424191 10446 ts_tablet_manager.cc:1403] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.015s
I20260709 13:03:51.426409 10446 raft_consensus.cc:359] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.426924 10446 raft_consensus.cc:385] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.427142 10446 raft_consensus.cc:740] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.427732 10446 consensus_queue.cc:260] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.419178 10504 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.420564 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:51.417804 10444 raft_consensus.cc:359] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:51.423549 10361 leader_election.cc:343] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.429252 10444 raft_consensus.cc:385] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.430411 10444 raft_consensus.cc:740] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
W20260709 13:03:51.429580 10215 leader_election.cc:343] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.432998 10444 consensus_queue.cc:260] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.384682 10443 raft_consensus.cc:740] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.436980 10443 consensus_queue.cc:260] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.429944 10452 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.431300 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.439491 10173 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:51.429334 10398 raft_consensus.cc:2468] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:51.441386 10446 ts_tablet_manager.cc:1434] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:03:51.442564 10446 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.442737 10364 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
W20260709 13:03:51.445340 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:51.446965 10444 ts_tablet_manager.cc:1434] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:03:51.439839 10443 ts_tablet_manager.cc:1434] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:03:51.448067 10444 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.450088 10215 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:51.451099 10071 catalog_manager.cc:5697] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.457876 10504 raft_consensus.cc:2804] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.458814 10504 raft_consensus.cc:697] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:51.459718 10504 consensus_queue.cc:237] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.465210 10452 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.465698 10452 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.466039 10452 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.466356 10445 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.465210 10443 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.467047 10445 ts_tablet_manager.cc:1403] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.049s
I20260709 13:03:51.470335 10445 raft_consensus.cc:359] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.471158 10445 raft_consensus.cc:385] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.471508 10445 raft_consensus.cc:740] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.472429 10445 consensus_queue.cc:260] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.474798 10445 ts_tablet_manager.cc:1434] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:51.474872 10452 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.476061 10445 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.478085 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
W20260709 13:03:51.479871 10361 leader_election.cc:343] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.481663 10444 tablet_bootstrap.cc:654] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.483206 10443 tablet_bootstrap.cc:654] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.484243 10445 tablet_bootstrap.cc:654] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.485975 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:51.486707 10173 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.486583 10446 tablet_bootstrap.cc:654] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.494014 10444 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.494805 10444 ts_tablet_manager.cc:1403] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.006s
I20260709 13:03:51.497170 10452 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.497867 10173 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:51.499454 10364 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:51.500905 10452 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.502341 10452 raft_consensus.cc:697] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:51.502818 10069 catalog_manager.cc:5697] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.503546 10452 consensus_queue.cc:237] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.507398 10445 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.508082 10445 ts_tablet_manager.cc:1403] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260709 13:03:51.512383 10445 raft_consensus.cc:359] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.513778 10445 raft_consensus.cc:385] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.515901 10443 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.516661 10443 ts_tablet_manager.cc:1403] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.002s
I20260709 13:03:51.514148 10445 raft_consensus.cc:740] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.518321 10445 consensus_queue.cc:260] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.520052 10443 raft_consensus.cc:359] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.520920 10443 raft_consensus.cc:385] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.521275 10443 raft_consensus.cc:740] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.521209 10445 ts_tablet_manager.cc:1434] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 13:03:51.522965 10445 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.523339 10443 consensus_queue.cc:260] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.528756 10444 raft_consensus.cc:359] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.529675 10444 raft_consensus.cc:385] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.530135 10444 raft_consensus.cc:740] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.531085 10444 consensus_queue.cc:260] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.532186 10443 ts_tablet_manager.cc:1434] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:51.533413 10443 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.533836 10444 ts_tablet_manager.cc:1434] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:03:51.534927 10444 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.543056 10443 tablet_bootstrap.cc:654] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.544188 10446 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.544776 10446 ts_tablet_manager.cc:1403] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.017s
I20260709 13:03:51.543876 10070 catalog_manager.cc:5697] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.545261 10452 raft_consensus.cc:493] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.545794 10452 raft_consensus.cc:515] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.543792 10445 tablet_bootstrap.cc:654] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.548182 10452 leader_election.cc:290] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:51.543792 10444 tablet_bootstrap.cc:654] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.547920 10446 raft_consensus.cc:359] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.549010 10446 raft_consensus.cc:385] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.549388 10446 raft_consensus.cc:740] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.549916 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.550418 10446 consensus_queue.cc:260] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.552695 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.555596 10362 leader_election.cc:304] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:51.556874 10452 raft_consensus.cc:2749] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.568107 10452 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.568580 10446 ts_tablet_manager.cc:1434] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:03:51.568660 10452 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.569998 10446 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.570966 10452 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.572645 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:51.574648 10498 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.575511 10498 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:03:51.577402 10361 leader_election.cc:343] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.575438 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.580013 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:51.580463 10364 leader_election.cc:343] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.580964 10364 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
W20260709 13:03:51.581915 10137 leader_election.cc:343] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.582083 10452 raft_consensus.cc:2749] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.578050 10446 tablet_bootstrap.cc:654] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.583333 10498 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.586553 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.590638 10444 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.594460 10444 ts_tablet_manager.cc:1403] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.015s
I20260709 13:03:51.592142 10443 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.594336 10398 raft_consensus.cc:2468] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:51.591805 10445 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.595744 10443 ts_tablet_manager.cc:1403] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.031s
I20260709 13:03:51.596118 10140 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:51.596077 10445 ts_tablet_manager.cc:1403] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.073s	user 0.001s	sys 0.023s
I20260709 13:03:51.597675 10498 raft_consensus.cc:2804] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.598183 10498 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.598542 10498 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.598634 10443 raft_consensus.cc:359] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.599426 10443 raft_consensus.cc:385] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.599707 10443 raft_consensus.cc:740] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.600505 10443 consensus_queue.cc:260] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.601904 10445 raft_consensus.cc:359] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.602771 10444 raft_consensus.cc:359] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.603335 10445 raft_consensus.cc:385] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.603544 10444 raft_consensus.cc:385] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.604032 10444 raft_consensus.cc:740] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.605011 10444 consensus_queue.cc:260] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.609339 10498 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.603648 10445 raft_consensus.cc:740] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.602954 10443 ts_tablet_manager.cc:1434] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:03:51.611618 10498 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.612244 10443 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.612764 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:51.613521 10444 ts_tablet_manager.cc:1434] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:03:51.614531 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:51.614876 10445 consensus_queue.cc:260] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.616472 10323 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.617188 10445 ts_tablet_manager.cc:1434] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:03:51.618153 10445 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.619172 10443 tablet_bootstrap.cc:654] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.620819 10446 tablet_bootstrap.cc:492] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.621313 10446 ts_tablet_manager.cc:1403] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.007s
I20260709 13:03:51.623155 10398 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.623865 10445 tablet_bootstrap.cc:654] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.614470 10444 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.624125 10446 raft_consensus.cc:359] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.624889 10446 raft_consensus.cc:385] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.625180 10446 raft_consensus.cc:740] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.625871 10446 consensus_queue.cc:260] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.627826 10446 ts_tablet_manager.cc:1434] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:51.630565 10446 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.630501 10398 raft_consensus.cc:2468] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:51.631673 10444 tablet_bootstrap.cc:654] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.631976 10140 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:51.632990 10498 raft_consensus.cc:2804] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.633482 10498 raft_consensus.cc:697] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:51.634442 10498 consensus_queue.cc:237] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.639205 10446 tablet_bootstrap.cc:654] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.643028 10397 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.647313 10323 raft_consensus.cc:2468] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:51.667754 10444 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.668511 10444 ts_tablet_manager.cc:1403] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.009s
I20260709 13:03:51.672066 10444 raft_consensus.cc:359] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.674481 10445 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.675138 10445 ts_tablet_manager.cc:1403] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.003s
I20260709 13:03:51.678002 10445 raft_consensus.cc:359] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.678687 10445 raft_consensus.cc:385] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.678956 10445 raft_consensus.cc:740] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.679559 10444 raft_consensus.cc:385] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.679874 10444 raft_consensus.cc:740] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.680809 10444 consensus_queue.cc:260] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.681844 10445 consensus_queue.cc:260] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.681555 10069 catalog_manager.cc:5697] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.684224 10444 ts_tablet_manager.cc:1434] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:51.692750 10446 tablet_bootstrap.cc:492] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.693778 10445 ts_tablet_manager.cc:1434] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:03:51.694350 10446 ts_tablet_manager.cc:1403] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.015s
I20260709 13:03:51.694437 10513 raft_consensus.cc:493] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.694809 10445 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.695173 10513 raft_consensus.cc:515] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.699501 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
W20260709 13:03:51.701329 10362 leader_election.cc:343] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.702064 10504 raft_consensus.cc:493] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.702271 10513 leader_election.cc:290] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:51.702625 10504 raft_consensus.cc:515] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.706208 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:51.707098 10322 raft_consensus.cc:2468] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:51.708598 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:51.709026 10212 leader_election.cc:304] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:51.709570 10323 raft_consensus.cc:2468] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:51.710464 10502 raft_consensus.cc:2804] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.710894 10502 raft_consensus.cc:493] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.711262 10502 raft_consensus.cc:3060] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.711194 10361 leader_election.cc:304] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: caa864648e614090be53d8ece3cd29b7
I20260709 13:03:51.712888 10513 raft_consensus.cc:2804] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.713290 10513 raft_consensus.cc:493] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.713640 10513 raft_consensus.cc:3060] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.706257 10446 raft_consensus.cc:359] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.717118 10460 raft_consensus.cc:493] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.717491 10446 raft_consensus.cc:385] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.717937 10446 raft_consensus.cc:740] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.717738 10460 raft_consensus.cc:515] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.717877 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.718851 10446 consensus_queue.cc:260] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:03:51.719858 10215 leader_election.cc:343] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.720077 10460 leader_election.cc:290] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.718113 10504 leader_election.cc:290] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:51.721371 10446 ts_tablet_manager.cc:1434] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:03:51.722519 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:51.722831 10446 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.723352 10323 raft_consensus.cc:2468] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:51.721624 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.724634 10212 leader_election.cc:304] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
W20260709 13:03:51.725729 10215 leader_election.cc:343] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.717154 10443 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.726645 10504 raft_consensus.cc:2804] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.729051 10504 raft_consensus.cc:493] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.729557 10504 raft_consensus.cc:3060] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.729686 10502 raft_consensus.cc:515] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.730660 10446 tablet_bootstrap.cc:654] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.732486 10502 leader_election.cc:290] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:51.735347 10443 ts_tablet_manager.cc:1403] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.032s
I20260709 13:03:51.735517 10445 tablet_bootstrap.cc:654] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.736696 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:51.727872 10513 raft_consensus.cc:515] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.702034 10444 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.740711 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:51.741379 10249 raft_consensus.cc:3060] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:51.743614 10215 leader_election.cc:343] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.744616 10444 tablet_bootstrap.cc:654] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.734973 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:51.745376 10507 raft_consensus.cc:493] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.745545 10323 raft_consensus.cc:3060] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.745915 10507 raft_consensus.cc:515] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.749958 10443 raft_consensus.cc:359] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.750653 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d927f3c7f024383ae5d8d4e018327fa" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.748157 10507 leader_election.cc:290] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.754464 10504 raft_consensus.cc:515] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.758822 10248 raft_consensus.cc:2468] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:51.760486 10287 leader_election.cc:304] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:51.761466 10459 raft_consensus.cc:2804] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.761871 10459 raft_consensus.cc:493] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.762200 10459 raft_consensus.cc:3060] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.762955 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:51.752502 10249 raft_consensus.cc:2468] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:51.752468 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d927f3c7f024383ae5d8d4e018327fa" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.757148 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf74617ea14c089e379068bd362ac8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:51.763619 10321 raft_consensus.cc:3060] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.764024 10322 raft_consensus.cc:3060] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.766237 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
W20260709 13:03:51.767774 10215 leader_election.cc:343] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.769382 10459 raft_consensus.cc:515] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.772830 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d927f3c7f024383ae5d8d4e018327fa" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:51.774201 10248 raft_consensus.cc:3060] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.774627 10362 leader_election.cc:304] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:51.770972 10498 raft_consensus.cc:493] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.775727 10452 raft_consensus.cc:2804] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.776423 10498 raft_consensus.cc:515] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.779011 10322 raft_consensus.cc:2468] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:51.779630 10498 leader_election.cc:290] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:51.776686 10397 raft_consensus.cc:2468] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:51.780419 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:03:51.781900 10140 leader_election.cc:343] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.774899 10321 raft_consensus.cc:2468] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:51.781869 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.783492 10212 leader_election.cc:304] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:51.784540 10502 raft_consensus.cc:2804] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:51.784968 10138 leader_election.cc:343] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.785076 10502 raft_consensus.cc:697] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:51.785492 10138 leader_election.cc:304] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:51.786144 10502 consensus_queue.cc:237] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.788897 10248 raft_consensus.cc:2468] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:51.754472 10323 raft_consensus.cc:2468] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:51.786679 10498 raft_consensus.cc:2749] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.758152 10443 raft_consensus.cc:385] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.790863 10443 raft_consensus.cc:740] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.757695 10513 leader_election.cc:290] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:51.791450 10212 leader_election.cc:304] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:51.760643 10504 leader_election.cc:290] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.792626 10460 raft_consensus.cc:2804] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.793076 10460 raft_consensus.cc:697] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:51.791541 10443 consensus_queue.cc:260] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.795928 10443 ts_tablet_manager.cc:1434] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.000s
I20260709 13:03:51.797065 10443 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.796659 10460 consensus_queue.cc:237] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.790378 10287 leader_election.cc:304] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:51.800701 10507 raft_consensus.cc:2804] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.809401 10069 catalog_manager.cc:5697] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.816586 10443 tablet_bootstrap.cc:654] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.818637 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d927f3c7f024383ae5d8d4e018327fa" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:51.819370 10397 raft_consensus.cc:3060] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.821368 10444 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.821741 10446 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:51.821858 10444 ts_tablet_manager.cc:1403] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.000s
I20260709 13:03:51.822258 10446 ts_tablet_manager.cc:1403] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.100s	user 0.046s	sys 0.021s
I20260709 13:03:51.819384 10498 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.823861 10498 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.826093 10498 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.827203 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:51.827541 10446 raft_consensus.cc:359] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.827849 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.828291 10446 raft_consensus.cc:385] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.828653 10446 raft_consensus.cc:740] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.828878 10398 raft_consensus.cc:2393] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:51.829413 10446 consensus_queue.cc:260] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.830318 10138 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:51.833843 10446 ts_tablet_manager.cc:1434] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:51.834892 10446 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:51.832476 10498 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.830408 10459 leader_election.cc:290] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:51.830729 10452 raft_consensus.cc:697] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:51.835418 10069 catalog_manager.cc:5697] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.839015 10452 consensus_queue.cc:237] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.850126 10498 raft_consensus.cc:2749] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.852938 10397 raft_consensus.cc:2468] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:51.855423 10444 raft_consensus.cc:359] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.856056 10444 raft_consensus.cc:385] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.856345 10444 raft_consensus.cc:740] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.838129 10507 raft_consensus.cc:697] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:51.861210 10443 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:51.861761 10443 ts_tablet_manager.cc:1403] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.006s
I20260709 13:03:51.863220 10446 tablet_bootstrap.cc:654] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.865051 10443 raft_consensus.cc:359] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.865890 10443 raft_consensus.cc:385] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.865569 10507 consensus_queue.cc:237] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.866218 10443 raft_consensus.cc:740] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.867188 10443 consensus_queue.cc:260] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.868114 10445 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.868634 10445 ts_tablet_manager.cc:1403] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.032s
I20260709 13:03:51.869498 10443 ts_tablet_manager.cc:1434] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:51.870645 10443 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:51.870254 10068 catalog_manager.cc:5697] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.871435 10445 raft_consensus.cc:359] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.872112 10445 raft_consensus.cc:385] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.872409 10445 raft_consensus.cc:740] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.873040 10445 consensus_queue.cc:260] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.875320 10445 ts_tablet_manager.cc:1434] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:03:51.865051 10444 consensus_queue.cc:260] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.876299 10445 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.877416 10443 tablet_bootstrap.cc:654] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.877643 10444 ts_tablet_manager.cc:1434] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:03:51.878993 10444 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.882995 10445 tablet_bootstrap.cc:654] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.889250 10444 tablet_bootstrap.cc:654] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.889219 10504 consensus_queue.cc:1048] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.917794 10444 tablet_bootstrap.cc:492] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:51.917794 10445 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:51.918452 10444 ts_tablet_manager.cc:1403] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.012s
I20260709 13:03:51.918524 10445 ts_tablet_manager.cc:1403] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 13:03:51.920012 10174 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.922294 10445 raft_consensus.cc:359] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.923974 10445 raft_consensus.cc:385] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.924335 10445 raft_consensus.cc:740] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.925160 10504 raft_consensus.cc:493] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.925271 10445 consensus_queue.cc:260] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.925805 10504 raft_consensus.cc:515] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.926687 10070 catalog_manager.cc:5697] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.927914 10445 ts_tablet_manager.cc:1434] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:51.928849 10445 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:51.930428 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:51.931141 10397 raft_consensus.cc:2468] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:51.931298 10323 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.932341 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:51.933008 10172 raft_consensus.cc:2468] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:51.934578 10215 leader_election.cc:304] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:51.935433 10460 raft_consensus.cc:2804] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.935856 10445 tablet_bootstrap.cc:654] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.935796 10460 raft_consensus.cc:493] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.936283 10460 raft_consensus.cc:3060] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.928206 10504 leader_election.cc:290] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:51.941560 10539 consensus_queue.cc:1048] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.950042 10444 raft_consensus.cc:359] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.950824 10444 raft_consensus.cc:385] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.951088 10444 raft_consensus.cc:740] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.955489 10460 raft_consensus.cc:515] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:51.958284 10507 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.960669 10507 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:51.960891 10452 consensus_queue.cc:1048] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.963200 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:51.959635 10444 consensus_queue.cc:260] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:51.963886 10397 raft_consensus.cc:3060] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.965381 10444 ts_tablet_manager.cc:1434] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:03:51.970664 10444 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:51.971427 10459 consensus_queue.cc:1048] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.973595 10459 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.974184 10459 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:51.992249 10444 tablet_bootstrap.cc:654] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.999519 10459 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.002482 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.002753 10397 raft_consensus.cc:2468] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:52.003208 10249 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:52.004427 10460 leader_election.cc:290] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.005422 10443 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.005975 10452 consensus_queue.cc:1048] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.006421 10215 leader_election.cc:304] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.007140 10507 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.007560 10498 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.008136 10498 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.009009 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.009716 10170 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:52.010357 10498 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.011902 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff063a758e5e46bb8e8277d3b6d4ee07" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.012611 10171 raft_consensus.cc:3060] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.014400 10446 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.015013 10446 ts_tablet_manager.cc:1403] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.180s	user 0.040s	sys 0.024s
I20260709 13:03:52.015460 10287 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.018000 10446 raft_consensus.cc:359] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.018743 10446 raft_consensus.cc:385] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.019032 10446 raft_consensus.cc:740] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.020004 10289 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:52.019750 10446 consensus_queue.cc:260] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.020680 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.020889 10504 raft_consensus.cc:2804] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.021371 10322 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.022009 10446 ts_tablet_manager.cc:1434] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:52.022114 10459 raft_consensus.cc:2804] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.022545 10459 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.022863 10459 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.005919 10443 ts_tablet_manager.cc:1403] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.033s
I20260709 13:03:52.007863 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.023777 10174 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:52.023079 10446 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.022753 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.026119 10249 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.027606 10138 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.028656 10498 raft_consensus.cc:2804] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.029186 10498 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.029587 10498 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.031486 10446 tablet_bootstrap.cc:654] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.021437 10504 raft_consensus.cc:697] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:52.036756 10504 consensus_queue.cc:237] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.039067 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.050374 10498 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.056663 10445 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.066408 10445 ts_tablet_manager.cc:1403] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.020s
I20260709 13:03:52.067356 10444 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.067847 10444 ts_tablet_manager.cc:1403] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.008s
I20260709 13:03:52.069342 10445 raft_consensus.cc:359] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.070171 10445 raft_consensus.cc:385] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.070477 10445 raft_consensus.cc:740] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.070699 10444 raft_consensus.cc:359] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.071496 10444 raft_consensus.cc:385] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.071902 10444 raft_consensus.cc:740] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.071460 10445 consensus_queue.cc:260] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.025970 10443 raft_consensus.cc:359] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.072644 10444 consensus_queue.cc:260] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.072949 10443 raft_consensus.cc:385] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.074275 10443 raft_consensus.cc:740] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.075151 10443 consensus_queue.cc:260] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.075908 10445 ts_tablet_manager.cc:1434] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:52.077940 10443 ts_tablet_manager.cc:1434] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 13:03:52.079401 10445 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.086233 10498 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.086973 10498 consensus_queue.cc:1048] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.087108 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.087613 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.092481 10248 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.108038 10444 ts_tablet_manager.cc:1434] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 13:03:52.125435 10444 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:52.125747 10502 raft_consensus.cc:493] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.126242 10502 raft_consensus.cc:515] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.128739 10502 leader_election.cc:290] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.130465 10248 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:52.131649 10444 tablet_bootstrap.cc:654] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.131556 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.131976 10138 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.132920 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.114603 10507 raft_consensus.cc:493] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.116058 10460 consensus_queue.cc:1048] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:03:52.124238 10566 consensus_queue.cc:1048] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:03:52.101837 10539 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:52.133073 10567 raft_consensus.cc:2804] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.136941 10567 raft_consensus.cc:697] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:52.137784 10539 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4b5b492fca940a3883a22eec56a4f9f)
I20260709 13:03:52.138283 10539 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.137928 10567 consensus_queue.cc:237] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
W20260709 13:03:52.140432 10215 leader_election.cc:343] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.133821 10507 raft_consensus.cc:515] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.141968 10562 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.142439 10321 raft_consensus.cc:2468] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:52.142472 10562 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.144744 10507 leader_election.cc:290] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.146581 10212 leader_election.cc:304] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:52.146518 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.148568 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.147872 10460 raft_consensus.cc:2804] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.150275 10460 raft_consensus.cc:493] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.150364 10289 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:52.147143 10562 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.150733 10460 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.152815 10562 raft_consensus.cc:2749] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.153682 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.120271 10443 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:03:52.155200 10289 leader_election.cc:343] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.091857 10459 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.160130 10323 raft_consensus.cc:2393] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:52.163265 10459 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.165838 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.168805 10068 catalog_manager.cc:5697] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.173444 10397 raft_consensus.cc:3060] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.117636 10171 raft_consensus.cc:2468] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:52.147940 10539 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.184024 10557 consensus_queue.cc:1048] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.186121 10539 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.091444 10445 tablet_bootstrap.cc:654] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.187803 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:52.191890 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.193390 10443 tablet_bootstrap.cc:654] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.198191 10289 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:52.199502 10564 raft_consensus.cc:2749] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:52.204120 10446 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
W20260709 13:03:52.186985 10287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 130329us
I20260709 13:03:52.204717 10446 ts_tablet_manager.cc:1403] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.182s	user 0.050s	sys 0.080s
I20260709 13:03:52.206634 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.207530 10249 raft_consensus.cc:2393] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:52.199704 10460 raft_consensus.cc:515] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.207638 10446 raft_consensus.cc:359] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.208964 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.209403 10446 raft_consensus.cc:385] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.209704 10446 raft_consensus.cc:740] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.210528 10446 consensus_queue.cc:260] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.212800 10446 ts_tablet_manager.cc:1434] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:52.213014 10287 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:52.213935 10446 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.217814 10504 consensus_queue.cc:1048] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.218736 10460 leader_election.cc:290] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.220742 10248 raft_consensus.cc:2393] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:52.221042 10446 tablet_bootstrap.cc:654] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.221143 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.221490 10539 raft_consensus.cc:2749] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.221231 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.222538 10321 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:52.222671 10215 leader_election.cc:343] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.237994 10446 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.239753 10452 raft_consensus.cc:493] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.257561 10446 ts_tablet_manager.cc:1403] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.023s
I20260709 13:03:52.258260 10452 raft_consensus.cc:515] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.229246 10287 leader_election.cc:304] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:52.261066 10446 raft_consensus.cc:359] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.261612 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.261896 10446 raft_consensus.cc:385] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.262331 10446 raft_consensus.cc:740] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.262429 10171 raft_consensus.cc:2468] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.263211 10446 consensus_queue.cc:260] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.263863 10364 leader_election.cc:304] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.254403 10453 consensus_queue.cc:1048] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:52.264978 10446 ts_tablet_manager.cc:1434] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:52.266108 10446 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.266544 10321 raft_consensus.cc:2468] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:52.238571 10537 raft_consensus.cc:493] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.267596 10537 raft_consensus.cc:515] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.270107 10537 leader_election.cc:290] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.270630 10537 raft_consensus.cc:2804] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.270958 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dad9027a254289ad29f258e8fbf67b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.271699 10248 raft_consensus.cc:2468] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.249019 10068 catalog_manager.cc:5697] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.237994 10443 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.272213 10446 tablet_bootstrap.cc:654] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.272729 10443 ts_tablet_manager.cc:1403] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.002s
I20260709 13:03:52.273130 10362 leader_election.cc:304] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.276546 10443 raft_consensus.cc:359] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.277382 10443 raft_consensus.cc:385] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.249322 10444 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.278409 10444 ts_tablet_manager.cc:1403] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.153s	user 0.005s	sys 0.024s
I20260709 13:03:52.233947 10445 tablet_bootstrap.cc:492] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.279245 10445 ts_tablet_manager.cc:1403] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.005s
I20260709 13:03:52.277671 10443 raft_consensus.cc:740] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.270979 10537 raft_consensus.cc:493] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.284133 10537 raft_consensus.cc:3060] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.286283 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.286988 10248 raft_consensus.cc:2468] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.288359 10212 leader_election.cc:304] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:52.289623 10460 raft_consensus.cc:2804] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.290115 10460 raft_consensus.cc:697] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:52.291347 10460 consensus_queue.cc:237] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.292284 10537 raft_consensus.cc:515] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.292831 10323 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.294175 10445 raft_consensus.cc:359] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.295039 10445 raft_consensus.cc:385] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.295331 10445 raft_consensus.cc:740] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.296620 10513 raft_consensus.cc:493] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader caa864648e614090be53d8ece3cd29b7)
I20260709 13:03:52.297313 10513 raft_consensus.cc:515] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.301599 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.304396 10446 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.304970 10446 ts_tablet_manager.cc:1403] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.004s
I20260709 13:03:52.307044 10445 consensus_queue.cc:260] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.283569 10443 consensus_queue.cc:260] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.308801 10446 raft_consensus.cc:359] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.309682 10446 raft_consensus.cc:385] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.309978 10446 raft_consensus.cc:740] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.310853 10443 ts_tablet_manager.cc:1434] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:03:52.301720 10513 leader_election.cc:290] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.281812 10539 raft_consensus.cc:2749] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.313779 10443 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.313063 10446 consensus_queue.cc:260] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.283109 10452 leader_election.cc:290] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.317323 10452 raft_consensus.cc:2804] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.317780 10452 raft_consensus.cc:493] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.318145 10452 raft_consensus.cc:3060] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.319778 10567 raft_consensus.cc:493] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.320366 10567 raft_consensus.cc:515] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.326603 10445 ts_tablet_manager.cc:1434] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:03:52.328367 10445 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.329957 10567 leader_election.cc:290] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.330641 10171 raft_consensus.cc:3060] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.330816 10443 tablet_bootstrap.cc:654] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.333377 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.333711 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b86688c0044287ad4812aa1134a0c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.338132 10539 consensus_queue.cc:1048] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.340898 10138 leader_election.cc:304] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:52.353664 10444 raft_consensus.cc:359] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.354216 10444 raft_consensus.cc:385] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.354419 10444 raft_consensus.cc:740] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.357622 10444 consensus_queue.cc:260] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.359161 10446 ts_tablet_manager.cc:1434] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.005s
I20260709 13:03:52.360004 10446 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.365371 10445 tablet_bootstrap.cc:654] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.351819 10513 consensus_queue.cc:1048] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:03:52.366691 10444 ts_tablet_manager.cc:1434] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.002s
I20260709 13:03:52.368083 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dad9027a254289ad29f258e8fbf67b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.369714 10567 raft_consensus.cc:2749] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.369808 10322 raft_consensus.cc:2468] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.373984 10537 leader_election.cc:290] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.373929 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.374758 10170 raft_consensus.cc:3060] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.376959 10566 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.377537 10566 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.379108 10452 raft_consensus.cc:515] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.381263 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60901c3e414849a18fdd33dbe5c1f878" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.381966 10248 raft_consensus.cc:3060] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.384152 10446 tablet_bootstrap.cc:654] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.385442 10539 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.386082 10539 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.385468 10452 leader_election.cc:290] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.396533 10443 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.397243 10443 ts_tablet_manager.cc:1403] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.003s
I20260709 13:03:52.399089 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.399901 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dad9027a254289ad29f258e8fbf67b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.400616 10249 raft_consensus.cc:3060] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.404059 10557 consensus_queue.cc:1048] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.404502 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.403923 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.406559 10319 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.406672 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e11d29a68964be6ba9535eba55c272e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.399896 10397 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.408054 10566 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:52.408197 10137 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:52.408635 10539 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.409099 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dad9027a254289ad29f258e8fbf67b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.409701 10322 raft_consensus.cc:3060] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.414580 10567 raft_consensus.cc:2804] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.414976 10567 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.415285 10567 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.412107 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.424829 10445 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.425415 10445 ts_tablet_manager.cc:1403] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.007s
I20260709 13:03:52.426533 10444 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:52.428627 10249 raft_consensus.cc:2468] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.429920 10361 leader_election.cc:304] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:52.429857 10576 consensus_queue.cc:1048] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.430930 10452 raft_consensus.cc:2749] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:52.432852 10362 leader_election.cc:304] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.433048 10445 raft_consensus.cc:359] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.433852 10452 raft_consensus.cc:2804] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.434057 10445 raft_consensus.cc:385] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.434485 10445 raft_consensus.cc:740] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.434525 10452 raft_consensus.cc:697] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:52.435364 10445 consensus_queue.cc:260] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.435909 10452 consensus_queue.cc:237] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.438086 10445 ts_tablet_manager.cc:1434] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:52.439525 10445 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.443552 10170 raft_consensus.cc:2468] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.443904 10564 consensus_queue.cc:1048] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.447499 10445 tablet_bootstrap.cc:654] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.450553 10443 raft_consensus.cc:359] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.451347 10443 raft_consensus.cc:385] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.451618 10443 raft_consensus.cc:740] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.457784 10443 consensus_queue.cc:260] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.455946 10248 raft_consensus.cc:2468] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.465248 10443 ts_tablet_manager.cc:1434] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:03:52.467571 10443 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.468809 10362 leader_election.cc:304] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.470064 10576 raft_consensus.cc:2804] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.472234 10576 raft_consensus.cc:697] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:52.474795 10576 consensus_queue.cc:237] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.479086 10453 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.486505 10443 tablet_bootstrap.cc:654] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.494836 10446 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.495405 10446 ts_tablet_manager.cc:1403] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.012s
I20260709 13:03:52.484380 10453 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.498595 10453 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.499944 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:52.502087 10215 leader_election.cc:343] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.490646 10322 raft_consensus.cc:2468] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.502060 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:03:52.520720 10215 leader_election.cc:343] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.521212 10215 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:52.522506 10460 raft_consensus.cc:2749] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.499651 10069 catalog_manager.cc:5697] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.525137 10446 raft_consensus.cc:359] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.526315 10446 raft_consensus.cc:385] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.526619 10446 raft_consensus.cc:740] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.530987 10322 raft_consensus.cc:1240] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Rejecting Update request from peer c4b5b492fca940a3883a22eec56a4f9f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:52.532642 10452 consensus_queue.cc:1059] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:52.534109 10452 raft_consensus.cc:3055] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.534474 10452 raft_consensus.cc:740] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:52.535964 10452 consensus_queue.cc:260] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.524245 10567 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.541178 10171 raft_consensus.cc:2393] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:52.541793 10444 tablet_bootstrap.cc:654] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.544888 10289 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:52.546201 10539 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.548478 10564 raft_consensus.cc:493] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.546389 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:52.548995 10564 raft_consensus.cc:515] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.549611 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.551412 10564 leader_election.cc:290] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:52.552351 10567 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:52.548889 10445 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.553227 10445 ts_tablet_manager.cc:1403] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.012s
I20260709 13:03:52.553210 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a65ec678174d949e2450a98c0f072b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.555068 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a65ec678174d949e2450a98c0f072b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.552589 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:52.556895 10445 raft_consensus.cc:359] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.557447 10445 raft_consensus.cc:385] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.557647 10445 raft_consensus.cc:740] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.555867 10397 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.560818 10567 consensus_queue.cc:1048] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.561268 10443 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.561834 10443 ts_tablet_manager.cc:1403] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.002s
W20260709 13:03:52.555231 10289 leader_election.cc:343] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.564409 10443 raft_consensus.cc:359] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.565095 10443 raft_consensus.cc:385] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.565423 10443 raft_consensus.cc:740] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.566689 10446 consensus_queue.cc:260] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.568655 10443 consensus_queue.cc:260] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.568843 10445 consensus_queue.cc:260] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.555210 10452 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.571216 10443 ts_tablet_manager.cc:1434] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:03:52.574182 10246 raft_consensus.cc:2468] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:52.576969 10443 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.578948 10397 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:52.580228 10140 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.580369 10287 leader_election.cc:304] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:52.581135 10567 raft_consensus.cc:2804] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.581638 10567 raft_consensus.cc:697] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:52.582046 10564 raft_consensus.cc:2804] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.582464 10564 raft_consensus.cc:493] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.582830 10564 raft_consensus.cc:3060] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.583436 10443 tablet_bootstrap.cc:654] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.584376 10539 raft_consensus.cc:2749] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.582468 10567 consensus_queue.cc:237] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.586036 10445 ts_tablet_manager.cc:1434] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.002s
I20260709 13:03:52.587090 10445 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.582013 10446 ts_tablet_manager.cc:1434] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.086s	user 0.002s	sys 0.005s
I20260709 13:03:52.589402 10446 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.607389 10444 tablet_bootstrap.cc:492] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.607955 10444 ts_tablet_manager.cc:1403] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.010s
I20260709 13:03:52.609160 10446 tablet_bootstrap.cc:654] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.610659 10444 raft_consensus.cc:359] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.611424 10444 raft_consensus.cc:385] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.611702 10444 raft_consensus.cc:740] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.615401 10444 consensus_queue.cc:260] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.617125 10321 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:52.618003 10444 ts_tablet_manager.cc:1434] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:03:52.619215 10444 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:52.618999 10564 raft_consensus.cc:515] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.621376 10445 tablet_bootstrap.cc:654] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.624198 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a65ec678174d949e2450a98c0f072b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:52.624938 10397 raft_consensus.cc:3060] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.624198 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a65ec678174d949e2450a98c0f072b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.630132 10248 raft_consensus.cc:3060] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.631362 10451 consensus_queue.cc:1048] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.635679 10564 leader_election.cc:290] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:52.651125 10453 consensus_queue.cc:1048] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.652812 10248 raft_consensus.cc:2468] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:52.654361 10443 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.655915 10397 raft_consensus.cc:2468] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:52.657356 10444 tablet_bootstrap.cc:654] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.657501 10289 leader_election.cc:304] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.658731 10443 ts_tablet_manager.cc:1403] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.013s
I20260709 13:03:52.658870 10539 raft_consensus.cc:2804] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.661216 10539 raft_consensus.cc:697] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:52.662074 10443 raft_consensus.cc:359] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.663017 10443 raft_consensus.cc:385] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.662091 10539 consensus_queue.cc:237] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:52.663309 10443 raft_consensus.cc:740] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.665227 10443 consensus_queue.cc:260] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.666134 10452 raft_consensus.cc:493] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.666706 10452 raft_consensus.cc:515] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.667716 10443 ts_tablet_manager.cc:1434] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:52.668892 10443 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.665078 10068 catalog_manager.cc:5697] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.674304 10446 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.675104 10446 ts_tablet_manager.cc:1403] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.001s
I20260709 13:03:52.680625 10453 consensus_queue.cc:1048] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.680908 10070 catalog_manager.cc:5697] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.682934 10070 catalog_manager.cc:5697] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.686733 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7608db3fe6943948ba234b016c7f8b8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:52.687553 10171 raft_consensus.cc:2468] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.688726 10452 leader_election.cc:290] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.689579 10364 leader_election.cc:304] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.689826 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7608db3fe6943948ba234b016c7f8b8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.690725 10322 raft_consensus.cc:2468] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:52.692688 10452 raft_consensus.cc:2804] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.697955 10452 raft_consensus.cc:493] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.698882 10445 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.699369 10445 ts_tablet_manager.cc:1403] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.009s
I20260709 13:03:52.700439 10452 raft_consensus.cc:3060] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.701344 10446 raft_consensus.cc:359] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.703584 10446 raft_consensus.cc:385] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.703903 10446 raft_consensus.cc:740] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.715436 10446 consensus_queue.cc:260] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.718101 10445 raft_consensus.cc:359] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.722667 10445 raft_consensus.cc:385] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.723070 10445 raft_consensus.cc:740] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.727099 10445 consensus_queue.cc:260] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.729570 10443 tablet_bootstrap.cc:654] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.730224 10445 ts_tablet_manager.cc:1434] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.005s
I20260709 13:03:52.731406 10445 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.721889 10446 ts_tablet_manager.cc:1434] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:03:52.733820 10446 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.745141 10452 raft_consensus.cc:515] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.751242 10446 tablet_bootstrap.cc:654] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.759291 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7608db3fe6943948ba234b016c7f8b8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.758703 10071 catalog_manager.cc:5697] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.759935 10322 raft_consensus.cc:3060] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.761971 10171 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.767607 10322 raft_consensus.cc:2468] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.769286 10452 leader_election.cc:290] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:52.769956 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7608db3fe6943948ba234b016c7f8b8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:52.770576 10172 raft_consensus.cc:3060] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.770753 10361 leader_election.cc:304] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.771727 10452 raft_consensus.cc:2804] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.772442 10452 raft_consensus.cc:697] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:52.773343 10452 consensus_queue.cc:237] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.778602 10443 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.779238 10443 ts_tablet_manager.cc:1403] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.007s
I20260709 13:03:52.781999 10443 raft_consensus.cc:359] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.782642 10443 raft_consensus.cc:385] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.782910 10443 raft_consensus.cc:740] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.783589 10443 consensus_queue.cc:260] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.786305 10445 tablet_bootstrap.cc:654] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.787045 10172 raft_consensus.cc:2468] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:52.787647 10443 ts_tablet_manager.cc:1434] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:52.788807 10443 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.791232 10504 consensus_queue.cc:1048] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.793488 10444 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.794035 10444 ts_tablet_manager.cc:1403] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.175s	user 0.023s	sys 0.028s
I20260709 13:03:52.803673 10444 raft_consensus.cc:359] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.812785 10444 raft_consensus.cc:385] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.813257 10444 raft_consensus.cc:740] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.814770 10071 catalog_manager.cc:5697] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.815536 10444 consensus_queue.cc:260] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.816938 10446 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.817502 10446 ts_tablet_manager.cc:1403] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.017s
I20260709 13:03:52.818496 10444 ts_tablet_manager.cc:1434] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.007s
I20260709 13:03:52.819656 10444 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:52.826315 10443 tablet_bootstrap.cc:654] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.826802 10444 tablet_bootstrap.cc:654] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.830569 10446 raft_consensus.cc:359] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.831509 10446 raft_consensus.cc:385] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.831780 10446 raft_consensus.cc:740] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.832002 10445 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.832535 10445 ts_tablet_manager.cc:1403] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.018s
I20260709 13:03:52.832489 10446 consensus_queue.cc:260] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.838259 10446 ts_tablet_manager.cc:1434] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:03:52.840282 10446 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:52.835618 10445 raft_consensus.cc:359] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.842864 10445 raft_consensus.cc:385] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.843222 10445 raft_consensus.cc:740] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.844120 10445 consensus_queue.cc:260] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.852087 10452 consensus_queue.cc:1048] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.854501 10557 consensus_queue.cc:1048] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.856770 10444 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.857065 10498 raft_consensus.cc:493] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.857376 10444 ts_tablet_manager.cc:1403] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:03:52.857545 10498 raft_consensus.cc:515] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.859876 10498 leader_election.cc:290] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.860426 10444 raft_consensus.cc:359] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.854487 10445 ts_tablet_manager.cc:1434] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:52.861560 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.862129 10445 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:52.861107 10444 raft_consensus.cc:385] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.862176 10248 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.862675 10444 raft_consensus.cc:740] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.863962 10138 leader_election.cc:304] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.864711 10444 consensus_queue.cc:260] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.867094 10443 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:52.861135 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:52.867743 10443 ts_tablet_manager.cc:1403] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.006s
I20260709 13:03:52.867969 10323 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.872225 10445 tablet_bootstrap.cc:654] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.874218 10446 tablet_bootstrap.cc:654] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.876253 10498 raft_consensus.cc:2804] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.877072 10498 raft_consensus.cc:493] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.877822 10498 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.882869 10513 consensus_queue.cc:1048] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.883976 10444 ts_tablet_manager.cc:1434] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:03:52.887539 10444 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:52.896044 10444 tablet_bootstrap.cc:654] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.898528 10443 raft_consensus.cc:359] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.908919 10443 raft_consensus.cc:385] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.909336 10443 raft_consensus.cc:740] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.917753 10443 consensus_queue.cc:260] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.898316 10498 raft_consensus.cc:515] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.930244 10567 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.931178 10443 ts_tablet_manager.cc:1434] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.063s	user 0.000s	sys 0.007s
I20260709 13:03:52.930943 10567 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.932230 10443 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:52.932813 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:52.933583 10246 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.922977 10513 consensus_queue.cc:1048] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:52.938541 10443 tablet_bootstrap.cc:654] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.946658 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:52.947456 10321 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.948107 10567 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.949280 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:52.949734 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.949957 10247 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.944588 10498 leader_election.cc:290] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:52.950403 10397 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.951772 10140 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.953049 10498 raft_consensus.cc:2804] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.953454 10498 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.953809 10498 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.963059 10246 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:52.964673 10138 leader_election.cc:304] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:52.967715 10567 raft_consensus.cc:2804] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.968235 10567 raft_consensus.cc:697] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:52.969084 10567 consensus_queue.cc:237] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:52.974046 10566 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.978106 10446 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:52.978685 10446 ts_tablet_manager.cc:1403] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.139s	user 0.027s	sys 0.002s
I20260709 13:03:52.974750 10566 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.979673 10444 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:52.980971 10444 ts_tablet_manager.cc:1403] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.094s	user 0.035s	sys 0.026s
I20260709 13:03:52.982038 10566 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.982798 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:52.984757 10321 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:52.984702 10397 raft_consensus.cc:2468] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:52.987329 10140 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:52.986377 10498 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:52.989596 10445 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:52.988112 10566 raft_consensus.cc:2804] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.990085 10566 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.990453 10566 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.991873 10445 ts_tablet_manager.cc:1403] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.011s
I20260709 13:03:52.991106 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:52.994572 10444 raft_consensus.cc:359] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:52.995083 10444 raft_consensus.cc:385] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.994131 10397 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.002614 10498 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:52.995280 10444 raft_consensus.cc:740] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.003746 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:53.003948 10445 raft_consensus.cc:359] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.004521 10248 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.005091 10445 raft_consensus.cc:385] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.003957 10444 consensus_queue.cc:260] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.005431 10445 raft_consensus.cc:740] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.005199 10397 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:53.006168 10445 consensus_queue.cc:260] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.007169 10444 ts_tablet_manager.cc:1434] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:03:53.009155 10445 ts_tablet_manager.cc:1434] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:03:53.008490 10070 catalog_manager.cc:5697] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.010128 10445 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.012069 10444 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:53.014238 10140 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:53.015295 10498 raft_consensus.cc:2804] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.016150 10498 raft_consensus.cc:697] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:53.017212 10498 consensus_queue.cc:237] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.016080 10445 tablet_bootstrap.cc:654] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.011969 10248 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:53.019762 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:53.021456 10453 raft_consensus.cc:493] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.021924 10138 leader_election.cc:343] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.021941 10453 raft_consensus.cc:515] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.024339 10453 leader_election.cc:290] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:53.025032 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:53.026288 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:53.026499 10215 leader_election.cc:343] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.026975 10321 raft_consensus.cc:2468] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:53.028844 10212 leader_election.cc:304] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:53.031342 10504 raft_consensus.cc:2804] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.031790 10504 raft_consensus.cc:493] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.032120 10504 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.032413 10566 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.040000 10443 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.040239 10444 tablet_bootstrap.cc:654] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.040601 10443 ts_tablet_manager.cc:1403] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.014s
I20260709 13:03:53.043787 10446 raft_consensus.cc:359] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.044412 10446 raft_consensus.cc:385] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.044691 10446 raft_consensus.cc:740] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.045382 10446 consensus_queue.cc:260] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.046047 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.046700 10397 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.047966 10446 ts_tablet_manager.cc:1434] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:03:53.049022 10446 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.055819 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
W20260709 13:03:53.057596 10138 leader_election.cc:343] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.066960 10443 raft_consensus.cc:359] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.067930 10443 raft_consensus.cc:385] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.073907 10443 raft_consensus.cc:740] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.075059 10443 consensus_queue.cc:260] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.075479 10504 raft_consensus.cc:515] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.078191 10504 leader_election.cc:290] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:53.073537 10446 tablet_bootstrap.cc:654] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.079689 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.064060 10566 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:53.080497 10321 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.082185 10578 consensus_queue.cc:1048] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:53.081990 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:53.092578 10072 catalog_manager.cc:5697] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.093807 10172 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.079689 10443 ts_tablet_manager.cc:1434] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.005s
I20260709 13:03:53.097844 10443 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:53.106891 10321 raft_consensus.cc:2468] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.108296 10212 leader_election.cc:304] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:53.108922 10498 consensus_queue.cc:1048] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.110283 10453 raft_consensus.cc:2804] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.110944 10453 raft_consensus.cc:697] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:53.111872 10453 consensus_queue.cc:237] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.116640 10498 consensus_queue.cc:1048] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.122905 10172 raft_consensus.cc:2468] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.080288 10397 raft_consensus.cc:2468] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:53.126547 10445 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:53.135118 10446 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.145799 10446 ts_tablet_manager.cc:1403] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.034s
I20260709 13:03:53.145763 10445 ts_tablet_manager.cc:1403] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.002s
I20260709 13:03:53.153015 10443 tablet_bootstrap.cc:654] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.158046 10446 raft_consensus.cc:359] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.158686 10445 raft_consensus.cc:359] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.159341 10446 raft_consensus.cc:385] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.159945 10446 raft_consensus.cc:740] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.159492 10445 raft_consensus.cc:385] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.161818 10446 consensus_queue.cc:260] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.163236 10072 catalog_manager.cc:5697] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.164250 10445 raft_consensus.cc:740] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.166400 10445 consensus_queue.cc:260] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.168152 10445 ts_tablet_manager.cc:1434] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:03:53.165570 10140 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: caa864648e614090be53d8ece3cd29b7
I20260709 13:03:53.169328 10445 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.171656 10446 ts_tablet_manager.cc:1434] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:03:53.172760 10446 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.182520 10446 tablet_bootstrap.cc:654] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.194271 10537 raft_consensus.cc:493] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.194604 10444 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.195117 10444 ts_tablet_manager.cc:1403] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.011s
I20260709 13:03:53.194916 10578 consensus_queue.cc:1048] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.198021 10453 raft_consensus.cc:493] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.197825 10537 raft_consensus.cc:515] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.211282 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.213783 10323 raft_consensus.cc:2468] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:53.215507 10361 leader_election.cc:304] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:53.215672 10559 consensus_queue.cc:1048] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.216184 10445 tablet_bootstrap.cc:654] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.220716 10578 raft_consensus.cc:2804] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.221187 10578 raft_consensus.cc:493] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.221556 10578 raft_consensus.cc:3060] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.210181 10537 leader_election.cc:290] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:53.236027 10578 raft_consensus.cc:515] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.239884 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.240996 10323 raft_consensus.cc:3060] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.263214 10444 raft_consensus.cc:359] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.181027 10566 raft_consensus.cc:2804] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.264168 10444 raft_consensus.cc:385] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.265165 10444 raft_consensus.cc:740] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.266151 10444 consensus_queue.cc:260] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.202455 10453 raft_consensus.cc:515] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.272096 10453 leader_election.cc:290] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:53.272625 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:53.275439 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:53.275625 10564 consensus_queue.cc:1048] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.287266 10443 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.287953 10443 ts_tablet_manager.cc:1403] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.190s	user 0.014s	sys 0.035s
I20260709 13:03:53.289058 10444 ts_tablet_manager.cc:1434] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 13:03:53.290475 10444 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
W20260709 13:03:53.293380 10215 leader_election.cc:343] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.287101 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.299666 10397 raft_consensus.cc:2468] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:53.299748 10323 raft_consensus.cc:2468] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:53.313437 10445 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
W20260709 13:03:53.308490 10364 leader_election.cc:343] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.317178 10537 consensus_queue.cc:1048] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.319969 10215 leader_election.cc:304] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:53.321203 10453 raft_consensus.cc:2804] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.321638 10453 raft_consensus.cc:493] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.321992 10453 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.330132 10539 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.331233 10539 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.340915 10444 tablet_bootstrap.cc:654] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.343508 10445 ts_tablet_manager.cc:1403] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.174s	user 0.026s	sys 0.013s
I20260709 13:03:53.348811 10361 leader_election.cc:304] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:53.349869 10537 raft_consensus.cc:2804] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.350368 10537 raft_consensus.cc:697] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:53.351190 10537 consensus_queue.cc:237] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.312727 10566 raft_consensus.cc:697] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:53.353286 10566 consensus_queue.cc:237] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.378036 10446 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.378675 10446 ts_tablet_manager.cc:1403] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.206s	user 0.053s	sys 0.059s
I20260709 13:03:53.382014 10445 raft_consensus.cc:359] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.382836 10445 raft_consensus.cc:385] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.383100 10445 raft_consensus.cc:740] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.383595 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:53.384771 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.383154 10539 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:03:53.385167 10364 leader_election.cc:343] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.383809 10445 consensus_queue.cc:260] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:03:53.386461 10289 leader_election.cc:343] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.399755 10445 ts_tablet_manager.cc:1434] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 13:03:53.401109 10445 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.407161 10446 raft_consensus.cc:359] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.407758 10446 raft_consensus.cc:385] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.408026 10446 raft_consensus.cc:740] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.404434 10443 raft_consensus.cc:359] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.413731 10443 raft_consensus.cc:385] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.414115 10443 raft_consensus.cc:740] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.415555 10446 consensus_queue.cc:260] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.423514 10445 tablet_bootstrap.cc:654] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.438700 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:53.441530 10443 consensus_queue.cc:260] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.441813 10071 catalog_manager.cc:5697] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.448606 10446 ts_tablet_manager.cc:1434] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:03:53.449836 10446 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.452426 10443 ts_tablet_manager.cc:1434] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.008s
I20260709 13:03:53.465682 10636 consensus_queue.cc:1048] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.469908 10443 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:53.474114 10578 leader_election.cc:290] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:03:53.494114 10289 leader_election.cc:343] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.494701 10289 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.497468 10539 raft_consensus.cc:2749] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.507078 10446 tablet_bootstrap.cc:654] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.509076 10444 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.509600 10444 ts_tablet_manager.cc:1403] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.219s	user 0.029s	sys 0.006s
I20260709 13:03:53.512235 10444 raft_consensus.cc:359] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.512936 10444 raft_consensus.cc:385] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.513204 10444 raft_consensus.cc:740] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.514663 10444 consensus_queue.cc:260] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.525864 10444 ts_tablet_manager.cc:1434] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:03:53.524577 10072 catalog_manager.cc:5697] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.527170 10444 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:53.529551 10453 raft_consensus.cc:515] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.526141 10557 raft_consensus.cc:493] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.537506 10557 raft_consensus.cc:515] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.546001 10557 leader_election.cc:290] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.547713 10443 tablet_bootstrap.cc:654] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.533828 10566 consensus_queue.cc:1048] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:53.549705 10566 consensus_queue.cc:1048] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.550652 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.554911 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.555804 10397 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:53.557158 10212 leader_election.cc:343] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.557672 10445 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:53.558238 10445 ts_tablet_manager.cc:1403] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.031s
I20260709 13:03:53.559507 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.561242 10445 raft_consensus.cc:359] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.561934 10445 raft_consensus.cc:385] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.565364 10444 tablet_bootstrap.cc:654] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.565160 10644 consensus_queue.cc:1048] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.562192 10445 raft_consensus.cc:740] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
W20260709 13:03:53.574810 10215 leader_election.cc:343] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.573740 10453 leader_election.cc:290] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:53.576689 10445 consensus_queue.cc:260] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.576638 10215 leader_election.cc:304] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.578970 10445 ts_tablet_manager.cc:1434] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:03:53.579702 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:53.581562 10453 raft_consensus.cc:2749] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.584465 10453 raft_consensus.cc:493] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.585039 10453 raft_consensus.cc:515] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.586730 10566 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4b5b492fca940a3883a22eec56a4f9f)
I20260709 13:03:53.590025 10566 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:53.584074 10215 leader_election.cc:343] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.592131 10397 raft_consensus.cc:2468] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.589277 10446 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.593626 10446 ts_tablet_manager.cc:1403] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.000s
I20260709 13:03:53.594847 10453 leader_election.cc:290] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:53.579975 10445 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.594283 10566 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.600996 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.601661 10396 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:03:53.603556 10140 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:53.604506 10637 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:53.604858 10637 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4b5b492fca940a3883a22eec56a4f9f)
I20260709 13:03:53.605198 10637 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.597188 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.608469 10322 raft_consensus.cc:2393] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 2: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:53.612390 10636 consensus_queue.cc:1048] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.613442 10443 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.613991 10443 ts_tablet_manager.cc:1403] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.007s
I20260709 13:03:53.616585 10443 raft_consensus.cc:359] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.617266 10443 raft_consensus.cc:385] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.617530 10443 raft_consensus.cc:740] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.618669 10446 raft_consensus.cc:359] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.619339 10215 leader_election.cc:304] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:53.619550 10446 raft_consensus.cc:385] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.621065 10446 raft_consensus.cc:740] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.621191 10453 raft_consensus.cc:2804] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.621716 10453 raft_consensus.cc:697] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:53.622605 10453 consensus_queue.cc:237] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.618570 10637 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.624832 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa66713733740428121c8683ffb7c90" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:53.625633 10170 raft_consensus.cc:2468] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:53.621865 10446 consensus_queue.cc:260] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.628155 10445 tablet_bootstrap.cc:654] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.630002 10446 ts_tablet_manager.cc:1434] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:03:53.631026 10446 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.598456 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa66713733740428121c8683ffb7c90" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.634135 10443 consensus_queue.cc:260] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.656462 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.662849 10637 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.656788 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.665138 10323 raft_consensus.cc:2393] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 2: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:53.658887 10444 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.666709 10444 ts_tablet_manager.cc:1403] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.140s	user 0.026s	sys 0.020s
I20260709 13:03:53.667130 10443 ts_tablet_manager.cc:1434] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:03:53.668514 10443 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:03:53.674391 10215 leader_election.cc:343] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.676071 10215 leader_election.cc:304] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.676836 10557 raft_consensus.cc:2804] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.677201 10557 raft_consensus.cc:493] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.677496 10557 raft_consensus.cc:3060] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.670573 10444 raft_consensus.cc:359] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:53.673175 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:53.680274 10444 raft_consensus.cc:385] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.680593 10444 raft_consensus.cc:740] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.681205 10444 consensus_queue.cc:260] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.683099 10444 ts_tablet_manager.cc:1434] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.003s
I20260709 13:03:53.683945 10444 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:53.686334 10557 raft_consensus.cc:515] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.688341 10557 leader_election.cc:290] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:53.690413 10445 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:53.690903 10445 ts_tablet_manager.cc:1403] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.000s
I20260709 13:03:53.690784 10641 consensus_queue.cc:1048] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.693562 10445 raft_consensus.cc:359] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.694226 10445 raft_consensus.cc:385] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.694499 10445 raft_consensus.cc:740] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.695147 10445 consensus_queue.cc:260] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.696234 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa66713733740428121c8683ffb7c90" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.696969 10396 raft_consensus.cc:3060] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.698995 10445 ts_tablet_manager.cc:1434] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:53.700151 10445 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.704474 10443 tablet_bootstrap.cc:654] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.696339 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa66713733740428121c8683ffb7c90" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:53.706250 10170 raft_consensus.cc:3060] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.707486 10444 tablet_bootstrap.cc:654] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.711366 10445 tablet_bootstrap.cc:654] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.713274 10396 raft_consensus.cc:2468] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.717228 10444 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.723973 10444 ts_tablet_manager.cc:1403] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:03:53.727070 10444 raft_consensus.cc:359] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.727820 10444 raft_consensus.cc:385] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.727998 10539 raft_consensus.cc:493] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.728768 10539 raft_consensus.cc:515] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.730283 10397 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:03:53.731052 10539 leader_election.cc:290] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.731539 10140 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:53.732731 10637 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.733202 10637 raft_consensus.cc:697] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:53.734056 10637 consensus_queue.cc:237] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.733306 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:53.735299 10246 raft_consensus.cc:2468] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:53.736951 10287 leader_election.cc:304] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:53.728099 10444 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.738119 10539 raft_consensus.cc:2804] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.738603 10539 raft_consensus.cc:493] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.739181 10539 raft_consensus.cc:3060] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.739367 10444 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.715382 10070 catalog_manager.cc:5697] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.742484 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:03:53.746501 10289 leader_election.cc:343] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.747733 10215 leader_election.cc:304] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:53.748629 10453 raft_consensus.cc:2804] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.749135 10453 raft_consensus.cc:697] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:53.749425 10446 tablet_bootstrap.cc:654] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.749998 10453 consensus_queue.cc:237] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.757299 10578 raft_consensus.cc:493] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.757927 10578 raft_consensus.cc:515] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.749127 10170 raft_consensus.cc:2468] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.762176 10578 leader_election.cc:290] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:53.764760 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.763520 10539 raft_consensus.cc:515] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.765403 10323 raft_consensus.cc:2468] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:53.743650 10444 ts_tablet_manager.cc:1434] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:53.767244 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:53.767957 10444 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:53.768631 10361 leader_election.cc:304] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
W20260709 13:03:53.769556 10362 leader_election.cc:343] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.763729 10071 catalog_manager.cc:5697] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.772601 10578 raft_consensus.cc:2804] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.773337 10578 raft_consensus.cc:493] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.778570 10578 raft_consensus.cc:3060] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.779647 10446 tablet_bootstrap.cc:492] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.780157 10446 ts_tablet_manager.cc:1403] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.003s
I20260709 13:03:53.783082 10446 raft_consensus.cc:359] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.783759 10446 raft_consensus.cc:385] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.784019 10446 raft_consensus.cc:740] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.784713 10446 consensus_queue.cc:260] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.788913 10635 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.789486 10635 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.791651 10635 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.793373 10446 ts_tablet_manager.cc:1434] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:03:53.794623 10446 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.793224 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.797163 10641 raft_consensus.cc:493] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.797791 10641 raft_consensus.cc:515] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.799517 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.800215 10323 raft_consensus.cc:2468] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:53.804564 10641 leader_election.cc:290] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.805454 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:53.807248 10323 raft_consensus.cc:2468] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:53.808673 10212 leader_election.cc:304] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
W20260709 13:03:53.807294 10140 leader_election.cc:343] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.810676 10137 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.811285 10443 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.811825 10443 ts_tablet_manager.cc:1403] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.007s
I20260709 13:03:53.812378 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.813212 10641 raft_consensus.cc:2804] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.813633 10641 raft_consensus.cc:493] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.813987 10641 raft_consensus.cc:3060] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:53.814282 10364 consensus_peers.cc:597] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.814733 10443 raft_consensus.cc:359] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.815245 10443 raft_consensus.cc:385] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.815477 10443 raft_consensus.cc:740] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.811818 10637 raft_consensus.cc:2804] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.815989 10637 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.816522 10637 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.817682 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:53.818236 10246 raft_consensus.cc:3060] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.819495 10539 leader_election.cc:290] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.822714 10641 raft_consensus.cc:515] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.824437 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.824937 10641 leader_election.cc:290] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.825083 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.816164 10443 consensus_queue.cc:260] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.825631 10323 raft_consensus.cc:3060] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:53.825708 10289 leader_election.cc:343] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.827098 10246 raft_consensus.cc:2468] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:53.828372 10444 tablet_bootstrap.cc:654] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.828233 10287 leader_election.cc:304] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.826197 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.829911 10539 raft_consensus.cc:2804] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.831108 10539 raft_consensus.cc:697] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:53.831305 10443 ts_tablet_manager.cc:1434] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:03:53.832228 10443 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:53.832005 10539 consensus_queue.cc:237] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.836933 10323 raft_consensus.cc:2468] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:53.838192 10445 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:53.838651 10445 ts_tablet_manager.cc:1403] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.037s
I20260709 13:03:53.839530 10443 tablet_bootstrap.cc:654] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.840004 10212 leader_election.cc:304] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.842864 10453 raft_consensus.cc:2804] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.843524 10453 raft_consensus.cc:697] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:53.843776 10445 raft_consensus.cc:359] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.844553 10445 raft_consensus.cc:385] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.844626 10453 consensus_queue.cc:237] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.824687 10578 raft_consensus.cc:515] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.847692 10396 raft_consensus.cc:2393] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate caa864648e614090be53d8ece3cd29b7 in current term 1: Already voted for candidate c4b5b492fca940a3883a22eec56a4f9f in this term.
I20260709 13:03:53.849007 10445 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.852687 10445 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.842202 10637 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.854496 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:53.855875 10637 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:53.856526 10445 ts_tablet_manager.cc:1434] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:03:53.857348 10445 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.858994 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.859349 10446 tablet_bootstrap.cc:654] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.861745 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:53.860630 10323 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.864960 10444 tablet_bootstrap.cc:492] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.865389 10444 ts_tablet_manager.cc:1403] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.000s
W20260709 13:03:53.867166 10140 leader_election.cc:343] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.868875 10444 raft_consensus.cc:359] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.869498 10444 raft_consensus.cc:385] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.869726 10445 tablet_bootstrap.cc:654] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.870000 10578 leader_election.cc:290] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:53.871248 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34d9d4b33884f7e8f29d0379b00614f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:53.872035 10321 raft_consensus.cc:2393] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:53.869695 10444 raft_consensus.cc:740] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.878491 10361 leader_election.cc:304] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:53.880167 10444 consensus_queue.cc:260] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.885113 10446 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.885643 10446 ts_tablet_manager.cc:1403] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.002s
I20260709 13:03:53.889629 10444 ts_tablet_manager.cc:1434] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:03:53.891309 10444 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:53.879701 10578 raft_consensus.cc:2749] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.894706 10443 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.895378 10443 ts_tablet_manager.cc:1403] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.007s
I20260709 13:03:53.897424 10071 catalog_manager.cc:5697] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.898154 10443 raft_consensus.cc:359] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.899091 10443 raft_consensus.cc:385] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.899435 10443 raft_consensus.cc:740] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.900213 10443 consensus_queue.cc:260] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.900651 10446 raft_consensus.cc:359] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.901069 10637 raft_consensus.cc:493] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.895485 10323 raft_consensus.cc:2468] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:53.901423 10446 raft_consensus.cc:385] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.903242 10071 catalog_manager.cc:5697] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.902217 10446 raft_consensus.cc:740] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.901593 10637 raft_consensus.cc:515] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:53.905851 10443 ts_tablet_manager.cc:1434] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:53.906814 10443 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:53.907029 10637 leader_election.cc:290] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:53.908701 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:53.905083 10446 consensus_queue.cc:260] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.909693 10539 raft_consensus.cc:493] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.911412 10539 raft_consensus.cc:515] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.912846 10446 ts_tablet_manager.cc:1434] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:03:53.912874 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:53.913935 10446 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.914180 10396 raft_consensus.cc:2393] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:53.917271 10140 leader_election.cc:304] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:53.917949 10445 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:53.918870 10445 ts_tablet_manager.cc:1403] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.025s
I20260709 13:03:53.919140 10635 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.921919 10446 tablet_bootstrap.cc:654] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.921998 10539 leader_election.cc:290] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:53.924731 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a5c8e6908849eba50516a7beb99556" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:53.925491 10246 raft_consensus.cc:2468] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:53.913065 10137 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:53.926788 10287 leader_election.cc:304] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:53.927459 10443 tablet_bootstrap.cc:654] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.928609 10566 raft_consensus.cc:2804] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.928612 10639 raft_consensus.cc:2804] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.929183 10566 raft_consensus.cc:697] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:53.929562 10639 raft_consensus.cc:493] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.929931 10639 raft_consensus.cc:3060] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.930128 10566 consensus_queue.cc:237] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.930749 10444 tablet_bootstrap.cc:654] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.931277 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a5c8e6908849eba50516a7beb99556" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:53.936663 10289 leader_election.cc:343] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.938944 10446 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:53.939723 10446 ts_tablet_manager.cc:1403] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:03:53.945770 10443 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:53.946401 10443 ts_tablet_manager.cc:1403] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 13:03:53.949457 10443 raft_consensus.cc:359] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.951296 10443 raft_consensus.cc:385] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.951395 10637 consensus_queue.cc:1048] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.942952 10446 raft_consensus.cc:359] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.953466 10446 raft_consensus.cc:385] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.953851 10446 raft_consensus.cc:740] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.954761 10446 consensus_queue.cc:260] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:53.955209 10070 catalog_manager.cc:5697] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.955910 10537 consensus_queue.cc:1048] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.951746 10443 raft_consensus.cc:740] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.956585 10446 ts_tablet_manager.cc:1434] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:03:53.958175 10446 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:53.958666 10443 consensus_queue.cc:260] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.922057 10445 raft_consensus.cc:359] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.966292 10445 raft_consensus.cc:385] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.966334 10246 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.966711 10444 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:53.967271 10444 ts_tablet_manager.cc:1403] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.003s
I20260709 13:03:53.967554 10443 ts_tablet_manager.cc:1434] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:03:53.968843 10443 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:53.969583 10445 raft_consensus.cc:740] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.970566 10445 consensus_queue.cc:260] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:53.974126 10446 tablet_bootstrap.cc:654] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.975067 10444 raft_consensus.cc:359] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.979183 10444 raft_consensus.cc:385] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.979487 10444 raft_consensus.cc:740] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.980181 10444 consensus_queue.cc:260] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:53.976478 10445 ts_tablet_manager.cc:1434] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 13:03:53.977274 10443 tablet_bootstrap.cc:654] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.981807 10445 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:53.988060 10445 tablet_bootstrap.cc:654] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.995931 10444 ts_tablet_manager.cc:1434] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:03:53.999801 10444 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.002029 10443 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:54.004048 10443 ts_tablet_manager.cc:1403] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.010s
I20260709 13:03:54.006028 10446 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:54.006569 10446 ts_tablet_manager.cc:1403] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.002s
I20260709 13:03:54.009344 10446 raft_consensus.cc:359] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.010192 10446 raft_consensus.cc:385] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.010514 10446 raft_consensus.cc:740] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.009644 10443 raft_consensus.cc:359] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.011059 10443 raft_consensus.cc:385] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.011197 10446 consensus_queue.cc:260] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.013938 10446 ts_tablet_manager.cc:1434] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:03:54.017021 10578 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.017659 10578 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.019943 10578 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.026408 10444 tablet_bootstrap.cc:654] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.032816 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:54.037362 10364 leader_election.cc:343] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.020498 10635 raft_consensus.cc:2749] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.021703 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.042443 10322 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:54.011456 10443 raft_consensus.cc:740] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.043432 10443 consensus_queue.cc:260] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.031368 10639 raft_consensus.cc:515] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.045336 10361 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:54.045842 10443 ts_tablet_manager.cc:1434] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:03:54.046811 10443 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:54.048417 10578 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.048821 10578 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.049427 10578 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.052865 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a5c8e6908849eba50516a7beb99556" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:54.053555 10170 raft_consensus.cc:3060] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.058729 10443 tablet_bootstrap.cc:654] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.058838 10641 consensus_queue.cc:1048] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.060882 10069 catalog_manager.cc:5697] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.061497 10641 consensus_queue.cc:1048] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.062028 10537 raft_consensus.cc:493] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.062587 10537 raft_consensus.cc:515] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.065001 10537 leader_election.cc:290] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:54.066756 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:54.067636 10248 raft_consensus.cc:2393] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:54.070513 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e39f05718844ce83488f64c90de17b" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.073321 10361 leader_election.cc:304] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:54.074486 10537 raft_consensus.cc:3060] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.020552 10446 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:54.070608 10578 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.090205 10453 raft_consensus.cc:493] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.091150 10453 raft_consensus.cc:515] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.099586 10170 raft_consensus.cc:2468] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.102478 10637 consensus_queue.cc:1048] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.099537 10453 leader_election.cc:290] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.100298 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.101189 10641 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.105604 10444 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.105312 10641 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.106086 10444 ts_tablet_manager.cc:1403] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.009s
I20260709 13:03:54.106930 10445 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:54.107496 10445 ts_tablet_manager.cc:1403] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.004s
I20260709 13:03:54.109011 10444 raft_consensus.cc:359] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.110826 10445 raft_consensus.cc:359] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:54.111441 10212 leader_election.cc:343] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.111001 10444 raft_consensus.cc:385] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.112177 10445 raft_consensus.cc:385] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.112067 10444 raft_consensus.cc:740] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.112739 10445 raft_consensus.cc:740] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.113323 10444 consensus_queue.cc:260] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.115231 10641 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.115742 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.102221 10639 leader_election.cc:290] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:54.131964 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a5c8e6908849eba50516a7beb99556" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:54.132655 10246 raft_consensus.cc:3060] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.131964 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.134869 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.135475 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
W20260709 13:03:54.136210 10215 leader_election.cc:343] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.137266 10215 leader_election.cc:304] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.103289 10537 raft_consensus.cc:2749] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.120627 10444 ts_tablet_manager.cc:1434] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:03:54.124289 10289 leader_election.cc:304] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:54.125047 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:54.138844 10444 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.138962 10319 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.146968 10640 raft_consensus.cc:2804] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.147516 10640 raft_consensus.cc:697] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:54.148202 10215 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.148345 10640 consensus_queue.cc:237] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.151221 10635 raft_consensus.cc:493] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.151862 10635 raft_consensus.cc:515] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.146988 10453 raft_consensus.cc:2749] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.155788 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.159392 10644 raft_consensus.cc:2749] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.160777 10635 leader_election.cc:290] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.161414 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84114c08b54e2892bb67e63f67b987" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.162014 10444 tablet_bootstrap.cc:654] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.127729 10446 tablet_bootstrap.cc:654] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.163125 10140 leader_election.cc:304] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.125563 10445 consensus_queue.cc:260] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.165037 10635 raft_consensus.cc:2749] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.161804 10537 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.128285 10443 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:54.166615 10445 ts_tablet_manager.cc:1434] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:03:54.124958 10578 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.170403 10537 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.171485 10445 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:54.170511 10443 ts_tablet_manager.cc:1403] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.022s
I20260709 13:03:54.173349 10537 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.175154 10443 raft_consensus.cc:359] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.176663 10443 raft_consensus.cc:385] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.177205 10443 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.151239 10246 raft_consensus.cc:2468] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.175930 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:54.177451 10364 leader_election.cc:343] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.179327 10445 tablet_bootstrap.cc:654] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.178645 10321 raft_consensus.cc:2393] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:54.179664 10443 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.181478 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.182557 10443 ts_tablet_manager.cc:1434] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:54.183223 10364 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:54.183537 10443 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:54.184252 10513 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.188472 10640 raft_consensus.cc:493] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.189010 10640 raft_consensus.cc:515] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.191066 10640 leader_election.cc:290] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:54.193110 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:54.193809 10246 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:54.194837 10319 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:54.195393 10287 leader_election.cc:304] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:54.196080 10361 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:54.197063 10640 raft_consensus.cc:2804] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.197476 10640 raft_consensus.cc:493] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.198197 10640 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.200388 10537 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.200886 10537 raft_consensus.cc:697] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:54.201707 10537 consensus_queue.cc:237] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.204111 10443 tablet_bootstrap.cc:654] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.204914 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.205662 10170 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:54.211071 10645 consensus_queue.cc:1048] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.218333 10513 raft_consensus.cc:2749] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.226281 10444 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.231691 10444 ts_tablet_manager.cc:1403] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.044s
I20260709 13:03:54.232959 10397 raft_consensus.cc:1275] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:54.235390 10444 raft_consensus.cc:359] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.236642 10444 raft_consensus.cc:385] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.237125 10444 raft_consensus.cc:740] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.235802 10498 consensus_queue.cc:1048] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:54.238080 10444 consensus_queue.cc:260] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.239367 10445 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:54.239924 10445 ts_tablet_manager.cc:1403] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 13:03:54.229825 10640 raft_consensus.cc:515] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.226140 10072 catalog_manager.cc:5697] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.241153 10444 ts_tablet_manager.cc:1434] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:03:54.242969 10444 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.242806 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:54.243479 10170 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.248203 10443 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:54.248934 10640 leader_election.cc:290] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:54.250172 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:54.250450 10443 ts_tablet_manager.cc:1403] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.001s
I20260709 13:03:54.250871 10246 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.250206 10444 tablet_bootstrap.cc:654] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.256182 10170 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.259337 10246 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.260187 10289 leader_election.cc:304] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:54.261437 10640 raft_consensus.cc:2804] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.258864 10446 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:54.262308 10640 raft_consensus.cc:697] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:54.262938 10446 ts_tablet_manager.cc:1403] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.007s
I20260709 13:03:54.263450 10640 consensus_queue.cc:237] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.266499 10443 raft_consensus.cc:359] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.267223 10443 raft_consensus.cc:385] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.267541 10443 raft_consensus.cc:740] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.268187 10443 consensus_queue.cc:260] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.270237 10443 ts_tablet_manager.cc:1434] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:03:54.271128 10443 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:54.277351 10446 raft_consensus.cc:359] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.278698 10446 raft_consensus.cc:385] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.279036 10446 raft_consensus.cc:740] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.279955 10445 raft_consensus.cc:359] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.282852 10445 raft_consensus.cc:385] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.283195 10445 raft_consensus.cc:740] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.283906 10445 consensus_queue.cc:260] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.286504 10445 ts_tablet_manager.cc:1434] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:03:54.287518 10445 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:54.282220 10446 consensus_queue.cc:260] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.281563 10443 tablet_bootstrap.cc:654] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.311846 10446 ts_tablet_manager.cc:1434] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:03:54.316236 10446 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:54.323181 10557 consensus_queue.cc:1048] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.326082 10445 tablet_bootstrap.cc:654] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.327953 10446 tablet_bootstrap.cc:654] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.332119 10645 raft_consensus.cc:493] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.332808 10645 raft_consensus.cc:515] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.335431 10645 leader_election.cc:290] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.356835 10068 catalog_manager.cc:5697] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.363619 10443 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:54.364246 10443 ts_tablet_manager.cc:1403] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.010s
I20260709 13:03:54.367846 10443 raft_consensus.cc:359] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.368688 10443 raft_consensus.cc:385] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.369287 10443 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.370779 10443 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.373308 10443 ts_tablet_manager.cc:1434] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:54.375782 10443 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:54.354801 10321 raft_consensus.cc:1275] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:54.378000 10635 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.385980 10446 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:54.386591 10446 ts_tablet_manager.cc:1403] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.006s
I20260709 13:03:54.388918 10557 consensus_queue.cc:1048] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.395040 10539 consensus_queue.cc:1048] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.395668 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9543c32b3846c78cd39da12cdbf781" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.396368 10396 raft_consensus.cc:2468] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:54.397051 10170 raft_consensus.cc:3060] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.398981 10215 leader_election.cc:304] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:54.400352 10645 raft_consensus.cc:2804] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.400696 10645 raft_consensus.cc:493] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.401033 10645 raft_consensus.cc:3060] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.387746 10635 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.404500 10539 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.405119 10539 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.406438 10635 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:54.405975 10070 catalog_manager.cc:5697] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.407002 10635 consensus_queue.cc:1048] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:54.407584 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:54.408679 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9543c32b3846c78cd39da12cdbf781" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.409379 10171 raft_consensus.cc:2468] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
W20260709 13:03:54.409632 10138 leader_election.cc:343] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.411298 10446 raft_consensus.cc:359] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.412107 10446 raft_consensus.cc:385] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.414371 10446 raft_consensus.cc:740] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.412523 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.412820 10539 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.419396 10446 consensus_queue.cc:260] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.426633 10444 tablet_bootstrap.cc:492] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.427178 10444 ts_tablet_manager.cc:1403] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.184s	user 0.058s	sys 0.068s
I20260709 13:03:54.436846 10446 ts_tablet_manager.cc:1434] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:03:54.438076 10446 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:54.441236 10557 consensus_queue.cc:1048] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.441079 10645 raft_consensus.cc:515] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.443302 10645 leader_election.cc:290] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.450482 10445 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:54.444087 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:54.457231 10140 leader_election.cc:343] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.458424 10498 consensus_queue.cc:1048] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.461699 10445 ts_tablet_manager.cc:1403] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.021s
I20260709 13:03:54.468699 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.457994 10140 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:54.478196 10444 raft_consensus.cc:359] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.479153 10444 raft_consensus.cc:385] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.479441 10444 raft_consensus.cc:740] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.479972 10444 consensus_queue.cc:260] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.473829 10289 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.486809 10444 ts_tablet_manager.cc:1434] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:03:54.491783 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9543c32b3846c78cd39da12cdbf781" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:54.492472 10172 raft_consensus.cc:3060] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.493047 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9543c32b3846c78cd39da12cdbf781" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:54.493822 10395 raft_consensus.cc:3060] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.485208 10498 raft_consensus.cc:2749] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.500072 10639 raft_consensus.cc:2749] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:54.505321 10639 raft_consensus.cc:493] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.505826 10639 raft_consensus.cc:515] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.507903 10639 leader_election.cc:290] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.507825 10395 raft_consensus.cc:2468] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:54.514935 10539 consensus_queue.cc:1048] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.515776 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.516119 10444 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.524084 10172 raft_consensus.cc:2468] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:54.525231 10215 leader_election.cc:304] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
W20260709 13:03:54.525411 10289 leader_election.cc:343] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.526072 10644 raft_consensus.cc:2804] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.528837 10644 raft_consensus.cc:697] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:54.529294 10567 consensus_queue.cc:1048] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.529803 10644 consensus_queue.cc:237] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.537336 10445 raft_consensus.cc:359] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.538594 10445 raft_consensus.cc:385] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.539039 10445 raft_consensus.cc:740] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.539875 10445 consensus_queue.cc:260] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.544157 10443 tablet_bootstrap.cc:654] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.547000 10446 tablet_bootstrap.cc:654] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.548614 10444 tablet_bootstrap.cc:654] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.551812 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.552834 10395 raft_consensus.cc:2468] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:54.559458 10445 ts_tablet_manager.cc:1434] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.002s
I20260709 13:03:54.562306 10445 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:54.578235 10539 consensus_queue.cc:1048] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.588898 10289 leader_election.cc:304] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:54.590082 10639 raft_consensus.cc:2804] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.590642 10639 raft_consensus.cc:493] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.591248 10639 raft_consensus.cc:3060] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.597671 10068 catalog_manager.cc:5697] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.616402 10639 raft_consensus.cc:515] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.640018 10444 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.640007 10639 leader_election.cc:290] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.640682 10444 ts_tablet_manager.cc:1403] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.000s
I20260709 13:03:54.648238 10445 tablet_bootstrap.cc:654] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.648419 10446 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:54.648986 10446 ts_tablet_manager.cc:1403] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.008s
I20260709 13:03:54.652232 10172 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.659356 10446 raft_consensus.cc:359] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.660714 10446 raft_consensus.cc:385] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.660962 10446 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.661799 10446 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.678141 10444 raft_consensus.cc:359] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.679006 10444 raft_consensus.cc:385] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.679337 10444 raft_consensus.cc:740] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.680442 10444 consensus_queue.cc:260] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.683018 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:54.676090 10641 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.685483 10641 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.687393 10641 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.687803 10444 ts_tablet_manager.cc:1434] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:54.691390 10446 ts_tablet_manager.cc:1434] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:54.692942 10444 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.701354 10446 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:54.704695 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.705420 10171 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:54.712512 10446 tablet_bootstrap.cc:654] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.713425 10215 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:54.715009 10641 raft_consensus.cc:2804] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.715375 10641 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.715689 10641 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.710279 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.720384 10443 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:54.721242 10443 ts_tablet_manager.cc:1403] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.345s	user 0.033s	sys 0.010s
W20260709 13:03:54.722162 10215 leader_election.cc:343] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.724035 10443 raft_consensus.cc:359] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.725456 10443 raft_consensus.cc:385] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.725693 10443 raft_consensus.cc:740] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.703444 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:54.726884 10641 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.729903 10637 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.730705 10641 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:54.732900 10394 raft_consensus.cc:3060] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.733443 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:54.734086 10171 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.730461 10637 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.740540 10443 consensus_queue.cc:260] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.745447 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:54.746774 10637 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.750736 10171 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:54.751223 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.751816 10444 tablet_bootstrap.cc:654] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.759882 10289 leader_election.cc:343] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.760921 10539 consensus_queue.cc:1048] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.741878 10640 raft_consensus.cc:493] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.765890 10640 raft_consensus.cc:515] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.767990 10640 leader_election.cc:290] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.765192 10639 consensus_queue.cc:1048] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.780406 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.829912 10395 raft_consensus.cc:2468] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
W20260709 13:03:54.769558 10215 leader_election.cc:343] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:54.831528 10215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35853, user_credentials={real_user=slave}} blocked reactor thread for 61989.7us
I20260709 13:03:54.756296 10537 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:03:54.831691 10289 leader_election.cc:304] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:54.789444 10445 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:54.833626 10445 ts_tablet_manager.cc:1403] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.272s	user 0.026s	sys 0.027s
I20260709 13:03:54.768579 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:54.792410 10446 tablet_bootstrap.cc:492] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:54.796360 10444 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.836436 10446 ts_tablet_manager.cc:1403] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.028s
I20260709 13:03:54.802327 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.836426 10513 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.837221 10323 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:54.836764 10539 raft_consensus.cc:2804] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.838387 10539 raft_consensus.cc:493] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.838752 10539 raft_consensus.cc:3060] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.839507 10640 raft_consensus.cc:493] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.839342 10446 raft_consensus.cc:359] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.840073 10446 raft_consensus.cc:385] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.839991 10640 raft_consensus.cc:515] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.836671 10444 ts_tablet_manager.cc:1403] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.004s
W20260709 13:03:54.813218 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:54.841125 10137 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.842022 10215 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.843222 10444 raft_consensus.cc:359] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.843890 10444 raft_consensus.cc:385] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.823916 10557 raft_consensus.cc:493] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.844146 10645 raft_consensus.cc:2804] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.844589 10557 raft_consensus.cc:515] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.845798 10567 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:54.846191 10567 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.846534 10567 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.846668 10557 leader_election.cc:290] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:54.846875 10445 raft_consensus.cc:359] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.847468 10445 raft_consensus.cc:385] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.785607 10443 ts_tablet_manager.cc:1434] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:03:54.847666 10445 raft_consensus.cc:740] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.848547 10443 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:54.850240 10645 raft_consensus.cc:697] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:54.851231 10645 consensus_queue.cc:237] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:54.853376 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.854496 10246 raft_consensus.cc:2468] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:54.840454 10446 raft_consensus.cc:740] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.844137 10444 raft_consensus.cc:740] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.855753 10446 consensus_queue.cc:260] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.781778 10394 raft_consensus.cc:2468] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.848367 10445 consensus_queue.cc:260] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:54.859457 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.859920 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c69db33a1ce4b1894e7cc946d24270c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:54.860663 10248 raft_consensus.cc:2468] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
W20260709 13:03:54.862694 10215 leader_election.cc:343] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.867365 10445 ts_tablet_manager.cc:1434] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:03:54.868676 10445 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:54.856460 10640 leader_election.cc:290] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.881561 10445 tablet_bootstrap.cc:654] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.879448 10444 consensus_queue.cc:260] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.887447 10289 leader_election.cc:304] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:54.888494 10721 consensus_queue.cc:1048] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.865707 10323 raft_consensus.cc:2468] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:54.896245 10539 raft_consensus.cc:515] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.893684 10640 raft_consensus.cc:2804] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.901750 10640 raft_consensus.cc:697] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:54.902626 10640 consensus_queue.cc:237] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.893960 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c69db33a1ce4b1894e7cc946d24270c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:54.905189 10443 tablet_bootstrap.cc:654] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.906241 10444 ts_tablet_manager.cc:1434] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260709 13:03:54.907258 10444 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:54.917754 10446 ts_tablet_manager.cc:1434] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.081s	user 0.012s	sys 0.004s
I20260709 13:03:54.905427 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:54.905303 10394 raft_consensus.cc:2468] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:54.919042 10446 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:54.924844 10289 leader_election.cc:304] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:54.925854 10721 raft_consensus.cc:2804] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.926244 10721 raft_consensus.cc:493] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.926592 10721 raft_consensus.cc:3060] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.926990 10212 leader_election.cc:304] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:54.934712 10725 raft_consensus.cc:2804] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.935179 10725 raft_consensus.cc:493] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.935497 10725 raft_consensus.cc:3060] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.926683 10247 raft_consensus.cc:3060] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.902868 10567 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.936733 10721 raft_consensus.cc:515] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.942771 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c69db33a1ce4b1894e7cc946d24270c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:54.943475 10248 raft_consensus.cc:3060] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.947033 10444 tablet_bootstrap.cc:654] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.953118 10723 raft_consensus.cc:493] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.953653 10723 raft_consensus.cc:515] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:54.957100 10247 raft_consensus.cc:2468] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.957100 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:54.960150 10171 raft_consensus.cc:1240] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Rejecting Update request from peer c4b5b492fca940a3883a22eec56a4f9f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:03:54.958577 10287 leader_election.cc:304] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:54.958949 10721 leader_election.cc:290] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.958752 10723 leader_election.cc:290] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:03:54.960485 10364 leader_election.cc:343] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.964130 10639 raft_consensus.cc:2804] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.965710 10639 raft_consensus.cc:697] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:54.966006 10070 catalog_manager.cc:5697] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.973256 10446 tablet_bootstrap.cc:654] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.972828 10639 consensus_queue.cc:237] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.957456 10248 raft_consensus.cc:2468] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:54.974676 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:54.976819 10445 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:54.977218 10445 ts_tablet_manager.cc:1403] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.010s
W20260709 13:03:54.976084 10361 leader_election.cc:343] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.982237 10567 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.982738 10361 leader_election.cc:304] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:54.983579 10723 raft_consensus.cc:2749] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.985421 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:54.987332 10539 leader_election.cc:290] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:54.988083 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:54.990605 10287 leader_election.cc:304] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:54.992190 10445 raft_consensus.cc:359] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.994065 10137 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:54.995273 10637 raft_consensus.cc:2749] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.995673 10445 raft_consensus.cc:385] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.996080 10445 raft_consensus.cc:740] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.997252 10445 consensus_queue.cc:260] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:54.998364 10444 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:54.999110 10444 ts_tablet_manager.cc:1403] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.005s
I20260709 13:03:55.000070 10445 ts_tablet_manager.cc:1434] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:03:55.000555 10720 raft_consensus.cc:2804] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.001159 10720 raft_consensus.cc:697] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:55.001381 10445 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:55.002143 10720 consensus_queue.cc:237] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.003417 10723 consensus_queue.cc:1059] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.005558 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e981dc5ffbe9413a941979a7e31690e1" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:55.006012 10513 raft_consensus.cc:3055] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.006438 10513 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:55.006887 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c69db33a1ce4b1894e7cc946d24270c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:55.007476 10396 raft_consensus.cc:3060] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.007299 10513 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.008981 10445 tablet_bootstrap.cc:654] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.006146 10395 raft_consensus.cc:3060] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.000449 10645 consensus_queue.cc:1048] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:03:55.008715 10444 raft_consensus.cc:359] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.011739 10444 raft_consensus.cc:385] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.012192 10444 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.018193 10513 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.024012 10396 raft_consensus.cc:2468] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.026008 10444 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.039234 10445 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:55.039774 10445 ts_tablet_manager.cc:1403] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:03:55.043558 10445 raft_consensus.cc:359] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.045246 10445 raft_consensus.cc:385] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.045524 10445 raft_consensus.cc:740] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.046160 10445 consensus_queue.cc:260] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.050381 10725 raft_consensus.cc:515] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.054467 10395 raft_consensus.cc:2468] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.055083 10725 leader_election.cc:290] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:55.055581 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:55.056160 10319 raft_consensus.cc:3060] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.058938 10444 ts_tablet_manager.cc:1434] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:03:55.059985 10444 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:55.071950 10567 raft_consensus.cc:493] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.074144 10445 ts_tablet_manager.cc:1434] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:03:55.073863 10567 raft_consensus.cc:515] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.075203 10445 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:55.077929 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.078579 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:55.083539 10443 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.084026 10443 ts_tablet_manager.cc:1403] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.002s
I20260709 13:03:55.086736 10443 raft_consensus.cc:359] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.087459 10443 raft_consensus.cc:385] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.088296 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1325c482dbf64578a5799209e1af6370" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.089339 10397 raft_consensus.cc:2393] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:55.087730 10443 raft_consensus.cc:740] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.090842 10443 consensus_queue.cc:260] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.092900 10140 leader_election.cc:304] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:55.093149 10726 consensus_queue.cc:1048] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:55.086565 10567 leader_election.cc:290] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:55.097000 10637 raft_consensus.cc:3060] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.098282 10443 ts_tablet_manager.cc:1434] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:03:55.102406 10443 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:55.098738 10319 raft_consensus.cc:2468] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:55.104734 10446 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.108448 10446 ts_tablet_manager.cc:1403] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.190s	user 0.007s	sys 0.010s
I20260709 13:03:55.105654 10637 raft_consensus.cc:2749] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:55.095016 10215 leader_election.cc:343] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.115312 10446 raft_consensus.cc:359] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.116143 10446 raft_consensus.cc:385] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.116456 10446 raft_consensus.cc:740] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.111539 10068 catalog_manager.cc:5697] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.117434 10446 consensus_queue.cc:260] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.135891 10446 ts_tablet_manager.cc:1434] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:55.139528 10446 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:55.146308 10212 leader_election.cc:304] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:55.153864 10444 tablet_bootstrap.cc:654] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.151721 10726 raft_consensus.cc:2804] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.159370 10726 raft_consensus.cc:697] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:55.160377 10726 consensus_queue.cc:237] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.170255 10446 tablet_bootstrap.cc:654] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.177944 10445 tablet_bootstrap.cc:654] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.189222 10443 tablet_bootstrap.cc:654] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.201120 10070 catalog_manager.cc:5697] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.206199 10070 catalog_manager.cc:5697] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.251114 10739 raft_consensus.cc:493] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.251758 10739 raft_consensus.cc:515] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.253993 10739 leader_election.cc:290] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:55.258586 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.259435 10172 raft_consensus.cc:2468] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.260998 10289 leader_election.cc:304] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:55.262388 10739 raft_consensus.cc:2804] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.262805 10739 raft_consensus.cc:493] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.263129 10739 raft_consensus.cc:3060] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.264250 10446 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.264827 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.265614 10394 raft_consensus.cc:2468] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.267179 10445 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:55.267673 10445 ts_tablet_manager.cc:1403] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.011s
I20260709 13:03:55.264855 10446 ts_tablet_manager.cc:1403] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.000s
I20260709 13:03:55.270416 10445 raft_consensus.cc:359] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.271095 10445 raft_consensus.cc:385] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.271329 10445 raft_consensus.cc:740] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.274307 10446 raft_consensus.cc:359] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.275406 10446 raft_consensus.cc:385] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.275704 10446 raft_consensus.cc:740] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.271885 10445 consensus_queue.cc:260] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.276834 10446 consensus_queue.cc:260] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.277755 10445 ts_tablet_manager.cc:1434] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:03:55.279031 10446 ts_tablet_manager.cc:1434] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:03:55.280689 10739 raft_consensus.cc:515] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.283772 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:55.284451 10397 raft_consensus.cc:3060] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.286779 10444 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:55.287075 10446 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:55.286278 10068 catalog_manager.cc:5697] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.287310 10444 ts_tablet_manager.cc:1403] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.228s	user 0.026s	sys 0.019s
I20260709 13:03:55.280625 10443 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.290388 10443 ts_tablet_manager.cc:1403] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.002s
I20260709 13:03:55.292856 10394 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.296650 10444 raft_consensus.cc:359] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.296926 10443 raft_consensus.cc:359] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.297451 10444 raft_consensus.cc:385] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.297691 10443 raft_consensus.cc:385] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.297837 10739 leader_election.cc:290] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:55.298467 10444 raft_consensus.cc:740] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.299249 10443 raft_consensus.cc:740] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.298676 10397 raft_consensus.cc:2468] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.300002 10443 consensus_queue.cc:260] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.302301 10445 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:55.303452 10289 leader_election.cc:304] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:55.303722 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cf8b715d234c44aac72258d0bac01f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.304462 10172 raft_consensus.cc:3060] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.310561 10445 tablet_bootstrap.cc:654] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.311882 10443 ts_tablet_manager.cc:1434] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:55.315372 10443 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:55.318274 10172 raft_consensus.cc:2468] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.320844 10513 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.321440 10513 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.322479 10445 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:55.322844 10443 tablet_bootstrap.cc:654] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.323009 10445 ts_tablet_manager.cc:1403] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:03:55.324435 10739 raft_consensus.cc:2804] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.325261 10739 raft_consensus.cc:697] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:55.325954 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.326130 10739 consensus_queue.cc:237] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.326661 10170 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:55.327961 10364 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:55.329056 10718 raft_consensus.cc:2804] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:55.329468 10718 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.329816 10718 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.328243 10444 consensus_queue.cc:260] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.335923 10444 ts_tablet_manager.cc:1434] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:03:55.337066 10444 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:55.337661 10443 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.338219 10443 ts_tablet_manager.cc:1403] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:03:55.341408 10443 raft_consensus.cc:359] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.342214 10443 raft_consensus.cc:385] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.342527 10443 raft_consensus.cc:740] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.343209 10443 consensus_queue.cc:260] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.343946 10723 raft_consensus.cc:493] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.344496 10723 raft_consensus.cc:515] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.345567 10443 ts_tablet_manager.cc:1434] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:55.346617 10723 leader_election.cc:290] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.348078 10443 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:55.348595 10446 tablet_bootstrap.cc:654] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.349552 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.350219 10248 raft_consensus.cc:2468] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:55.351912 10362 leader_election.cc:304] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:55.353453 10723 raft_consensus.cc:2804] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.353839 10723 raft_consensus.cc:493] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.354198 10723 raft_consensus.cc:3060] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.354310 10444 tablet_bootstrap.cc:654] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.358695 10443 tablet_bootstrap.cc:654] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.361438 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.363477 10446 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.364192 10446 ts_tablet_manager.cc:1403] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.006s
I20260709 13:03:55.366923 10446 raft_consensus.cc:359] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.363538 10739 raft_consensus.cc:493] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.368844 10739 raft_consensus.cc:515] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.368659 10446 raft_consensus.cc:385] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.369746 10446 raft_consensus.cc:740] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.370525 10446 consensus_queue.cc:260] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.371201 10739 leader_election.cc:290] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:55.372790 10446 ts_tablet_manager.cc:1434] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:55.374918 10446 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:55.377843 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae79c759a874e5ab8c3a59dbde5aa0e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.378661 10248 raft_consensus.cc:2468] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.381024 10287 leader_election.cc:304] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:55.381963 10446 tablet_bootstrap.cc:654] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.382951 10721 raft_consensus.cc:2804] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.359956 10513 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.383428 10721 raft_consensus.cc:493] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.383806 10721 raft_consensus.cc:3060] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.367887 10445 raft_consensus.cc:359] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.392269 10718 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.406840 10718 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.408007 10723 raft_consensus.cc:515] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.397481 10446 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.409217 10446 ts_tablet_manager.cc:1403] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.003s
I20260709 13:03:55.410590 10723 leader_election.cc:290] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.408643 10739 consensus_queue.cc:1048] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:55.412627 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae79c759a874e5ab8c3a59dbde5aa0e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.403918 10444 tablet_bootstrap.cc:492] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:55.413582 10444 ts_tablet_manager.cc:1403] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.001s
I20260709 13:03:55.413796 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.414536 10170 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.415060 10645 consensus_queue.cc:1048] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.416739 10444 raft_consensus.cc:359] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.417626 10444 raft_consensus.cc:385] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.417949 10444 raft_consensus.cc:740] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.418941 10444 consensus_queue.cc:260] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.422828 10444 ts_tablet_manager.cc:1434] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:03:55.411890 10446 raft_consensus.cc:359] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.423435 10446 raft_consensus.cc:385] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.423520 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:55.424019 10444 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:55.422922 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:55.423728 10446 raft_consensus.cc:740] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.424926 10397 raft_consensus.cc:2468] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.425873 10247 raft_consensus.cc:3060] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.392861 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.402148 10445 raft_consensus.cc:385] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.428112 10445 raft_consensus.cc:740] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.428822 10445 consensus_queue.cc:260] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.425843 10446 consensus_queue.cc:260] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.430611 10444 tablet_bootstrap.cc:654] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.431214 10446 ts_tablet_manager.cc:1434] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:03:55.437412 10446 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:55.436141 10445 ts_tablet_manager.cc:1434] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.000s
I20260709 13:03:55.439771 10247 raft_consensus.cc:2468] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:55.440254 10445 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
W20260709 13:03:55.441403 10364 leader_election.cc:343] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.441712 10443 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.446406 10443 ts_tablet_manager.cc:1403] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.031s
I20260709 13:03:55.448086 10362 leader_election.cc:304] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:55.449436 10443 raft_consensus.cc:359] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.458388 10443 raft_consensus.cc:385] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.458710 10443 raft_consensus.cc:740] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.459205 10445 tablet_bootstrap.cc:654] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.459452 10443 consensus_queue.cc:260] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.451812 10446 tablet_bootstrap.cc:654] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.453085 10170 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:03:55.461885 10070 catalog_manager.cc:5697] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.462131 10513 raft_consensus.cc:2804] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.462848 10174 raft_consensus.cc:1240] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Rejecting Update request from peer caa864648e614090be53d8ece3cd29b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:55.463919 10443 ts_tablet_manager.cc:1434] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:03:55.465425 10443 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:55.466107 10513 raft_consensus.cc:697] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:55.466270 10645 consensus_queue.cc:1059] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.467146 10645 raft_consensus.cc:3055] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.466977 10513 consensus_queue.cc:237] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.467530 10645 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:55.449162 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.463835 10444 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:55.468866 10444 ts_tablet_manager.cc:1403] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.003s
I20260709 13:03:55.468360 10172 raft_consensus.cc:3060] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.474851 10645 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.476649 10645 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.476855 10444 raft_consensus.cc:359] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.477723 10444 raft_consensus.cc:385] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.478009 10444 raft_consensus.cc:740] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.478668 10444 consensus_queue.cc:260] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.487097 10444 ts_tablet_manager.cc:1434] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:03:55.488142 10444 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:55.491915 10739 consensus_queue.cc:1048] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.492748 10443 tablet_bootstrap.cc:654] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.501386 10444 tablet_bootstrap.cc:654] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.505426 10395 raft_consensus.cc:1240] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Rejecting Update request from peer caa864648e614090be53d8ece3cd29b7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:03:55.518571 10739 consensus_queue.cc:1048] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.542124 10364 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: caa864648e614090be53d8ece3cd29b7
I20260709 13:03:55.544751 10723 raft_consensus.cc:2804] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.545365 10723 raft_consensus.cc:697] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:55.546264 10723 consensus_queue.cc:237] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.549721 10720 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.550314 10720 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.538468 10644 raft_consensus.cc:493] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.552884 10644 raft_consensus.cc:515] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.553937 10640 raft_consensus.cc:493] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.554431 10640 raft_consensus.cc:515] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.555346 10644 leader_election.cc:290] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:55.556573 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:55.552465 10720 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:55.536897 10725 raft_consensus.cc:493] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.556632 10640 leader_election.cc:290] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.557533 10319 raft_consensus.cc:2468] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:55.557456 10725 raft_consensus.cc:515] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.558923 10212 leader_election.cc:304] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:55.559485 10725 leader_election.cc:290] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:55.560046 10725 raft_consensus.cc:2804] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.560781 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:55.571323 10446 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.571261 10725 raft_consensus.cc:493] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.566635 10445 tablet_bootstrap.cc:492] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:55.567277 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.567909 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.571861 10725 raft_consensus.cc:3060] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:55.572067 10212 leader_election.cc:343] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.572016 10446 ts_tablet_manager.cc:1403] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.003s
I20260709 13:03:55.568461 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.574503 10445 ts_tablet_manager.cc:1403] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.015s
I20260709 13:03:55.575475 10446 raft_consensus.cc:359] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.525104 10721 raft_consensus.cc:515] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.572602 10173 raft_consensus.cc:2468] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.576190 10446 raft_consensus.cc:385] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.576956 10446 raft_consensus.cc:740] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.578243 10446 consensus_queue.cc:260] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.580389 10172 raft_consensus.cc:2468] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
W20260709 13:03:55.592264 10287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 77088.1us
I20260709 13:03:55.580586 10721 leader_election.cc:290] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:55.612044 10446 ts_tablet_manager.cc:1434] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260709 13:03:55.613487 10446 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:55.594751 10637 raft_consensus.cc:493] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.615080 10445 raft_consensus.cc:359] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.615826 10445 raft_consensus.cc:385] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.616096 10445 raft_consensus.cc:740] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.621133 10445 consensus_queue.cc:260] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.623566 10445 ts_tablet_manager.cc:1434] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
W20260709 13:03:55.624022 10289 leader_election.cc:343] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.624569 10445 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:55.624800 10289 leader_election.cc:304] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:55.625751 10639 raft_consensus.cc:2804] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.626133 10639 raft_consensus.cc:493] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.626456 10639 raft_consensus.cc:3060] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.626653 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.616259 10637 raft_consensus.cc:515] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.664157 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae79c759a874e5ab8c3a59dbde5aa0e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:55.664981 10394 raft_consensus.cc:3060] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.665503 10443 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.666013 10443 ts_tablet_manager.cc:1403] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.018s
I20260709 13:03:55.670711 10443 raft_consensus.cc:359] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.671838 10443 raft_consensus.cc:385] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.672300 10443 raft_consensus.cc:740] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.677300 10443 consensus_queue.cc:260] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:55.682853 10445 tablet_bootstrap.cc:654] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.680368 10637 leader_election.cc:290] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:55.685218 10444 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:55.693666 10444 ts_tablet_manager.cc:1403] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.206s	user 0.027s	sys 0.002s
I20260709 13:03:55.685518 10443 ts_tablet_manager.cc:1434] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:55.697583 10444 raft_consensus.cc:359] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.715533 10444 raft_consensus.cc:385] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.715942 10444 raft_consensus.cc:740] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.687485 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae79c759a874e5ab8c3a59dbde5aa0e" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:55.695658 10639 raft_consensus.cc:515] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.718225 10247 raft_consensus.cc:3060] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.695303 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.685714 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.701097 10443 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:55.701917 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.716661 10444 consensus_queue.cc:260] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.722358 10446 tablet_bootstrap.cc:654] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.723671 10639 leader_election.cc:290] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:55.724608 10395 raft_consensus.cc:2468] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:55.721851 10720 consensus_queue.cc:1048] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:55.730660 10443 tablet_bootstrap.cc:654] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.734040 10072 catalog_manager.cc:5697] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.739853 10444 ts_tablet_manager.cc:1434] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:03:55.701527 10725 raft_consensus.cc:515] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.741671 10248 raft_consensus.cc:2393] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:55.744258 10444 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
W20260709 13:03:55.744410 10289 leader_election.cc:343] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.744987 10289 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:55.747756 10172 raft_consensus.cc:3060] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.747691 10760 raft_consensus.cc:2749] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.749728 10394 raft_consensus.cc:2468] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.719408 10721 consensus_queue.cc:1048] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:03:55.766065 10645 raft_consensus.cc:493] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.766561 10645 raft_consensus.cc:515] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.768937 10645 leader_election.cc:290] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:55.774571 10725 leader_election.cc:290] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:55.778298 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:55.779213 10245 raft_consensus.cc:2393] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:55.779474 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c96e8c718214d359041be0247dd3c4b" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:55.780332 10321 raft_consensus.cc:2393] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:55.786978 10247 raft_consensus.cc:2468] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.788395 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.791620 10215 leader_election.cc:304] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:55.791857 10173 raft_consensus.cc:3060] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.792842 10289 leader_election.cc:304] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:55.789949 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:55.794207 10322 raft_consensus.cc:2393] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate caa864648e614090be53d8ece3cd29b7 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:55.794329 10720 raft_consensus.cc:2804] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.788220 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:55.795323 10639 consensus_queue.cc:1048] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.796559 10645 raft_consensus.cc:2804] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.797009 10645 raft_consensus.cc:493] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.794903 10720 raft_consensus.cc:697] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:55.797341 10645 raft_consensus.cc:3060] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.798012 10720 consensus_queue.cc:237] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.817685 10444 tablet_bootstrap.cc:654] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.798789 10137 leader_election.cc:304] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:55.854238 10637 raft_consensus.cc:2749] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.854967 10721 raft_consensus.cc:493] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.876379 10446 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:55.877645 10446 ts_tablet_manager.cc:1403] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.264s	user 0.009s	sys 0.011s
I20260709 13:03:55.856487 10173 raft_consensus.cc:2468] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:55.880489 10445 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:55.881107 10445 ts_tablet_manager.cc:1403] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.257s	user 0.021s	sys 0.024s
W20260709 13:03:55.865207 10137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 69441.1us
I20260709 13:03:55.900256 10443 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:55.900902 10443 ts_tablet_manager.cc:1403] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.003s
I20260709 13:03:55.879220 10721 raft_consensus.cc:515] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:55.913028 10639 consensus_queue.cc:1048] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.913259 10721 leader_election.cc:290] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:55.917745 10289 leader_election.cc:304] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: caa864648e614090be53d8ece3cd29b7
I20260709 13:03:55.918936 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f42bc2234743f1bf7ae96281ec598b" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:55.919569 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:55.919889 10172 raft_consensus.cc:2393] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate caa864648e614090be53d8ece3cd29b7 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:55.920598 10644 consensus_queue.cc:1048] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:55.920902 10212 leader_election.cc:343] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.921631 10557 consensus_queue.cc:1048] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.927251 10445 raft_consensus.cc:359] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.928184 10445 raft_consensus.cc:385] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.928509 10445 raft_consensus.cc:740] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.931730 10445 consensus_queue.cc:260] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:55.940212 10445 ts_tablet_manager.cc:1434] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:03:55.930336 10721 raft_consensus.cc:2804] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.960106 10215 leader_election.cc:304] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:55.961448 10779 raft_consensus.cc:2749] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:03:55.961639 10215 leader_election.cc:343] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.964223 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:55.962001 10215 leader_election.cc:304] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:55.970974 10644 raft_consensus.cc:2749] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.971936 10537 consensus_queue.cc:1048] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.972946 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:55.976194 10397 raft_consensus.cc:2468] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:55.981858 10289 leader_election.cc:304] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:55.952996 10721 raft_consensus.cc:697] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:55.998489 10443 raft_consensus.cc:359] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.999343 10443 raft_consensus.cc:385] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.999760 10443 raft_consensus.cc:740] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.002966 10443 consensus_queue.cc:260] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:55.989194 10739 raft_consensus.cc:2804] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.979774 10645 raft_consensus.cc:515] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.023406 10445 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:56.022050 10443 ts_tablet_manager.cc:1434] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.001s
I20260709 13:03:56.018750 10444 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:56.033530 10444 ts_tablet_manager.cc:1403] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.289s	user 0.024s	sys 0.011s
I20260709 13:03:56.022058 10072 catalog_manager.cc:5697] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.020563 10567 raft_consensus.cc:493] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.031329 10070 catalog_manager.cc:5697] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.042968 10446 raft_consensus.cc:359] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.050414 10446 raft_consensus.cc:385] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.050765 10446 raft_consensus.cc:740] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.051599 10446 consensus_queue.cc:260] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.011749 10739 raft_consensus.cc:493] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.061076 10446 ts_tablet_manager.cc:1434] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.183s	user 0.005s	sys 0.003s
I20260709 13:03:56.055603 10637 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.058931 10739 raft_consensus.cc:3060] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.080261 10248 raft_consensus.cc:2393] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:56.049338 10539 consensus_queue.cc:1048] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:56.084196 10444 raft_consensus.cc:359] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.085227 10444 raft_consensus.cc:385] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.085506 10444 raft_consensus.cc:740] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
W20260709 13:03:56.089262 10780 log.cc:927] Time spent T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:03:56.047528 10567 raft_consensus.cc:515] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.102809 10445 tablet_bootstrap.cc:654] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.019023 10721 consensus_queue.cc:237] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.103012 10444 consensus_queue.cc:260] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.091925 10637 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.122949 10443 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:56.122962 10567 leader_election.cc:290] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:56.130219 10443 tablet_bootstrap.cc:654] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.131490 10637 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.136473 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:56.150133 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:56.150928 10245 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:56.158393 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:56.159292 10396 raft_consensus.cc:3060] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.136152 10645 leader_election.cc:290] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.162823 10720 raft_consensus.cc:493] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.163425 10720 raft_consensus.cc:515] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.166044 10720 leader_election.cc:290] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:56.167675 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:56.172358 10319 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:56.173025 10446 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:56.177167 10138 leader_election.cc:304] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:56.178342 10637 raft_consensus.cc:2804] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.178882 10637 raft_consensus.cc:493] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.179342 10637 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.182199 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:56.182952 10245 raft_consensus.cc:2468] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:56.191468 10444 ts_tablet_manager.cc:1434] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.158s	user 0.003s	sys 0.005s
I20260709 13:03:56.192095 10287 leader_election.cc:304] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:56.192940 10444 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:56.194903 10720 raft_consensus.cc:2804] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.195345 10720 raft_consensus.cc:493] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.195828 10720 raft_consensus.cc:3060] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.210620 10739 raft_consensus.cc:515] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.212247 10322 raft_consensus.cc:2393] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate caa864648e614090be53d8ece3cd29b7 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:56.217666 10537 consensus_queue.cc:1048] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:56.220428 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35805, user_credentials={real_user=slave}} blocked reactor thread for 64268.6us
I20260709 13:03:56.212716 10720 raft_consensus.cc:515] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.226445 10720 leader_election.cc:290] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:56.227663 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
W20260709 13:03:56.227967 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:56.234622 10443 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:56.237852 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.238138 10174 raft_consensus.cc:1275] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:56.243752 10249 raft_consensus.cc:1275] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:03:56.249104 10443 ts_tablet_manager.cc:1403] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.126s	user 0.001s	sys 0.012s
I20260709 13:03:56.249198 10249 pending_rounds.cc:85] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Aborting all ops after (but not including) 0
I20260709 13:03:56.248687 10245 raft_consensus.cc:3060] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.249953 10249 pending_rounds.cc:107] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:56.250383 10249 raft_consensus.cc:2889] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.245514 10137 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:56.241030 10789 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.252367 10789 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.252664 10443 raft_consensus.cc:359] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.253362 10443 raft_consensus.cc:385] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.253688 10394 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:56.255745 10789 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:56.252328 10537 consensus_queue.cc:1048] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:56.255856 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:56.257465 10321 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:56.259055 10361 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:56.260844 10537 raft_consensus.cc:2804] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.261379 10537 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.263119 10537 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.268524 10784 raft_consensus.cc:2804] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.273377 10784 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.273778 10784 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.274670 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.275372 10397 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:56.287614 10245 raft_consensus.cc:2468] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:56.253733 10443 raft_consensus.cc:740] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
W20260709 13:03:56.288662 10137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 86028.9us
I20260709 13:03:56.289018 10443 consensus_queue.cc:260] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.290606 10443 ts_tablet_manager.cc:1434] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:03:56.291491 10443 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:56.291703 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:56.292713 10248 raft_consensus.cc:2393] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:56.293329 10068 catalog_manager.cc:5697] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.300091 10739 leader_election.cc:290] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.303279 10445 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:56.303793 10445 ts_tablet_manager.cc:1403] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.281s	user 0.013s	sys 0.001s
I20260709 13:03:56.306344 10789 consensus_queue.cc:1048] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.307451 10445 raft_consensus.cc:359] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.308137 10445 raft_consensus.cc:385] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.308422 10445 raft_consensus.cc:740] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.279578 10537 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.309065 10445 consensus_queue.cc:260] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.310789 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:56.311110 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:56.311393 10537 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:56.311816 10322 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.317248 10445 ts_tablet_manager.cc:1434] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:56.318424 10445 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:56.320721 10287 leader_election.cc:304] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:56.322093 10720 raft_consensus.cc:2804] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.323295 10639 consensus_queue.cc:1048] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.324627 10443 tablet_bootstrap.cc:654] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.326073 10637 raft_consensus.cc:515] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.329847 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:56.330242 10446 tablet_bootstrap.cc:654] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.331280 10394 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.324134 10445 tablet_bootstrap.cc:654] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.333215 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:56.339041 10444 tablet_bootstrap.cc:654] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.338850 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27f9cdf5f7448b1b83691579db44a27" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:56.341277 10784 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.342572 10171 raft_consensus.cc:2393] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:56.347163 10784 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.348610 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:56.349402 10398 raft_consensus.cc:2393] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 in current term 1: Already voted for candidate c4b5b492fca940a3883a22eec56a4f9f in this term.
I20260709 13:03:56.352666 10720 raft_consensus.cc:697] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:56.353847 10739 consensus_queue.cc:1048] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.354187 10289 leader_election.cc:304] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:56.353782 10720 consensus_queue.cc:237] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.355243 10639 raft_consensus.cc:2749] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.355473 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b795492ea96e4371835f5f4cacaf9141" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
W20260709 13:03:56.359961 10289 leader_election.cc:343] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:56.361048 10289 leader_election.cc:343] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.362079 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:56.340060 10394 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:56.374779 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:56.375911 10168 raft_consensus.cc:2393] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:56.377573 10137 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:56.360894 10396 raft_consensus.cc:2468] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:56.328217 10637 leader_election.cc:290] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:56.390043 10322 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:56.392881 10361 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:56.398862 10215 leader_election.cc:304] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:56.402213 10557 raft_consensus.cc:2804] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.408192 10785 raft_consensus.cc:2749] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.398665 10513 raft_consensus.cc:2804] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.410252 10513 raft_consensus.cc:697] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:56.411128 10513 consensus_queue.cc:237] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.413311 10557 raft_consensus.cc:697] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:56.414361 10557 consensus_queue.cc:237] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.429522 10071 catalog_manager.cc:5697] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.429080 10140 leader_election.cc:304] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:56.436503 10567 raft_consensus.cc:2804] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.437108 10567 raft_consensus.cc:697] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:56.438051 10567 consensus_queue.cc:237] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.459713 10443 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:56.460515 10443 ts_tablet_manager.cc:1403] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.169s	user 0.031s	sys 0.020s
I20260709 13:03:56.462241 10446 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:56.466784 10446 ts_tablet_manager.cc:1403] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.294s	user 0.018s	sys 0.006s
I20260709 13:03:56.475977 10721 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4b5b492fca940a3883a22eec56a4f9f)
I20260709 13:03:56.485683 10721 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.487977 10721 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:56.501453 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.485352 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:56.504700 10249 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.509949 10398 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 2.
I20260709 13:03:56.516356 10289 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:56.522575 10444 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:56.523140 10444 ts_tablet_manager.cc:1403] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.331s	user 0.017s	sys 0.009s
I20260709 13:03:56.521999 10721 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:56.566061 10721 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4b5b492fca940a3883a22eec56a4f9f)
I20260709 13:03:56.566534 10721 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:56.564075 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:56.603083 10739 raft_consensus.cc:493] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.607393 10739 raft_consensus.cc:515] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.610003 10739 leader_election.cc:290] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.612766 10249 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:56.615502 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:03:56.619176 10289 leader_election.cc:343] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.619194 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:56.622133 10170 raft_consensus.cc:2393] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 2: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:56.621996 10721 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:56.624439 10287 leader_election.cc:343] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.625066 10287 leader_election.cc:304] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:56.626281 10639 raft_consensus.cc:2749] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.631032 10443 raft_consensus.cc:359] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.631865 10443 raft_consensus.cc:385] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.661645 10443 raft_consensus.cc:740] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.662483 10443 consensus_queue.cc:260] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
W20260709 13:03:56.664134 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 95665.9us
I20260709 13:03:56.635443 10445 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:56.668185 10445 ts_tablet_manager.cc:1403] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.350s	user 0.019s	sys 0.012s
I20260709 13:03:56.670264 10443 ts_tablet_manager.cc:1434] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.209s	user 0.006s	sys 0.005s
I20260709 13:03:56.671280 10443 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:56.673239 10070 catalog_manager.cc:5697] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.636770 10071 catalog_manager.cc:5697] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.667927 10444 raft_consensus.cc:359] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.677017 10444 raft_consensus.cc:385] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.677307 10444 raft_consensus.cc:740] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.678059 10444 consensus_queue.cc:260] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.679826 10444 ts_tablet_manager.cc:1434] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.000s
I20260709 13:03:56.680807 10444 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:56.688138 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:56.678833 10445 raft_consensus.cc:359] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.691035 10445 raft_consensus.cc:385] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.676704 10639 consensus_queue.cc:1048] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:03:56.694423 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:56.691447 10445 raft_consensus.cc:740] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.700245 10445 consensus_queue.cc:260] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.703102 10785 raft_consensus.cc:493] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.655857 10766 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.656615 10446 raft_consensus.cc:359] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.708277 10446 raft_consensus.cc:385] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.624413 10721 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:56.708657 10446 raft_consensus.cc:740] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.709096 10766 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.709470 10446 consensus_queue.cc:260] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.710242 10172 raft_consensus.cc:2393] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 2: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:56.711627 10446 ts_tablet_manager.cc:1434] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.244s	user 0.001s	sys 0.006s
I20260709 13:03:56.711913 10766 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.708588 10072 catalog_manager.cc:5697] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.703667 10785 raft_consensus.cc:515] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.717303 10785 leader_election.cc:290] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.718118 10446 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:56.708745 10445 ts_tablet_manager.cc:1434] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 13:03:56.719997 10445 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:56.721804 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:56.722822 10321 raft_consensus.cc:2410] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e8e4753ffb400b8e90eaff84fc1f10 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:03:56.724613 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:03:56.728193 10137 leader_election.cc:343] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.734612 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.741240 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.743355 10140 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:56.745186 10443 tablet_bootstrap.cc:654] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.746536 10567 raft_consensus.cc:2749] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:56.749341 10140 leader_election.cc:343] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.750689 10445 tablet_bootstrap.cc:654] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.751593 10444 tablet_bootstrap.cc:654] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.754441 10140 leader_election.cc:304] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:56.759924 10446 tablet_bootstrap.cc:654] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.734133 10394 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 2.
I20260709 13:03:56.768667 10289 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:56.773017 10567 raft_consensus.cc:2749] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.786723 10721 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.787324 10721 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.794582 10721 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:56.797387 10173 raft_consensus.cc:3060] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.804760 10444 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:56.805281 10444 ts_tablet_manager.cc:1403] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.006s
I20260709 13:03:56.805696 10446 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:56.806280 10446 ts_tablet_manager.cc:1403] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.002s
I20260709 13:03:56.802301 10723 raft_consensus.cc:493] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.808072 10444 raft_consensus.cc:359] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.808787 10444 raft_consensus.cc:385] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.808749 10723 raft_consensus.cc:515] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.811887 10723 leader_election.cc:290] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:56.812127 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:56.812458 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:56.809234 10444 raft_consensus.cc:740] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.813544 10444 consensus_queue.cc:260] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:03:56.814451 10364 leader_election.cc:343] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:56.815996 10362 leader_election.cc:343] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.816092 10444 ts_tablet_manager.cc:1434] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:56.817116 10362 leader_election.cc:304] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:56.819058 10789 raft_consensus.cc:2749] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.802398 10739 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:56.820405 10640 consensus_queue.cc:1048] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.821655 10444 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:56.822307 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:56.822585 10739 raft_consensus.cc:697] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:56.830245 10443 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:56.831458 10443 ts_tablet_manager.cc:1403] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.008s
I20260709 13:03:56.829808 10739 consensus_queue.cc:237] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.822307 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.822299 10721 consensus_queue.cc:1048] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.835379 10444 tablet_bootstrap.cc:654] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:56.839008 10289 leader_election.cc:343] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.840699 10445 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:56.841195 10445 ts_tablet_manager.cc:1403] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.027s
I20260709 13:03:56.843777 10445 raft_consensus.cc:359] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.844611 10445 raft_consensus.cc:385] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.844919 10445 raft_consensus.cc:740] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.845566 10445 consensus_queue.cc:260] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.846825 10444 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:56.847366 10444 ts_tablet_manager.cc:1403] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.007s
I20260709 13:03:56.847226 10446 raft_consensus.cc:359] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.847983 10446 raft_consensus.cc:385] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.848272 10446 raft_consensus.cc:740] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.850414 10445 ts_tablet_manager.cc:1434] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:56.850764 10444 raft_consensus.cc:359] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.851548 10444 raft_consensus.cc:385] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.838562 10443 raft_consensus.cc:359] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.852358 10443 raft_consensus.cc:385] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.852840 10443 raft_consensus.cc:740] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.853654 10443 consensus_queue.cc:260] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.855868 10443 ts_tablet_manager.cc:1434] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:03:56.857105 10443 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:56.860677 10739 consensus_queue.cc:1048] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.851972 10444 raft_consensus.cc:740] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.863510 10444 consensus_queue.cc:260] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.861783 10446 consensus_queue.cc:260] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
W20260709 13:03:56.864609 10289 leader_election.cc:343] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.865119 10289 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:56.866148 10446 ts_tablet_manager.cc:1434] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:03:56.868029 10444 ts_tablet_manager.cc:1434] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:03:56.868906 10739 raft_consensus.cc:2749] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.869964 10446 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:56.851502 10445 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:56.877570 10446 tablet_bootstrap.cc:654] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.869118 10444 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:56.889317 10445 tablet_bootstrap.cc:654] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.900981 10443 tablet_bootstrap.cc:654] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.888643 10070 catalog_manager.cc:5697] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 1 to 2, leader changed from c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196) to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.903139 10444 tablet_bootstrap.cc:654] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.923007 10446 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:56.924160 10444 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:56.924822 10444 ts_tablet_manager.cc:1403] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.007s
I20260709 13:03:56.924863 10446 ts_tablet_manager.cc:1403] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.014s
I20260709 13:03:56.928884 10446 raft_consensus.cc:359] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.929101 10445 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:56.929078 10444 raft_consensus.cc:359] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.930022 10444 raft_consensus.cc:385] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.930119 10445 ts_tablet_manager.cc:1403] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.004s
I20260709 13:03:56.930356 10444 raft_consensus.cc:740] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.929711 10446 raft_consensus.cc:385] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.933023 10446 raft_consensus.cc:740] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.933283 10445 raft_consensus.cc:359] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.934160 10445 raft_consensus.cc:385] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.934460 10445 raft_consensus.cc:740] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.935570 10443 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:56.935103 10446 consensus_queue.cc:260] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.935165 10445 consensus_queue.cc:260] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:56.936082 10443 ts_tablet_manager.cc:1403] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.009s
I20260709 13:03:56.938247 10444 consensus_queue.cc:260] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:56.941700 10443 raft_consensus.cc:359] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.942605 10557 raft_consensus.cc:493] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.945012 10443 raft_consensus.cc:385] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.945397 10443 raft_consensus.cc:740] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.946233 10443 consensus_queue.cc:260] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:56.947772 10443 ts_tablet_manager.cc:1434] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:03:56.948756 10443 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:56.949417 10445 ts_tablet_manager.cc:1434] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:03:56.950455 10445 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:56.950832 10785 consensus_queue.cc:1048] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.954787 10443 tablet_bootstrap.cc:654] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.944227 10444 ts_tablet_manager.cc:1434] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:03:56.959712 10444 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:56.969441 10445 tablet_bootstrap.cc:654] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.971843 10446 ts_tablet_manager.cc:1434] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:03:56.972991 10446 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:56.945276 10557 raft_consensus.cc:515] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:56.987306 10557 leader_election.cc:290] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:56.989279 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27c8a705d134d5f96385dc1ed5aaa3d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:56.990051 10394 raft_consensus.cc:2468] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:56.995477 10445 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:56.996100 10445 ts_tablet_manager.cc:1403] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.010s
I20260709 13:03:56.997359 10215 leader_election.cc:304] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:56.998025 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27c8a705d134d5f96385dc1ed5aaa3d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:56.998600 10644 raft_consensus.cc:2804] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.999280 10644 raft_consensus.cc:493] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.999637 10644 raft_consensus.cc:3060] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.001538 10212 leader_election.cc:343] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.007572 10723 consensus_queue.cc:1048] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:57.013204 10789 consensus_queue.cc:1048] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.015431 10446 tablet_bootstrap.cc:654] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.017903 10445 raft_consensus.cc:359] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.018675 10445 raft_consensus.cc:385] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.018944 10445 raft_consensus.cc:740] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.986200 10725 consensus_queue.cc:1048] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:03:57.020153 10644 raft_consensus.cc:515] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.021462 10445 consensus_queue.cc:260] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.025977 10444 tablet_bootstrap.cc:654] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.030897 10443 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:57.031476 10443 ts_tablet_manager.cc:1403] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.009s
I20260709 13:03:57.033721 10445 ts_tablet_manager.cc:1434] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:03:57.037667 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27c8a705d134d5f96385dc1ed5aaa3d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.037629 10779 consensus_queue.cc:1048] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:57.038889 10443 raft_consensus.cc:359] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.039618 10443 raft_consensus.cc:385] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:57.039721 10212 leader_election.cc:343] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.039924 10443 raft_consensus.cc:740] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.034981 10445 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:57.040513 10725 raft_consensus.cc:493] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.041078 10725 raft_consensus.cc:515] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.045485 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4d416a3b0a41bb80cd831c381eb1bf" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.051046 10323 raft_consensus.cc:2468] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:57.051414 10725 leader_election.cc:290] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.053828 10212 leader_election.cc:304] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:57.049549 10443 consensus_queue.cc:260] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.058246 10725 raft_consensus.cc:2804] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.058672 10725 raft_consensus.cc:493] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.059054 10725 raft_consensus.cc:3060] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.062716 10446 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:57.063321 10723 raft_consensus.cc:493] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.063926 10723 raft_consensus.cc:515] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.063284 10446 ts_tablet_manager.cc:1403] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.002s
I20260709 13:03:57.063373 10644 leader_election.cc:290] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.066238 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4d416a3b0a41bb80cd831c381eb1bf" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.067315 10723 leader_election.cc:290] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:57.068415 10637 consensus_queue.cc:1048] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:57.069458 10215 leader_election.cc:343] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.069955 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:57.071333 10364 leader_election.cc:343] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.074452 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:57.075860 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27c8a705d134d5f96385dc1ed5aaa3d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
W20260709 13:03:57.076048 10362 leader_election.cc:343] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.076557 10362 leader_election.cc:304] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:57.079087 10789 raft_consensus.cc:2749] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.076550 10394 raft_consensus.cc:3060] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.097206 10443 ts_tablet_manager.cc:1434] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:03:57.093014 10779 raft_consensus.cc:493] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.105880 10443 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:57.105489 10446 raft_consensus.cc:359] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.108456 10446 raft_consensus.cc:385] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.108785 10446 raft_consensus.cc:740] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.111864 10779 raft_consensus.cc:515] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.114428 10779 leader_election.cc:290] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:57.117535 10445 tablet_bootstrap.cc:654] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:57.120216 10827 log.cc:927] Time spent T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:57.124264 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.126108 10444 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:57.129810 10444 ts_tablet_manager.cc:1403] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.002s
I20260709 13:03:57.129938 10446 consensus_queue.cc:260] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:57.131044 10215 leader_election.cc:343] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.136397 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.137310 10321 raft_consensus.cc:2468] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:57.138691 10212 leader_election.cc:304] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:57.143215 10725 raft_consensus.cc:515] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.144677 10557 raft_consensus.cc:2804] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.153774 10557 raft_consensus.cc:493] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.154179 10557 raft_consensus.cc:3060] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.133998 10394 raft_consensus.cc:2468] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:57.209977 10567 raft_consensus.cc:493] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.223299 10567 raft_consensus.cc:515] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:57.295836 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35805, user_credentials={real_user=slave}} blocked reactor thread for 150820us
I20260709 13:03:57.296882 10215 leader_election.cc:304] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:57.307114 10446 ts_tablet_manager.cc:1434] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.242s	user 0.011s	sys 0.009s
I20260709 13:03:57.308641 10446 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:57.328795 10639 raft_consensus.cc:493] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.329358 10639 raft_consensus.cc:515] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.331431 10639 leader_election.cc:290] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.333320 10835 raft_consensus.cc:2804] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.333884 10835 raft_consensus.cc:697] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:57.334231 10557 raft_consensus.cc:515] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.334705 10835 consensus_queue.cc:237] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.322571 10785 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.337066 10725 leader_election.cc:290] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.336858 10785 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.339890 10567 leader_election.cc:290] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.340524 10785 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.341078 10785 raft_consensus.cc:493] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.341499 10785 raft_consensus.cc:515] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.344046 10444 raft_consensus.cc:359] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.344944 10444 raft_consensus.cc:385] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.345239 10444 raft_consensus.cc:740] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.346701 10444 consensus_queue.cc:260] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:57.367772 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:57.370236 10444 ts_tablet_manager.cc:1434] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.240s	user 0.003s	sys 0.023s
I20260709 13:03:57.336463 10557 leader_election.cc:290] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:57.384547 10785 leader_election.cc:290] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:57.385656 10446 tablet_bootstrap.cc:654] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.371054 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4d416a3b0a41bb80cd831c381eb1bf" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:57.372093 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:57.395234 10445 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:57.401165 10445 ts_tablet_manager.cc:1403] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.366s	user 0.027s	sys 0.016s
I20260709 13:03:57.373756 10537 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.417604 10215 leader_election.cc:343] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.420958 10443 tablet_bootstrap.cc:654] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:57.422966 10215 leader_election.cc:343] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.417549 10513 raft_consensus.cc:493] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.424516 10444 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:57.408779 10537 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.432535 10445 raft_consensus.cc:359] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.434517 10445 raft_consensus.cc:385] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.434846 10445 raft_consensus.cc:740] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.444054 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.437675 10445 consensus_queue.cc:260] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.428321 10513 raft_consensus.cc:515] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.472476 10445 ts_tablet_manager.cc:1434] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 13:03:57.457245 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.475343 10445 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:57.465307 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.473443 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.495208 10322 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:57.497931 10444 tablet_bootstrap.cc:654] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.500758 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.501888 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.491372 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:57.502789 10397 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
W20260709 13:03:57.513183 10140 leader_election.cc:343] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.513986 10140 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
W20260709 13:03:57.518189 10289 leader_election.cc:343] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.500820 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.562678 10637 raft_consensus.cc:2804] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.599921 10637 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.564946 10320 raft_consensus.cc:2468] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:57.600975 10637 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.627338 10835 raft_consensus.cc:493] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.641670 10137 leader_election.cc:343] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.642627 10137 leader_election.cc:304] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:57.644428 10513 leader_election.cc:290] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.665104 10396 raft_consensus.cc:1275] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer b7e7b27d524749fbbbc0fa9855c2c5d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.669226 10446 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:57.669806 10446 ts_tablet_manager.cc:1403] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.361s	user 0.041s	sys 0.036s
I20260709 13:03:57.670403 10445 tablet_bootstrap.cc:654] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.670619 10173 raft_consensus.cc:1275] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Refusing update from remote peer b7e7b27d524749fbbbc0fa9855c2c5d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.673929 10446 raft_consensus.cc:359] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.675331 10446 raft_consensus.cc:385] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:57.665707 10289 leader_election.cc:343] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.677623 10289 leader_election.cc:304] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:57.675693 10446 raft_consensus.cc:740] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.680576 10446 consensus_queue.cc:260] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.682282 10443 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:57.683174 10443 ts_tablet_manager.cc:1403] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.580s	user 0.032s	sys 0.025s
I20260709 13:03:57.686167 10444 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:57.686762 10444 ts_tablet_manager.cc:1403] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.262s	user 0.010s	sys 0.008s
I20260709 13:03:57.688195 10443 raft_consensus.cc:359] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.689025 10443 raft_consensus.cc:385] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.689306 10443 raft_consensus.cc:740] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.689682 10444 raft_consensus.cc:359] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.690481 10444 raft_consensus.cc:385] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.690760 10444 raft_consensus.cc:740] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.690966 10860 raft_consensus.cc:2749] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.691536 10137 leader_election.cc:304] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:57.691942 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.692263 10444 consensus_queue.cc:260] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.692960 10172 raft_consensus.cc:2468] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:57.648340 10835 raft_consensus.cc:515] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.694083 10443 consensus_queue.cc:260] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:57.661137 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 89056.9us
I20260709 13:03:57.693329 10860 raft_consensus.cc:2804] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.697984 10364 leader_election.cc:304] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:57.698485 10537 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.699065 10537 raft_consensus.cc:2804] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.699430 10537 raft_consensus.cc:493] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.700147 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.698525 10860 raft_consensus.cc:493] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.701404 10860 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.701877 10446 ts_tablet_manager.cc:1434] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:03:57.703015 10446 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:57.707300 10444 ts_tablet_manager.cc:1434] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:03:57.708386 10444 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:57.709450 10446 tablet_bootstrap.cc:654] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.709219 10070 catalog_manager.cc:5697] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.711122 10860 raft_consensus.cc:515] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.713351 10443 ts_tablet_manager.cc:1434] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:03:57.714574 10443 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:57.721747 10444 tablet_bootstrap.cc:654] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.733048 10446 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:57.733644 10446 ts_tablet_manager.cc:1403] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:03:57.738453 10446 raft_consensus.cc:359] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.739542 10446 raft_consensus.cc:385] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.739809 10446 raft_consensus.cc:740] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.740599 10446 consensus_queue.cc:260] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.743122 10446 ts_tablet_manager.cc:1434] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:03:57.744035 10446 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:57.747584 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.748373 10398 raft_consensus.cc:2468] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:57.750322 10444 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:57.750969 10444 ts_tablet_manager.cc:1403] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.007s
I20260709 13:03:57.751638 10446 tablet_bootstrap.cc:654] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.757107 10446 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:57.757581 10446 ts_tablet_manager.cc:1403] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:03:57.760421 10446 raft_consensus.cc:359] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.761119 10446 raft_consensus.cc:385] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.761487 10446 raft_consensus.cc:740] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.762264 10446 consensus_queue.cc:260] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.764271 10446 ts_tablet_manager.cc:1434] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
W20260709 13:03:57.765643 10289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35853, user_credentials={real_user=slave}} blocked reactor thread for 47609.3us
I20260709 13:03:57.770251 10446 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:57.717422 10537 raft_consensus.cc:3060] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.777891 10637 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.773577 10855 raft_consensus.cc:2749] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.780305 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.789539 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4d416a3b0a41bb80cd831c381eb1bf" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.780776 10172 raft_consensus.cc:2393] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in this term.
I20260709 13:03:57.784422 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.791177 10323 raft_consensus.cc:3060] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.790340 10853 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:03:57.802030 10835 leader_election.cc:290] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.803532 10537 raft_consensus.cc:515] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.789451 10860 leader_election.cc:290] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:57.805773 10537 leader_election.cc:290] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.810016 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:57.810694 10396 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.812480 10739 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.811956 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.814643 10320 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.816207 10314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.816506 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:57.816891 10314 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.818912 10173 raft_consensus.cc:3060] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.826948 10444 raft_consensus.cc:359] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:57.827797 10444 raft_consensus.cc:385] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.828074 10444 raft_consensus.cc:740] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.807929 10323 raft_consensus.cc:2468] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:57.828768 10215 leader_election.cc:304] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:57.842056 10835 raft_consensus.cc:2804] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.842470 10835 raft_consensus.cc:493] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.842792 10835 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.844933 10212 leader_election.cc:304] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:57.845986 10557 raft_consensus.cc:2804] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.846477 10557 raft_consensus.cc:697] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:57.788041 10637 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:57.847297 10557 consensus_queue.cc:237] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.847267 10445 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:57.849067 10445 ts_tablet_manager.cc:1403] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.374s	user 0.014s	sys 0.001s
I20260709 13:03:57.844985 10315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e7f66e663495dac8f9b10d847b0f6" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:57.858398 10443 tablet_bootstrap.cc:654] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.859293 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.838428 10322 raft_consensus.cc:3060] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.862107 10444 consensus_queue.cc:260] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:03:57.834847 10287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 52409.9us
I20260709 13:03:57.875634 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:57.861563 10361 leader_election.cc:343] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:57.879047 10215 leader_election.cc:343] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.883468 10445 raft_consensus.cc:359] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.886333 10445 raft_consensus.cc:385] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.886674 10445 raft_consensus.cc:740] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.887218 10445 consensus_queue.cc:260] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:03:57.893821 10361 leader_election.cc:343] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.894714 10361 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:57.895434 10513 raft_consensus.cc:493] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.895974 10513 raft_consensus.cc:515] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.900664 10444 ts_tablet_manager.cc:1434] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.002s
I20260709 13:03:57.905289 10513 leader_election.cc:290] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.908877 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:57.909749 10321 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:57.911506 10361 leader_election.cc:304] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:57.913530 10842 raft_consensus.cc:2804] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.914003 10842 raft_consensus.cc:493] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.914376 10842 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.917006 10444 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:57.913635 10445 ts_tablet_manager.cc:1434] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:03:57.919581 10445 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
W20260709 13:03:57.922513 10212 consensus_peers.cc:597] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:57.925473 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.926369 10170 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:57.933842 10835 raft_consensus.cc:515] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:57.934427 10138 leader_election.cc:343] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.898869 10173 raft_consensus.cc:2468] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:57.938822 10364 leader_election.cc:304] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:57.939580 10850 raft_consensus.cc:493] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.940104 10513 raft_consensus.cc:2804] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.940155 10850 raft_consensus.cc:515] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:57.940851 10513 raft_consensus.cc:697] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:57.941761 10513 consensus_queue.cc:237] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.942457 10850 leader_election.cc:290] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.943025 10850 consensus_queue.cc:1048] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.944482 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:57.944667 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:57.945197 10249 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.935935 10396 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:57.946825 10537 raft_consensus.cc:2749] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.949374 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:57.950974 10140 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:57.951217 10173 raft_consensus.cc:2468] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:57.952679 10766 raft_consensus.cc:2804] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.953266 10766 raft_consensus.cc:697] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:57.936033 10835 leader_election.cc:290] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:57.954113 10766 consensus_queue.cc:237] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:57.958871 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:57.959682 10394 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.961292 10215 leader_election.cc:343] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.963744 10215 leader_election.cc:304] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:57.968405 10445 tablet_bootstrap.cc:654] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.969046 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:57.965824 10320 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:57.972379 10443 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:57.973892 10443 ts_tablet_manager.cc:1403] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.260s	user 0.013s	sys 0.002s
W20260709 13:03:57.976541 10215 leader_election.cc:343] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.977238 10835 raft_consensus.cc:2804] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.991703 10444 tablet_bootstrap.cc:654] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.999429 10446 tablet_bootstrap.cc:654] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.006172 10443 raft_consensus.cc:359] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.011274 10443 raft_consensus.cc:385] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.011636 10443 raft_consensus.cc:740] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.997311 10835 raft_consensus.cc:493] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.022631 10443 consensus_queue.cc:260] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:57.993724 10842 raft_consensus.cc:515] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.016484 10835 raft_consensus.cc:3060] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.021956 10322 raft_consensus.cc:2468] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:58.062850 10443 ts_tablet_manager.cc:1434] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.001s
I20260709 13:03:58.068151 10443 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:58.061949 10394 raft_consensus.cc:2468] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:58.074350 10314 raft_consensus.cc:2468] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:58.080641 10834 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.124707 10215 leader_election.cc:304] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:03:58.125461 10445 tablet_bootstrap.cc:492] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:58.130190 10137 leader_election.cc:304] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:03:58.132861 10445 ts_tablet_manager.cc:1403] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.214s	user 0.027s	sys 0.004s
I20260709 13:03:58.133092 10212 leader_election.cc:304] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:58.137132 10072 catalog_manager.cc:5697] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.138543 10833 raft_consensus.cc:2804] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.155992 10833 raft_consensus.cc:697] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:58.156961 10833 consensus_queue.cc:237] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.160946 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:58.161592 10170 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.128052 10834 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.164429 10445 raft_consensus.cc:359] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.165246 10445 raft_consensus.cc:385] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.146730 10842 leader_election.cc:290] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.165544 10445 raft_consensus.cc:740] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.166358 10834 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:58.166224 10445 consensus_queue.cc:260] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.167786 10445 ts_tablet_manager.cc:1434] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.000s
I20260709 13:03:58.170660 10249 raft_consensus.cc:2468] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:58.172044 10443 tablet_bootstrap.cc:654] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.172173 10444 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:58.172770 10444 ts_tablet_manager.cc:1403] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.256s	user 0.024s	sys 0.017s
I20260709 13:03:58.145138 10314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:58.173678 10314 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.175541 10444 raft_consensus.cc:359] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.176259 10444 raft_consensus.cc:385] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.176558 10444 raft_consensus.cc:740] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.177449 10444 consensus_queue.cc:260] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.178989 10835 raft_consensus.cc:515] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.181221 10835 leader_election.cc:290] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.134756 10637 raft_consensus.cc:2804] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.140924 10557 raft_consensus.cc:2804] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.187346 10637 raft_consensus.cc:697] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:58.189610 10557 raft_consensus.cc:697] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
W20260709 13:03:58.197224 10212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 63020.1us
I20260709 13:03:58.209776 10855 raft_consensus.cc:493] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.210338 10855 raft_consensus.cc:515] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.212975 10855 leader_election.cc:290] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:58.206514 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:58.214735 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:58.215193 10446 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:58.215694 10446 ts_tablet_manager.cc:1403] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.451s	user 0.021s	sys 0.001s
I20260709 13:03:58.216374 10396 raft_consensus.cc:2468] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 0.
I20260709 13:03:58.225693 10446 raft_consensus.cc:359] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.221637 10557 consensus_queue.cc:237] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.220472 10637 consensus_queue.cc:237] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.238608 10289 leader_election.cc:304] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:58.242969 10855 raft_consensus.cc:2804] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.245801 10855 raft_consensus.cc:493] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.246196 10855 raft_consensus.cc:3060] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.247865 10446 raft_consensus.cc:385] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.248229 10446 raft_consensus.cc:740] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.248998 10446 consensus_queue.cc:260] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:03:58.251796 10212 leader_election.cc:343] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:58.258311 10215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35853, user_credentials={real_user=slave}} blocked reactor thread for 96081us
I20260709 13:03:58.262599 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:58.265556 10446 ts_tablet_manager.cc:1434] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:03:58.266659 10446 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: Bootstrap starting.
I20260709 13:03:58.266985 10445 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:58.268704 10071 catalog_manager.cc:5697] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.273263 10314 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:58.293140 10361 leader_election.cc:304] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:58.293740 10445 tablet_bootstrap.cc:654] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.294211 10857 raft_consensus.cc:2804] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.294802 10857 raft_consensus.cc:697] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:58.265574 10443 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:58.295732 10857 consensus_queue.cc:237] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.281740 10850 raft_consensus.cc:493] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.299705 10850 raft_consensus.cc:515] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.301829 10850 leader_election.cc:290] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.280913 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:58.296339 10443 ts_tablet_manager.cc:1403] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.228s	user 0.011s	sys 0.003s
I20260709 13:03:58.298919 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:58.304183 10287 leader_election.cc:343] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.307425 10446 tablet_bootstrap.cc:654] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.256016 10170 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:58.314177 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:58.314781 10172 raft_consensus.cc:3060] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.314857 10443 raft_consensus.cc:359] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.315956 10443 raft_consensus.cc:385] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.316246 10443 raft_consensus.cc:740] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.316912 10443 consensus_queue.cc:260] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.320212 10443 ts_tablet_manager.cc:1434] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:58.320236 10072 catalog_manager.cc:5697] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.326963 10172 raft_consensus.cc:2468] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:58.336759 10443 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:58.338732 10855 raft_consensus.cc:515] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.341818 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:58.342196 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:58.342540 10396 raft_consensus.cc:3060] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.344688 10287 leader_election.cc:343] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.345129 10446 tablet_bootstrap.cc:492] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: No bootstrap required, opened a new log
I20260709 13:03:58.345650 10446 ts_tablet_manager.cc:1403] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.009s
I20260709 13:03:58.356618 10443 tablet_bootstrap.cc:654] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.356541 10446 raft_consensus.cc:359] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.358556 10446 raft_consensus.cc:385] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.358845 10446 raft_consensus.cc:740] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.359582 10446 consensus_queue.cc:260] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.360146 10396 raft_consensus.cc:2468] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:03:58.361451 10289 leader_election.cc:304] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: caa864648e614090be53d8ece3cd29b7
I20260709 13:03:58.313303 10071 catalog_manager.cc:5697] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.364904 10841 raft_consensus.cc:2804] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.365408 10841 raft_consensus.cc:697] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:03:58.367789 10855 leader_election.cc:290] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:58.368037 10443 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:58.368374 10446 ts_tablet_manager.cc:1434] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:03:58.368579 10443 ts_tablet_manager.cc:1403] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.011s
I20260709 13:03:58.366204 10841 consensus_queue.cc:237] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.371692 10443 raft_consensus.cc:359] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.372478 10443 raft_consensus.cc:385] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.372761 10443 raft_consensus.cc:740] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.373692 10443 consensus_queue.cc:260] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.381778 10445 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:58.382372 10445 ts_tablet_manager.cc:1403] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.001s
I20260709 13:03:58.379235 10443 ts_tablet_manager.cc:1434] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:58.387502 10443 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:03:58.394265 10215 leader_election.cc:343] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.394763 10215 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:03:58.395829 10215 leader_election.cc:304] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:58.395931 10850 raft_consensus.cc:2749] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.396330 10443 tablet_bootstrap.cc:654] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.404217 10885 raft_consensus.cc:2804] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:58.404539 10215 leader_election.cc:343] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.404747 10885 raft_consensus.cc:697] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:58.405328 10320 raft_consensus.cc:3060] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.405838 10885 consensus_queue.cc:237] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.409942 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:58.410614 10393 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:58.403855 10444 ts_tablet_manager.cc:1434] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.231s	user 0.052s	sys 0.032s
I20260709 13:03:58.401690 10445 raft_consensus.cc:359] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.413946 10445 raft_consensus.cc:385] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.414242 10445 raft_consensus.cc:740] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.411952 10444 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:58.425045 10070 catalog_manager.cc:5697] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.426331 10445 consensus_queue.cc:260] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.430610 10445 ts_tablet_manager.cc:1434] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
W20260709 13:03:58.432524 10137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 52996.4us
I20260709 13:03:58.434468 10850 consensus_queue.cc:1048] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.435992 10861 raft_consensus.cc:493] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.442523 10861 raft_consensus.cc:515] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.444702 10861 leader_election.cc:290] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:58.441071 10444 tablet_bootstrap.cc:654] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.445365 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:58.447770 10887 raft_consensus.cc:493] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.450019 10887 raft_consensus.cc:515] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.441253 10445 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: Bootstrap starting.
I20260709 13:03:58.452725 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:58.453346 10322 raft_consensus.cc:2468] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 0.
I20260709 13:03:58.454577 10361 leader_election.cc:304] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:58.457764 10444 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:58.449070 10072 catalog_manager.cc:5697] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.458250 10444 ts_tablet_manager.cc:1403] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.004s
I20260709 13:03:58.460667 10215 leader_election.cc:304] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:58.460896 10444 raft_consensus.cc:359] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.456887 10887 leader_election.cc:290] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.461587 10444 raft_consensus.cc:385] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.448009 10443 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
I20260709 13:03:58.462271 10443 ts_tablet_manager.cc:1403] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.002s
I20260709 13:03:58.462571 10557 raft_consensus.cc:2804] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.462970 10557 raft_consensus.cc:493] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.463271 10557 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.464499 10444 raft_consensus.cc:740] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.464745 10443 raft_consensus.cc:359] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.465358 10444 consensus_queue.cc:260] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.465409 10443 raft_consensus.cc:385] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.466102 10443 raft_consensus.cc:740] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.466692 10443 consensus_queue.cc:260] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.467461 10444 ts_tablet_manager.cc:1434] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:58.470844 10513 consensus_queue.cc:1048] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.472594 10443 ts_tablet_manager.cc:1434] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:58.474165 10443 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:03:58.474984 10444 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: Bootstrap starting.
I20260709 13:03:58.482507 10443 tablet_bootstrap.cc:654] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.488831 10557 raft_consensus.cc:515] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.492610 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
W20260709 13:03:58.494724 10137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 52637.4us
I20260709 13:03:58.456566 10857 raft_consensus.cc:2804] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.495105 10443 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: No bootstrap required, opened a new log
W20260709 13:03:58.511840 10364 leader_election.cc:343] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.512243 10443 ts_tablet_manager.cc:1403] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 13:03:58.514308 10557 leader_election.cc:290] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.515228 10443 raft_consensus.cc:359] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.499606 10444 tablet_bootstrap.cc:654] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.517370 10321 raft_consensus.cc:3060] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.517799 10857 raft_consensus.cc:493] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.518231 10857 raft_consensus.cc:3060] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.509251 10445 tablet_bootstrap.cc:654] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.509531 10887 raft_consensus.cc:493] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.528903 10172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:58.529685 10172 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 0.
I20260709 13:03:58.519526 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a00d13ac4c46b980527f87fe684f46" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:58.532819 10861 consensus_queue.cc:1048] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:58.506537 10215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35853, user_credentials={real_user=slave}} blocked reactor thread for 45937us
I20260709 13:03:58.538106 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:03:58.538733 10396 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.539549 10071 catalog_manager.cc:5697] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.541221 10513 consensus_queue.cc:1048] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.541185 10071 catalog_manager.cc:5697] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.542810 10071 catalog_manager.cc:5697] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.529457 10887 raft_consensus.cc:515] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.515903 10443 raft_consensus.cc:385] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.552331 10443 raft_consensus.cc:740] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.553196 10443 consensus_queue.cc:260] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.555603 10443 ts_tablet_manager.cc:1434] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:03:58.565874 10887 leader_election.cc:290] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:58.567603 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" is_pre_election: true
I20260709 13:03:58.568521 10174 raft_consensus.cc:2393] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b5b492fca940a3883a22eec56a4f9f in current term 1: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
I20260709 13:03:58.573676 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d884577f53054c19b81aad58eca5d459" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:58.575809 10444 tablet_bootstrap.cc:492] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: No bootstrap required, opened a new log
I20260709 13:03:58.580394 10170 raft_consensus.cc:3060] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.583411 10396 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:58.576442 10444 ts_tablet_manager.cc:1403] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.018s
I20260709 13:03:58.591331 10444 raft_consensus.cc:359] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.591511 10362 leader_election.cc:304] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:58.593425 10789 raft_consensus.cc:3060] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.601903 10444 raft_consensus.cc:385] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.602681 10215 leader_election.cc:304] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:58.603523 10883 raft_consensus.cc:2804] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.603909 10445 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: No bootstrap required, opened a new log
I20260709 13:03:58.604012 10883 raft_consensus.cc:697] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:03:58.605013 10883 consensus_queue.cc:237] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.606700 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:58.607363 10168 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.617092 10445 ts_tablet_manager.cc:1403] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.003s
I20260709 13:03:58.617285 10789 raft_consensus.cc:2749] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.618637 10637 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.619158 10637 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.602273 10444 raft_consensus.cc:740] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.621259 10637 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:03:58.620967 10444 consensus_queue.cc:260] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.616055 10168 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:03:58.620014 10445 raft_consensus.cc:359] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.624938 10445 raft_consensus.cc:385] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.624221 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:58.625399 10557 consensus_queue.cc:1048] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.625512 10249 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:58.627409 10857 raft_consensus.cc:515] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.628077 10138 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:58.631866 10861 raft_consensus.cc:2804] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.632372 10861 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.632771 10861 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.633308 10567 consensus_queue.cc:1048] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.636626 10137 leader_election.cc:304] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:58.638789 10170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
I20260709 13:03:58.647029 10170 raft_consensus.cc:3060] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.647190 10557 consensus_queue.cc:1048] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.635787 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a72a81e18bd4f33ab1f087ecbd1c83d" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:58.652500 10321 raft_consensus.cc:3060] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.659166 10170 raft_consensus.cc:2468] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:58.660609 10567 raft_consensus.cc:2749] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.696417 10396 raft_consensus.cc:3060] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.660789 10857 leader_election.cc:290] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:03:58.623818 10444 ts_tablet_manager.cc:1434] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 13:03:58.661761 10445 raft_consensus.cc:740] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.698475 10445 consensus_queue.cc:260] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.645521 10861 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.667928 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:58.700685 10320 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 0.
I20260709 13:03:58.674063 10321 raft_consensus.cc:2468] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:03:58.701915 10861 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
W20260709 13:03:58.678443 10120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:58.680058 10887 consensus_queue.cc:1048] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.704598 10445 ts_tablet_manager.cc:1434] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 13:03:58.702759 10361 leader_election.cc:304] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:03:58.707244 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:03:58.707913 10246 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.708987 10857 raft_consensus.cc:2804] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.709507 10857 raft_consensus.cc:697] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:03:58.709683 10861 consensus_queue.cc:1048] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.705932 10070 catalog_manager.cc:5697] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.715680 10857 consensus_queue.cc:237] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:03:58.715553 10246 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:58.717803 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:03:58.717929 10138 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:03:58.718405 10321 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.719566 10861 raft_consensus.cc:2804] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.720482 10861 raft_consensus.cc:697] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:03:58.721293 10861 consensus_queue.cc:237] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:03:58.725485 10321 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 1.
I20260709 13:03:58.729291 10883 consensus_queue.cc:1048] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.736299 10785 raft_consensus.cc:493] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.737025 10785 raft_consensus.cc:515] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:03:58.756748 10173 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.770833 10070 catalog_manager.cc:5697] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.780629 10883 raft_consensus.cc:493] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.781508 10883 raft_consensus.cc:515] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:03:58.787835 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:03:58.789804 10557 consensus_queue.cc:1048] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.791613 10637 consensus_queue.cc:1048] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.798681 10883 leader_election.cc:290] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:03:58.799718 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff683367d884f7799d765efa95a0c5a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:58.800630 10396 raft_consensus.cc:2393] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate caa864648e614090be53d8ece3cd29b7 in current term 1: Already voted for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in this term.
I20260709 13:03:58.802026 10215 leader_election.cc:304] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:03:58.803373 10557 raft_consensus.cc:3060] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.803731 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:03:58.811161 10557 raft_consensus.cc:2749] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.812968 10785 leader_election.cc:290] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:03:58.814203 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:03:58.816164 10138 leader_election.cc:304] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:03:58.830948 10887 consensus_queue.cc:1048] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.840433 10785 raft_consensus.cc:2749] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.844985 10557 consensus_queue.cc:1048] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.849188 10855 consensus_queue.cc:1048] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.865841 10848 consensus_queue.cc:1048] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.868806 10072 catalog_manager.cc:5697] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.880739 10557 consensus_queue.cc:1048] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.907599 10883 consensus_queue.cc:1048] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.077653 10885 consensus_queue.cc:1048] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.111197 10916 consensus_queue.cc:1048] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.121625 10557 consensus_queue.cc:1048] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.153975 10637 consensus_queue.cc:1048] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.219061 10857 consensus_queue.cc:1048] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.290786 10887 consensus_queue.cc:1048] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.309285   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:59.314178 10215 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 367 similar messages]
W20260709 13:03:59.321386 10215 consensus_peers.cc:597] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.336668 10215 consensus_peers.cc:597] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.345216 10364 consensus_peers.cc:597] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.361726 10215 consensus_peers.cc:597] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.362439 10215 consensus_peers.cc:597] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.365289 10364 consensus_peers.cc:597] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.372341   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:59.373816   431 tablet_replica.cc:333] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.375335   431 raft_consensus.cc:2243] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.376108   431 raft_consensus.cc:2272] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.379611   431 tablet_replica.cc:333] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.380707   431 raft_consensus.cc:2243] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.381304   431 raft_consensus.cc:2272] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.385437   431 tablet_replica.cc:333] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.386577   431 raft_consensus.cc:2243] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.387224   431 raft_consensus.cc:2272] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.389957   431 tablet_replica.cc:333] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.390625   431 raft_consensus.cc:2243] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.391455   431 raft_consensus.cc:2272] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.393999   431 tablet_replica.cc:333] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.394956   431 raft_consensus.cc:2243] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.395685   431 raft_consensus.cc:2272] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.398072 10215 consensus_peers.cc:597] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.401451   431 tablet_replica.cc:333] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.402148   431 raft_consensus.cc:2243] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.402675   431 raft_consensus.cc:2272] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.406397   431 tablet_replica.cc:333] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.407253   431 raft_consensus.cc:2243] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.408144   431 raft_consensus.cc:2272] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.410754 10289 consensus_peers.cc:597] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.411409   431 tablet_replica.cc:333] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.412043   431 raft_consensus.cc:2243] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.412635   431 raft_consensus.cc:2272] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.415117   431 tablet_replica.cc:333] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.415923   431 raft_consensus.cc:2243] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.416543   431 raft_consensus.cc:2272] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.419489 10215 consensus_peers.cc:597] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.419545   431 tablet_replica.cc:333] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.420461   431 raft_consensus.cc:2243] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.421214   431 raft_consensus.cc:2272] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.423840   431 tablet_replica.cc:333] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.424427   431 raft_consensus.cc:2243] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.424852   431 raft_consensus.cc:2272] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.426698   431 tablet_replica.cc:333] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.427227   431 raft_consensus.cc:2243] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.427601   431 raft_consensus.cc:2272] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.429685   431 tablet_replica.cc:333] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.430222   431 raft_consensus.cc:2243] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.430663   431 raft_consensus.cc:2272] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.432868   431 tablet_replica.cc:333] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.433594   431 raft_consensus.cc:2243] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.434149   431 raft_consensus.cc:2272] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.436930   431 tablet_replica.cc:333] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.437686   431 raft_consensus.cc:2243] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.438373   431 raft_consensus.cc:2272] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.441190   431 tablet_replica.cc:333] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.441937   431 raft_consensus.cc:2243] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.443104   431 raft_consensus.cc:2272] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.446074   431 tablet_replica.cc:333] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
W20260709 13:03:59.446100 10364 consensus_peers.cc:597] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.446762   431 raft_consensus.cc:2243] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.447279   431 raft_consensus.cc:2272] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.450385   431 tablet_replica.cc:333] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.451171   431 raft_consensus.cc:2243] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.451894   431 raft_consensus.cc:2272] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.453455 10215 consensus_peers.cc:597] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.455024   431 tablet_replica.cc:333] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.455974   431 raft_consensus.cc:2243] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.457314   431 raft_consensus.cc:2272] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.460392   431 tablet_replica.cc:333] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
W20260709 13:03:59.460824 10364 consensus_peers.cc:597] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.461237   431 raft_consensus.cc:2243] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.461875   431 raft_consensus.cc:2272] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.465463   431 tablet_replica.cc:333] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.466166   431 raft_consensus.cc:2243] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:59.467128 10289 consensus_peers.cc:597] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.467432   431 raft_consensus.cc:2272] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.470824   431 tablet_replica.cc:333] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.471684   431 raft_consensus.cc:2243] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.472242   431 raft_consensus.cc:2272] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.475587   431 tablet_replica.cc:333] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.476297   431 raft_consensus.cc:2243] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.477680   431 raft_consensus.cc:2272] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.480870   431 tablet_replica.cc:333] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.481758   431 raft_consensus.cc:2243] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.482690   431 raft_consensus.cc:2272] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.485776   431 tablet_replica.cc:333] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.486595   431 raft_consensus.cc:2243] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:59.488088 10364 consensus_peers.cc:597] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.488101   431 raft_consensus.cc:2272] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.491994   431 tablet_replica.cc:333] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.492925   431 raft_consensus.cc:2243] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.493530   431 raft_consensus.cc:2272] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.496582   431 tablet_replica.cc:333] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.497495   431 raft_consensus.cc:2243] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.498145   431 raft_consensus.cc:2272] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.501487   431 tablet_replica.cc:333] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.502146   431 raft_consensus.cc:2243] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.503115   431 raft_consensus.cc:2272] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.503918 10215 consensus_peers.cc:597] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.505971   431 tablet_replica.cc:333] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.506794   431 raft_consensus.cc:2243] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.507428   431 raft_consensus.cc:2272] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.509819   431 tablet_replica.cc:333] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.510315   431 raft_consensus.cc:2243] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.511096   431 raft_consensus.cc:2272] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.513123   431 tablet_replica.cc:333] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.513657   431 raft_consensus.cc:2243] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.514036   431 raft_consensus.cc:2272] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.515887   431 tablet_replica.cc:333] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.516433   431 raft_consensus.cc:2243] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.517062   431 raft_consensus.cc:2272] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.519560   431 tablet_replica.cc:333] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.520301   431 raft_consensus.cc:2243] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.520713   431 raft_consensus.cc:2272] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.523041   431 tablet_replica.cc:333] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.523715   431 raft_consensus.cc:2243] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.524281   431 raft_consensus.cc:2272] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.526851   431 tablet_replica.cc:333] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.527384   431 raft_consensus.cc:2243] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.527944   431 raft_consensus.cc:2272] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.530575   431 tablet_replica.cc:333] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.531124   431 raft_consensus.cc:2243] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.531523   431 raft_consensus.cc:2272] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.534373   431 tablet_replica.cc:333] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.535125   431 raft_consensus.cc:2243] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.535646   431 raft_consensus.cc:2272] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.538697   431 tablet_replica.cc:333] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.539597   431 raft_consensus.cc:2243] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.540804   431 raft_consensus.cc:2272] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.544245   431 tablet_replica.cc:333] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.545013   431 raft_consensus.cc:2243] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.546111   431 raft_consensus.cc:2272] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.549083   431 tablet_replica.cc:333] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.549606   431 raft_consensus.cc:2243] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.550094   431 raft_consensus.cc:2272] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.551967   431 tablet_replica.cc:333] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.552541   431 raft_consensus.cc:2243] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.552965   431 raft_consensus.cc:2272] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.555248   431 tablet_replica.cc:333] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.555894   431 raft_consensus.cc:2243] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.556418   431 raft_consensus.cc:2272] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.558663   431 tablet_replica.cc:333] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.559168   431 raft_consensus.cc:2243] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.559639   431 raft_consensus.cc:2272] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.562566   431 tablet_replica.cc:333] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.563197   431 raft_consensus.cc:2243] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.563724   431 raft_consensus.cc:2272] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.566215   431 tablet_replica.cc:333] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: stopping tablet replica
I20260709 13:03:59.566830   431 raft_consensus.cc:2243] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.567720   431 raft_consensus.cc:2272] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.596267 10289 consensus_peers.cc:597] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.598415 10215 consensus_peers.cc:597] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.605156 10215 consensus_peers.cc:597] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.625018 10215 consensus_peers.cc:597] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.650928   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:59.669701 10289 consensus_peers.cc:597] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.691216 10364 consensus_peers.cc:597] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.726473 10215 consensus_peers.cc:597] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.727458 10215 consensus_peers.cc:597] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.728091 10215 consensus_peers.cc:597] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.752411 10364 consensus_peers.cc:597] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.782896   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:59.815063 10289 consensus_peers.cc:597] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.822467 10289 consensus_peers.cc:597] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.822899 10289 consensus_peers.cc:597] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.937045 10364 consensus_peers.cc:597] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.960425 10364 consensus_peers.cc:597] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.961454 10289 consensus_peers.cc:597] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.968544 10941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.076545 10946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.150450 10951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.167425   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.169394   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:00.169673   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.169898   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240169880 us; error 0 us; skew 500 ppm
I20260709 13:04:00.170902   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.193921   431 webserver.cc:533] Webserver started at http://127.0.107.193:45247/ using document root <none> and password file <none>
I20260709 13:04:00.194826   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.196379   431 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:04:00.310024 10212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 107474us
I20260709 13:04:00.336681   431 fs_manager.cc:714] Time spent opening directory manager: real 0.139s	user 0.014s	sys 0.008s
W20260709 13:04:00.349357 10215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35805, user_credentials={real_user=slave}} blocked reactor thread for 124097us
W20260709 13:04:00.379101 10215 consensus_peers.cc:597] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.391474 10969 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.398953   431 fs_manager.cc:730] Time spent opening block manager: real 0.035s	user 0.002s	sys 0.008s
I20260709 13:04:00.399451   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
format_stamp: "Formatted at 2026-07-09 13:03:48 on dist-test-slave-021n"
I20260709 13:04:00.400002   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:00.428056   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.429337   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.430776   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.435343 10976 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:04:00.450826 10843 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.451472 10843 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.453550 10843 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.454918 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:04:00.458489 10289 leader_election.cc:336] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.459031 10289 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.459748 10843 raft_consensus.cc:2749] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.515053 10557 raft_consensus.cc:493] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.515518 10557 raft_consensus.cc:515] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.517392 10557 leader_election.cc:290] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.518092 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
W20260709 13:04:00.521221 10215 leader_election.cc:336] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.521587 10215 leader_election.cc:304] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.522116 10557 raft_consensus.cc:2749] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.527226 10843 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.527799 10843 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.530412 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.530757 10843 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:04:00.534813 10289 leader_election.cc:336] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.535156 10289 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.535671 10963 raft_consensus.cc:2749] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:00.590977 10943 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.591442 10943 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.593219 10943 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.593451 10963 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.594205 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.594046 10963 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.596809 10963 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:04:00.598977 10364 leader_election.cc:336] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.599603 10364 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:04:00.599642 10956 raft_consensus.cc:493] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.600365 10956 raft_consensus.cc:515] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.600481 10943 raft_consensus.cc:2749] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.602401 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.603602 10956 leader_election.cc:290] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:00.605439 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:04:00.608548 10289 leader_election.cc:336] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.609169 10289 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.611202 10943 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.612193 10943 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.610157 10963 raft_consensus.cc:2749] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.618873 10943 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.619712 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.621374 10322 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:00.622659 10361 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:00.624703 10943 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:00.625108 10943 raft_consensus.cc:493] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.625514 10943 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:00.628721 10364 leader_election.cc:336] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.633136 10943 raft_consensus.cc:515] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.636601 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c269356f5284edabf474b9034c8da3f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:00.637368 10322 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:00.637979 10215 leader_election.cc:336] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.638489 10215 leader_election.cc:304] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:04:00.639956 10956 raft_consensus.cc:2749] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.644347 10943 leader_election.cc:290] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.646205 10943 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.646718 10943 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.648902 10943 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:04:00.650281 10364 leader_election.cc:336] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.650621 10956 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.650714 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.651211 10956 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.651573 10320 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:00.650327 10322 raft_consensus.cc:2468] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 3.
I20260709 13:04:00.652990 10361 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:00.653522 10956 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:00.654745 10361 leader_election.cc:304] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.656144 10959 raft_consensus.cc:2804] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.656579 10959 raft_consensus.cc:493] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.657128 10959 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.657325 10943 raft_consensus.cc:2804] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:04:00.658391 10215 leader_election.cc:336] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.658946 10943 raft_consensus.cc:697] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 3 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
W20260709 13:04:00.661952 10364 leader_election.cc:336] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.661149 10943 consensus_queue.cc:237] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.663203 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.664057 10322 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:04:00.664520 10963 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.664986 10963 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.666479 10959 raft_consensus.cc:515] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.667130 10963 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.668973 10959 leader_election.cc:290] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.665117 10212 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
W20260709 13:04:00.675237 10364 leader_election.cc:336] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.676092 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.675150 10956 raft_consensus.cc:2804] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.676621 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d6f0a40934634966942872cb2fcc3" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
W20260709 13:04:00.676659 10289 leader_election.cc:336] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.677384 10322 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.677592 10956 raft_consensus.cc:493] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.678023 10956 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.687657 10963 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.688349 10963 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.690202 10322 raft_consensus.cc:2468] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:00.691193 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.690675 10072 catalog_manager.cc:5697] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 2 to 3, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.692158 10963 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.693327 10557 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.693769 10557 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.697059 10361 leader_election.cc:304] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.697273 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.695487 10557 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:04:00.700970 10215 leader_election.cc:336] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.701561 10943 raft_consensus.cc:2804] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.701735 10956 raft_consensus.cc:515] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.703143 10247 raft_consensus.cc:2393] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in current term 2: Already voted for candidate caa864648e614090be53d8ece3cd29b7 in this term.
W20260709 13:04:00.703374 10289 leader_election.cc:336] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.703819 10289 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.705291 10963 raft_consensus.cc:2749] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.705467 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136327a8d9d14b05838f2e67d241c7f7" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:00.706203 10322 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.702656 10943 raft_consensus.cc:697] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:00.701882 10215 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.708040 10557 raft_consensus.cc:2749] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.708627 10287 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:00.707552 10943 consensus_queue.cc:237] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:04:00.714342 10215 leader_election.cc:336] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.717331 10956 leader_election.cc:290] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:00.728180 10322 raft_consensus.cc:2468] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 2.
I20260709 13:04:00.728901   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:00.729282   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.295s	user 0.008s	sys 0.001s
I20260709 13:04:00.728874 10843 raft_consensus.cc:2749] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.730199   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:00.732369 10960 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.732980 10960 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.734726 10212 leader_election.cc:304] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.735800 10557 raft_consensus.cc:2804] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.736265 10557 raft_consensus.cc:697] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:00.738221 10960 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.743984 10959 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
W20260709 13:04:00.744365 10364 leader_election.cc:336] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.744527 10959 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.746659 10959 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.741228 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.748275 10247 raft_consensus.cc:2468] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:00.748458 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.743517 10557 consensus_queue.cc:237] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.749102 10321 raft_consensus.cc:2468] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:00.739672 10976 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:00.750422 10361 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:00.750537 10958 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.751132 10958 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.751212 10959 raft_consensus.cc:2804] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.752995 10958 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.752960 10959 raft_consensus.cc:493] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.753701 10959 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.758742 10963 raft_consensus.cc:493] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.759311 10963 raft_consensus.cc:515] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.763558 10963 leader_election.cc:290] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.764273 10362 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.765506 10943 raft_consensus.cc:2804] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.765853 10943 raft_consensus.cc:493] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.766209 10943 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.770671 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.775663 10943 raft_consensus.cc:515] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.777870 10943 leader_election.cc:290] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
W20260709 13:04:00.779863 10289 leader_election.cc:336] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.780468 10289 leader_election.cc:304] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:00.780803 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38417199a01548d58b4afa4478c87a09" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:00.781421 10247 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.781641 10963 raft_consensus.cc:2749] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.782599 10933 raft_consensus.cc:493] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.783139 10933 raft_consensus.cc:515] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.783640 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.786440 10933 leader_election.cc:290] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.788828 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
W20260709 13:04:00.789587 10215 leader_election.cc:336] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.789602 10248 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:04:00.790166 10247 raft_consensus.cc:2468] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:00.791139 10287 leader_election.cc:304] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
W20260709 13:04:00.791774 10289 leader_election.cc:336] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.792045 10933 raft_consensus.cc:2804] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.792495 10933 raft_consensus.cc:493] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.792649 10960 raft_consensus.cc:493] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.792888 10933 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.793289 10960 raft_consensus.cc:515] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.795840 10963 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.796260 10362 leader_election.cc:304] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:00.797333 10944 raft_consensus.cc:2804] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.797962 10944 raft_consensus.cc:697] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:00.799383 10956 raft_consensus.cc:493] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.799093 10944 consensus_queue.cc:237] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.800150 10956 raft_consensus.cc:515] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.763557 10959 raft_consensus.cc:515] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.802870 10956 leader_election.cc:290] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:00.803228 10959 leader_election.cc:290] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.804160 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74aa2caa4cef407db88d87691e1e3e3c" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:00.804852 10322 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.808123 10963 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.808727 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:00.809469 10321 raft_consensus.cc:2468] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:04:00.810735 10963 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.811596 10212 leader_election.cc:304] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:00.812618 10958 raft_consensus.cc:2804] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.812938 10976 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.813535 10960 leader_election.cc:290] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
W20260709 13:04:00.817655 10289 leader_election.cc:336] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
W20260709 13:04:00.818831 10364 leader_election.cc:336] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.821534 10322 raft_consensus.cc:2468] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:00.822901 10361 leader_election.cc:304] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:00.823920 10944 raft_consensus.cc:2804] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.824517 10944 raft_consensus.cc:697] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:00.825713 10944 consensus_queue.cc:237] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.828940 10215 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:00.829713 10956 raft_consensus.cc:2749] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.822943 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.813942 10976 tablet_bootstrap.cc:492] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:00.814851 10958 raft_consensus.cc:493] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.830910 10247 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:00.831235 10958 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.831784 10933 raft_consensus.cc:515] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.831285 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:00.833123 10392 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:04:00.834298 10933 leader_election.cc:290] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.837038 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289c2698ec0e4ce5aa73380329eaeb85" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:00.837769 10248 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.840013 10976 ts_tablet_manager.cc:1403] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.008s
W20260709 13:04:00.845944 10289 leader_election.cc:336] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.852702 10248 raft_consensus.cc:2468] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 2.
W20260709 13:04:00.852296 10215 leader_election.cc:336] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.857151 10362 leader_election.cc:304] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:00.844868 10958 raft_consensus.cc:515] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.859899 10958 leader_election.cc:290] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:00.856359 10287 leader_election.cc:304] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.862592 10289 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.865696 10968 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.866928 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e7bbdd88eb4f6ea262e8951785f78a" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:00.867615 10322 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.866333 10968 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.863561 10945 raft_consensus.cc:2804] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.872519 10945 raft_consensus.cc:493] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.873097 10945 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.875615 10322 raft_consensus.cc:2468] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 2.
I20260709 13:04:00.879163 10963 raft_consensus.cc:2804] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.882727 10212 leader_election.cc:304] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:00.882349 10070 catalog_manager.cc:5697] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:00.887693 10364 leader_election.cc:336] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.890816 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.890961 10953 raft_consensus.cc:2804] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.884356 10843 raft_consensus.cc:2804] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.895562 10843 raft_consensus.cc:493] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.895569 10953 raft_consensus.cc:697] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:00.896044 10843 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.897161 10953 consensus_queue.cc:237] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.875211 10968 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.903394 10976 raft_consensus.cc:359] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:04:00.914896 10364 leader_election.cc:336] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.915548 10945 raft_consensus.cc:515] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.912377 10976 raft_consensus.cc:740] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
W20260709 13:04:00.921674 10364 leader_election.cc:336] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.923071 10976 consensus_queue.cc:260] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.931126 10976 ts_tablet_manager.cc:1434] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:04:00.932216 10976 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:00.936411 10963 raft_consensus.cc:697] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:00.932580 10945 leader_election.cc:290] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.933068 10843 raft_consensus.cc:515] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:04:00.938974 10364 leader_election.cc:336] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.939941 10843 leader_election.cc:290] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
W20260709 13:04:00.935844 10287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 51856.4us
I20260709 13:04:00.941562 10963 consensus_queue.cc:237] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.943966 10945 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.944548 10945 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:00.946427 10945 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:00.947108 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
W20260709 13:04:00.949425 10289 leader_election.cc:336] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.954417 10287 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:00.955271 10843 raft_consensus.cc:2749] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:00.956387 10215 leader_election.cc:336] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.956924 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf286bda5432ba867269e864dfd32" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:00.957670 10392 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.956075 10070 catalog_manager.cc:5697] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.968618 10070 catalog_manager.cc:5697] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.970243 10392 raft_consensus.cc:2468] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 2.
I20260709 13:04:00.969995 10070 catalog_manager.cc:5697] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:00.971391 10364 leader_election.cc:336] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.971855 10364 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1
I20260709 13:04:00.972617 10945 raft_consensus.cc:2749] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.978619 10289 leader_election.cc:304] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:00.979728 10987 raft_consensus.cc:2804] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.979779 10976 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:00.980358 10289 leader_election.cc:336] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.980532 10987 raft_consensus.cc:697] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:00.981289 10976 tablet_bootstrap.cc:492] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:00.981539 10987 consensus_queue.cc:237] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.982081 10976 ts_tablet_manager.cc:1403] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.000s
I20260709 13:04:00.983114 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1a9d1c53c442ff8ea9c6cdbd02031f" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:00.983793 10247 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.985347 10945 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.985886 10976 raft_consensus.cc:359] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.986819 10976 raft_consensus.cc:740] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.985988 10945 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:00.987890 10976 consensus_queue.cc:260] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:00.990787 10945 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:00.992795 10247 raft_consensus.cc:2468] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:00.994628 10976 ts_tablet_manager.cc:1434] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:04:00.994789 10364 leader_election.cc:336] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:00.995117 10953 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:00.995779 10953 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:00.996708 10362 leader_election.cc:304] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:00.997834 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:00.998512 10247 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:00.998551 10070 catalog_manager.cc:5697] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.001178 10953 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:01.002905 10943 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:01.003034 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:01.003706 10322 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 1.
I20260709 13:04:01.003590 10943 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:01.005872 10943 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:01.007457 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:01.008086 10321 raft_consensus.cc:2468] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 1.
I20260709 13:04:01.009205 10362 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:01.005795 10212 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:01.010335 10557 raft_consensus.cc:2804] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:01.010699 10557 raft_consensus.cc:493] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:01.011054 10557 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.998452 10960 raft_consensus.cc:2804] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.013470 10960 raft_consensus.cc:697] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:01.014247 10959 raft_consensus.cc:2804] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:01.014672 10959 raft_consensus.cc:493] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:01.015194 10959 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.010740 10361 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
W20260709 13:04:01.017236 10364 leader_election.cc:336] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.017356 10944 raft_consensus.cc:2804] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:01.017835 10944 raft_consensus.cc:493] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:01.018209 10944 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.020053 10976 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:01.014571 10960 consensus_queue.cc:237] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.022557 10959 raft_consensus.cc:515] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.017418 10072 catalog_manager.cc:5697] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:01.029676 10364 leader_election.cc:336] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.031000 10959 leader_election.cc:290] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:01.032967 10557 raft_consensus.cc:515] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.035995 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82534bc4cd7045f6a24502bff235976d" candidate_uuid: "caa864648e614090be53d8ece3cd29b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:01.036592 10322 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.038038 10070 catalog_manager.cc:5697] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.031067 10944 raft_consensus.cc:515] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:01.054116 10322 raft_consensus.cc:2468] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa864648e614090be53d8ece3cd29b7 in term 2.
I20260709 13:04:01.057358 10072 catalog_manager.cc:5697] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.058561 10557 leader_election.cc:290] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:01.059237 10212 leader_election.cc:304] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:01.059993 10958 raft_consensus.cc:2804] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.060505 10958 raft_consensus.cc:697] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Becoming Leader. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:01.060895 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f990deb05e0436ab18c7ac796c66c3a" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:01.061465 10322 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.061277 10958 consensus_queue.cc:237] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
W20260709 13:04:01.062724 10215 leader_election.cc:336] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.064659 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7187ede0b76425593900305a48a4aa2" candidate_uuid: "c4b5b492fca940a3883a22eec56a4f9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:01.065268 10247 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:01.067121 10364 leader_election.cc:336] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.068447 10944 leader_election.cc:290] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:01.068684 10963 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
W20260709 13:04:01.069523 10215 leader_election.cc:336] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.069312 10963 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:01.071739 10963 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
W20260709 13:04:01.077344 10289 leader_election.cc:336] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.083060 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:01.083804 10392 raft_consensus.cc:2468] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 1.
I20260709 13:04:01.084381 10322 raft_consensus.cc:2468] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:01.085708 10361 leader_election.cc:304] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:01.086855 10944 raft_consensus.cc:2804] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.087368 10944 raft_consensus.cc:697] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:01.088286 10944 consensus_queue.cc:237] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:01.093799 10289 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:01.095304 10963 raft_consensus.cc:2804] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:01.095706 10963 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:01.096143 10963 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.097011 10247 raft_consensus.cc:2468] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b5b492fca940a3883a22eec56a4f9f in term 2.
I20260709 13:04:01.098376 10362 leader_election.cc:304] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:01.100488 10976 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.100775 10944 raft_consensus.cc:2804] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.101295 10944 raft_consensus.cc:697] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Leader. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:01.101483 10976 tablet_bootstrap.cc:492] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.102217 10976 ts_tablet_manager.cc:1403] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.016s
I20260709 13:04:01.102530 10944 consensus_queue.cc:237] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.107714 10072 catalog_manager.cc:5697] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.111601 10976 raft_consensus.cc:359] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:01.112946 10976 raft_consensus.cc:740] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.117967 10963 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:01.111876 10070 catalog_manager.cc:5697] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to caa864648e614090be53d8ece3cd29b7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "caa864648e614090be53d8ece3cd29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.121660 10976 consensus_queue.cc:260] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:01.125598 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:01.129055 10392 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.130043 10976 ts_tablet_manager.cc:1434] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:04:01.131031 10976 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:01.134166 10289 leader_election.cc:336] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
I20260709 13:04:01.138871 10392 raft_consensus.cc:2468] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7e7b27d524749fbbbc0fa9855c2c5d1 in term 2.
I20260709 13:04:01.140539 10289 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:01.121446 10963 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [CANDIDATE]: Term 2 election: Requested vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:04:01.142266 10963 raft_consensus.cc:2804] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.142758 10963 raft_consensus.cc:697] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Becoming Leader. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:01.143586 10963 consensus_queue.cc:237] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
W20260709 13:04:01.147673 10270 debug-util.cc:398] Leaking SignalData structure 0x7b080029b680 after lost signal to thread 434
W20260709 13:04:01.149147 10270 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc460 after lost signal to thread 10106
W20260709 13:04:01.150660 10270 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac3c0 after lost signal to thread 10273
W20260709 13:04:01.152053 10270 debug-util.cc:398] Leaking SignalData structure 0x7b08001916e0 after lost signal to thread 10347
W20260709 13:04:01.153358 10270 debug-util.cc:398] Leaking SignalData structure 0x7b08001d61e0 after lost signal to thread 10422
W20260709 13:04:01.164757 10364 consensus_peers.cc:597] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.166364 10976 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.167354 10976 tablet_bootstrap.cc:492] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.168017 10976 ts_tablet_manager.cc:1403] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.007s
I20260709 13:04:01.170600 10976 raft_consensus.cc:359] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:01.171274 10976 raft_consensus.cc:740] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.186574 10322 raft_consensus.cc:1275] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.196501 10944 consensus_queue.cc:1048] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.182854 10976 consensus_queue.cc:260] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:01.203707 10322 raft_consensus.cc:1275] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:01.204037 10976 ts_tablet_manager.cc:1434] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:04:01.206375 10976 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:01.216548 10944 consensus_queue.cc:1048] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:01.219928 10070 catalog_manager.cc:5697] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c4b5b492fca940a3883a22eec56a4f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.233227 10320 raft_consensus.cc:1275] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.234978 10959 consensus_queue.cc:1048] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.224141 10072 catalog_manager.cc:5697] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 reported cstate change: term changed from 1 to 2, leader changed from 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193) to b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.238521 10247 raft_consensus.cc:1275] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:01.239130 10364 consensus_peers.cc:597] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.235186 10320 raft_consensus.cc:1275] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer caa864648e614090be53d8ece3cd29b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.247408 10883 consensus_queue.cc:1048] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.258198 10944 consensus_queue.cc:1048] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:01.323707 10364 consensus_peers.cc:597] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.341584 10976 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:01.341998 10364 consensus_peers.cc:597] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.342638 10976 tablet_bootstrap.cc:492] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.343413 10976 ts_tablet_manager.cc:1403] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.008s
I20260709 13:04:01.346597 10976 raft_consensus.cc:359] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.347397 10976 raft_consensus.cc:740] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.351038 10248 raft_consensus.cc:1275] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer b7e7b27d524749fbbbc0fa9855c2c5d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.352624 10963 consensus_queue.cc:1048] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.351323 10976 consensus_queue.cc:260] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.374643 10976 ts_tablet_manager.cc:1434] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
W20260709 13:04:01.377025 10215 consensus_peers.cc:597] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.378612 10314 raft_consensus.cc:1275] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer caa864648e614090be53d8ece3cd29b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.380674 10883 consensus_queue.cc:1048] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.384157 10976 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:01.448956   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:01.449506   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.719s	user 0.285s	sys 0.010s
W20260709 13:04:01.467554 10289 consensus_peers.cc:597] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.481829 10289 consensus_peers.cc:597] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.494607 10248 raft_consensus.cc:1275] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.497504 10960 consensus_queue.cc:1048] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.514056 10976 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:01.516554 10364 consensus_peers.cc:597] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.518040 10215 consensus_peers.cc:597] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.520665 10976 tablet_bootstrap.cc:492] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.523051 10976 ts_tablet_manager.cc:1403] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.004s
I20260709 13:04:01.524123 10397 raft_consensus.cc:1275] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer b7e7b27d524749fbbbc0fa9855c2c5d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.526266 10987 consensus_queue.cc:1048] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.525981 10976 raft_consensus.cc:359] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.528867 10976 raft_consensus.cc:740] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.529805 10976 consensus_queue.cc:260] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.532755 10976 ts_tablet_manager.cc:1434] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:01.534018 10976 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:01.537613 10364 consensus_peers.cc:597] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.538291 10322 raft_consensus.cc:1275] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer caa864648e614090be53d8ece3cd29b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.539872 10883 consensus_queue.cc:1048] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.556943 10314 raft_consensus.cc:1275] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.559906 10959 consensus_queue.cc:1048] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:01.578984 10215 consensus_peers.cc:597] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.631210 10976 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.632200 10976 tablet_bootstrap.cc:492] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.632823 10976 ts_tablet_manager.cc:1403] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.003s
I20260709 13:04:01.640698 10976 raft_consensus.cc:359] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.641454 10976 raft_consensus.cc:740] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.645478 10976 consensus_queue.cc:260] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.648670 10976 ts_tablet_manager.cc:1434] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:01.649443 10976 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:01.657626 10247 raft_consensus.cc:1275] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer c4b5b492fca940a3883a22eec56a4f9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.659834 10393 raft_consensus.cc:1275] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer b7e7b27d524749fbbbc0fa9855c2c5d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.660044 10960 consensus_queue.cc:1048] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.668574 10843 consensus_queue.cc:1048] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:01.682595 10364 consensus_peers.cc:597] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.748301 10289 consensus_peers.cc:597] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.750414 10976 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.751593 10976 tablet_bootstrap.cc:492] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.752381 10976 ts_tablet_manager.cc:1403] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.012s
I20260709 13:04:01.755915 10976 raft_consensus.cc:359] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.756742 10976 raft_consensus.cc:740] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.757691 10976 consensus_queue.cc:260] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.760237 10976 ts_tablet_manager.cc:1434] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.761328 10976 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:01.854012 10976 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.855141 10976 tablet_bootstrap.cc:492] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.855885 10976 ts_tablet_manager.cc:1403] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.025s
I20260709 13:04:01.858677 10976 raft_consensus.cc:359] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.859498 10976 raft_consensus.cc:740] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.860528 10976 consensus_queue.cc:260] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.864054 10976 ts_tablet_manager.cc:1434] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:04:01.865178 10976 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:01.875921 10364 consensus_peers.cc:597] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.900220 10976 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.901413 10976 tablet_bootstrap.cc:492] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.902058 10976 ts_tablet_manager.cc:1403] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.004s
I20260709 13:04:01.904624 10976 raft_consensus.cc:359] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.905263 10976 raft_consensus.cc:740] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.906004 10976 consensus_queue.cc:260] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.908247 10976 ts_tablet_manager.cc:1434] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:01.909163 10976 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:01.928159 10215 consensus_peers.cc:597] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.935297 10976 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.936338 10976 tablet_bootstrap.cc:492] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.938727 10976 ts_tablet_manager.cc:1403] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 13:04:01.943181 10976 raft_consensus.cc:359] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.943924 10976 raft_consensus.cc:740] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.944787 10976 consensus_queue.cc:260] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:01.947041 10976 ts_tablet_manager.cc:1434] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:01.947854 10976 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:01.949080 10215 consensus_peers.cc:597] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.959203 10364 consensus_peers.cc:597] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.965029 10976 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.967372 10976 tablet_bootstrap.cc:492] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:01.968143 10976 ts_tablet_manager.cc:1403] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:04:01.971058 10976 raft_consensus.cc:359] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.971848 10976 raft_consensus.cc:740] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.972708 10976 consensus_queue.cc:260] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:01.975025 10976 ts_tablet_manager.cc:1434] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.975837 10976 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.001020 10976 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.002069 10976 tablet_bootstrap.cc:492] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.003062 10976 ts_tablet_manager.cc:1403] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.005s
I20260709 13:04:02.006157 10976 raft_consensus.cc:359] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.007018 10976 raft_consensus.cc:740] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.007934 10976 consensus_queue.cc:260] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.010582 10976 ts_tablet_manager.cc:1434] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:02.011559 10976 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.029820 10976 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.030810 10976 tablet_bootstrap.cc:492] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.031626 10976 ts_tablet_manager.cc:1403] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
W20260709 13:04:02.034493 10215 consensus_peers.cc:597] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.034291 10976 raft_consensus.cc:359] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.035097 10976 raft_consensus.cc:740] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.035910 10976 consensus_queue.cc:260] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.038322 10976 ts_tablet_manager.cc:1434] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:02.039161 10976 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.054101 10976 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.055025 10976 tablet_bootstrap.cc:492] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.055640 10976 ts_tablet_manager.cc:1403] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:04:02.058284 10976 raft_consensus.cc:359] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.059073 10976 raft_consensus.cc:740] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.059968 10976 consensus_queue.cc:260] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.061955 10976 ts_tablet_manager.cc:1434] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:02.062713 10976 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:02.112087 10215 consensus_peers.cc:597] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.119427 10289 consensus_peers.cc:597] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.123955 10212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45585, user_credentials={real_user=slave}} blocked reactor thread for 46565.1us
W20260709 13:04:02.127481 10215 consensus_peers.cc:597] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.130841 10976 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.131875 10976 tablet_bootstrap.cc:492] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.132555 10976 ts_tablet_manager.cc:1403] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.070s	user 0.031s	sys 0.012s
I20260709 13:04:02.135244 10976 raft_consensus.cc:359] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.135977 10976 raft_consensus.cc:740] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.136863 10976 consensus_queue.cc:260] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.140102 10976 ts_tablet_manager.cc:1434] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:02.140967 10976 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:02.144966 10215 consensus_peers.cc:597] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.159786 10289 consensus_peers.cc:597] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.162878 10976 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:02.169209 10215 consensus_peers.cc:597] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.163918 10364 consensus_peers.cc:597] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.171995 10364 consensus_peers.cc:597] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.174824 10976 tablet_bootstrap.cc:492] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.181627 10976 ts_tablet_manager.cc:1403] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.010s
I20260709 13:04:02.188011 10976 raft_consensus.cc:359] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
W20260709 13:04:02.188045 10215 consensus_peers.cc:597] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.195426 10976 raft_consensus.cc:740] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
W20260709 13:04:02.195873 10364 consensus_peers.cc:597] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.198808 10976 consensus_queue.cc:260] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.201583 10976 ts_tablet_manager.cc:1434] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 13:04:02.213743 10364 consensus_peers.cc:597] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.212708 10976 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.228106   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35805
I20260709 13:04:02.227840 11091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35805 every 8 connection(s)
I20260709 13:04:02.250077 10976 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.253998 10976 tablet_bootstrap.cc:492] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.254942 10976 ts_tablet_manager.cc:1403] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.000s
I20260709 13:04:02.257833 10976 raft_consensus.cc:359] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.258678 10976 raft_consensus.cc:740] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.260069 10976 consensus_queue.cc:260] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.267181 10976 ts_tablet_manager.cc:1434] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:02.268010 10976 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
W20260709 13:04:02.282343 10364 consensus_peers.cc:597] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.293210 10215 consensus_peers.cc:597] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.297226 10364 consensus_peers.cc:597] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.303665 10976 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.304739 10976 tablet_bootstrap.cc:492] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.305409 10976 ts_tablet_manager.cc:1403] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.003s
I20260709 13:04:02.307689 10976 raft_consensus.cc:359] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.308427 10976 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.309049 11092 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45551
I20260709 13:04:02.309003 10976 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.309578 11092 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:02.310587 10976 ts_tablet_manager.cc:1434] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:04:02.311743 10976 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.310598 11092 heartbeater.cc:507] Master 127.0.107.254:45551 requested a full tablet report, sending...
I20260709 13:04:02.323096 11062 raft_consensus.cc:3060] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.342814 10976 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.343892 10976 tablet_bootstrap.cc:492] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.344638 10976 ts_tablet_manager.cc:1403] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.005s
I20260709 13:04:02.347250 10976 raft_consensus.cc:359] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.347958 10976 raft_consensus.cc:740] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
W20260709 13:04:02.348016 10215 consensus_peers.cc:597] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.348987 10976 consensus_queue.cc:260] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.351366 10976 ts_tablet_manager.cc:1434] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:02.352577 10976 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.362102 10992 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.362715 10992 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.367061 10072 ts_manager.cc:194] Re-registered known tserver with Master: 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805)
I20260709 13:04:02.368589 10992 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
W20260709 13:04:02.387391 10215 consensus_peers.cc:597] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.393311 10289 consensus_peers.cc:597] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.394022 10289 consensus_peers.cc:597] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.395887 10289 consensus_peers.cc:597] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.400524 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:02.411108 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:02.412756 10973 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:02.413647 10992 raft_consensus.cc:2749] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:02.416870 10976 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.417678 10976 tablet_bootstrap.cc:492] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.418293 10976 ts_tablet_manager.cc:1403] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.018s
I20260709 13:04:02.420135 10976 raft_consensus.cc:359] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.420683 10976 raft_consensus.cc:740] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.421262 10976 consensus_queue.cc:260] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.423018 10976 ts_tablet_manager.cc:1434] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:04:02.423727 10976 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.438413 11062 raft_consensus.cc:3060] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.470512 10992 raft_consensus.cc:493] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.471045 10992 raft_consensus.cc:515] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } }
I20260709 13:04:02.473490 10992 leader_election.cc:290] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
W20260709 13:04:02.478034 10289 consensus_peers.cc:597] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.482376 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:02.486933 10976 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.487954 10976 tablet_bootstrap.cc:492] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.493114 10976 ts_tablet_manager.cc:1403] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.000s
I20260709 13:04:02.495639 10976 raft_consensus.cc:359] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.496431 10976 raft_consensus.cc:740] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.507261 11061 raft_consensus.cc:3060] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.515280 10976 consensus_queue.cc:260] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.517956 10976 ts_tablet_manager.cc:1434] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:02.518750 10976 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.526574 11063 raft_consensus.cc:3060] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.537165 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389b7d02e091434d92c8b6ed3ad13c15" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" is_pre_election: true
I20260709 13:04:02.538898 10970 leader_election.cc:304] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: b7e7b27d524749fbbbc0fa9855c2c5d1, c4b5b492fca940a3883a22eec56a4f9f
I20260709 13:04:02.540226 10992 raft_consensus.cc:2749] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:02.542460 11062 raft_consensus.cc:3060] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.543226 10976 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.544158 10976 tablet_bootstrap.cc:492] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.544973 10976 ts_tablet_manager.cc:1403] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.011s
I20260709 13:04:02.559350 10976 raft_consensus.cc:359] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.560118 10976 raft_consensus.cc:740] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.561106 10976 consensus_queue.cc:260] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
W20260709 13:04:02.561525 10364 consensus_peers.cc:597] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.563325 10976 ts_tablet_manager.cc:1434] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:04:02.564210 10976 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.603798 10976 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.604851 10976 tablet_bootstrap.cc:492] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.605540 10976 ts_tablet_manager.cc:1403] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.004s
I20260709 13:04:02.608033 10976 raft_consensus.cc:359] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.609997 10976 raft_consensus.cc:740] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.610641 10976 consensus_queue.cc:260] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.612864 10976 ts_tablet_manager.cc:1434] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:02.613679 10976 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.618006 10992 raft_consensus.cc:493] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.618654 10992 raft_consensus.cc:515] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.622262 10992 leader_election.cc:290] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:02.623306 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "caa864648e614090be53d8ece3cd29b7" is_pre_election: true
I20260709 13:04:02.623885 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33497a7cce7475fb1f48d994ccdb42e" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f" is_pre_election: true
I20260709 13:04:02.636116 10072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35126
I20260709 13:04:02.642127 10973 leader_election.cc:304] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10; no voters: c4b5b492fca940a3883a22eec56a4f9f, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:02.642979 10992 raft_consensus.cc:2749] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:02.644441 11061 raft_consensus.cc:3060] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.651054 10976 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.652104 10976 tablet_bootstrap.cc:492] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.652765 10976 ts_tablet_manager.cc:1403] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.007s
I20260709 13:04:02.655469 10976 raft_consensus.cc:359] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.656144 10976 raft_consensus.cc:740] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.657017 10976 consensus_queue.cc:260] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:02.657322 11092 heartbeater.cc:499] Master 127.0.107.254:45551 was elected leader, sending a full tablet report...
I20260709 13:04:02.659835 10976 ts_tablet_manager.cc:1434] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:02.661123 10976 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.735716 11062 raft_consensus.cc:3060] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.769060 10976 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.770118 10976 tablet_bootstrap.cc:492] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.770879 10976 ts_tablet_manager.cc:1403] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.110s	user 0.045s	sys 0.056s
I20260709 13:04:02.775072 10976 raft_consensus.cc:359] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.775991 10976 raft_consensus.cc:740] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.776849 10976 consensus_queue.cc:260] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:02.790931 10976 ts_tablet_manager.cc:1434] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:02.792115 10976 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.796257 11061 raft_consensus.cc:3060] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.842747 10976 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.843770 10976 tablet_bootstrap.cc:492] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.845003 10976 ts_tablet_manager.cc:1403] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.003s
I20260709 13:04:02.846997 10976 raft_consensus.cc:359] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.848465 10976 raft_consensus.cc:740] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.849202 10976 consensus_queue.cc:260] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.850828 10976 ts_tablet_manager.cc:1434] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:04:02.851603 10976 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.864039 10976 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.864987 10976 tablet_bootstrap.cc:492] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.865581 10976 ts_tablet_manager.cc:1403] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:04:02.867952 10976 raft_consensus.cc:359] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.869449 10976 raft_consensus.cc:740] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.870126 10976 consensus_queue.cc:260] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.872143 10976 ts_tablet_manager.cc:1434] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:02.872965 10976 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.895030 10976 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.896102 10976 tablet_bootstrap.cc:492] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.896896 10976 ts_tablet_manager.cc:1403] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:04:02.899694 10976 raft_consensus.cc:359] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.900542 10976 raft_consensus.cc:740] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.901254 10976 consensus_queue.cc:260] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.903680 10976 ts_tablet_manager.cc:1434] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:02.904598 10976 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:02.940282 11062 raft_consensus.cc:3060] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:02.949826 10976 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.950623 10976 tablet_bootstrap.cc:492] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:02.951117 10976 ts_tablet_manager.cc:1403] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.012s
I20260709 13:04:02.955482 10976 raft_consensus.cc:359] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.956199 10976 raft_consensus.cc:740] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.956950 10976 consensus_queue.cc:260] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:02.960366 10976 ts_tablet_manager.cc:1434] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:04:02.961274 10976 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.005805 10976 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.006844 10976 tablet_bootstrap.cc:492] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.008498 10976 ts_tablet_manager.cc:1403] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.025s
I20260709 13:04:03.011005 10976 raft_consensus.cc:359] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.011849 10976 raft_consensus.cc:740] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.012701 10976 consensus_queue.cc:260] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.021157 10976 ts_tablet_manager.cc:1434] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:03.022110 10976 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.063211 11062 raft_consensus.cc:3060] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.069871 10976 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.071054 10976 tablet_bootstrap.cc:492] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.071883 10976 ts_tablet_manager.cc:1403] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.050s	user 0.036s	sys 0.009s
I20260709 13:04:03.074781 10976 raft_consensus.cc:359] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.075583 10976 raft_consensus.cc:740] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.076504 10976 consensus_queue.cc:260] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.078891 10976 ts_tablet_manager.cc:1434] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:03.080929 10976 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.105517 10976 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.106725 10976 tablet_bootstrap.cc:492] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.107468 10976 ts_tablet_manager.cc:1403] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:04:03.110021 10976 raft_consensus.cc:359] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.110773 10976 raft_consensus.cc:740] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.111598 10976 consensus_queue.cc:260] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.114966 10976 ts_tablet_manager.cc:1434] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:03.115865 10976 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.143913 10976 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.145027 10976 tablet_bootstrap.cc:492] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.145823 10976 ts_tablet_manager.cc:1403] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 13:04:03.148783 10976 raft_consensus.cc:359] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.152060 10976 raft_consensus.cc:740] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.153661 10976 consensus_queue.cc:260] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.156075 10976 ts_tablet_manager.cc:1434] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:04:03.157374 10976 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.261806 10976 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.262796 10976 tablet_bootstrap.cc:492] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.263473 10976 ts_tablet_manager.cc:1403] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.106s	user 0.024s	sys 0.041s
I20260709 13:04:03.267616 10976 raft_consensus.cc:359] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.268339 10976 raft_consensus.cc:740] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.269116 10976 consensus_queue.cc:260] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.271338 10976 ts_tablet_manager.cc:1434] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:03.272122 10976 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.309276 10976 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.310217 10976 tablet_bootstrap.cc:492] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.310935 10976 ts_tablet_manager.cc:1403] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.003s
I20260709 13:04:03.313313 10976 raft_consensus.cc:359] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.313868 10976 raft_consensus.cc:740] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.314677 10976 consensus_queue.cc:260] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.318300 10976 ts_tablet_manager.cc:1434] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:03.319288 10976 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.367496 10976 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.368463 10976 tablet_bootstrap.cc:492] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.369131 10976 ts_tablet_manager.cc:1403] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.027s
I20260709 13:04:03.371155 10976 raft_consensus.cc:359] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.371646 10976 raft_consensus.cc:740] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.372264 10976 consensus_queue.cc:260] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.374084 10976 ts_tablet_manager.cc:1434] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:03.374872 10976 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.408248 10976 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.409070 10976 tablet_bootstrap.cc:492] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.409653 10976 ts_tablet_manager.cc:1403] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.019s
I20260709 13:04:03.412803 10976 raft_consensus.cc:359] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.413561 10976 raft_consensus.cc:740] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.414240 10976 consensus_queue.cc:260] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.415683 10976 ts_tablet_manager.cc:1434] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:04:03.417124 10976 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.431089 10976 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.432125 10976 tablet_bootstrap.cc:492] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.432868 10976 ts_tablet_manager.cc:1403] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:04:03.435521 10976 raft_consensus.cc:359] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.436610 10976 raft_consensus.cc:740] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.437508 10976 consensus_queue.cc:260] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.439742 10976 ts_tablet_manager.cc:1434] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:03.442411 10976 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.463454 10976 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.464521 10976 tablet_bootstrap.cc:492] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.465185 10976 ts_tablet_manager.cc:1403] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:04:03.467708 10976 raft_consensus.cc:359] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.468417 10976 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.469129 10976 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.471194 10976 ts_tablet_manager.cc:1434] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:03.472430 10976 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.488902 10976 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.489873 10976 tablet_bootstrap.cc:492] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.490550 10976 ts_tablet_manager.cc:1403] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:04:03.493212 10976 raft_consensus.cc:359] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.493985 10976 raft_consensus.cc:740] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.494668 10976 consensus_queue.cc:260] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.497232 11062 raft_consensus.cc:3060] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.500368 10976 ts_tablet_manager.cc:1434] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:04:03.504372 10976 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.544857 10976 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.546803 10976 tablet_bootstrap.cc:492] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.547464 10976 ts_tablet_manager.cc:1403] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.011s
I20260709 13:04:03.549803 10976 raft_consensus.cc:359] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.550290 10976 raft_consensus.cc:740] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.550897 10976 consensus_queue.cc:260] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.552942 10976 ts_tablet_manager.cc:1434] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:03.553903 10976 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.571579 10976 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.573186 10976 tablet_bootstrap.cc:492] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.573983 10976 ts_tablet_manager.cc:1403] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:04:03.577581 10976 raft_consensus.cc:359] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.578409 10976 raft_consensus.cc:740] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.579159 10976 consensus_queue.cc:260] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:03.581636 10976 ts_tablet_manager.cc:1434] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:03.582470 10976 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.600479 10976 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.601401 10976 tablet_bootstrap.cc:492] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.602187 10976 ts_tablet_manager.cc:1403] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:04:03.604743 10976 raft_consensus.cc:359] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.605510 10976 raft_consensus.cc:740] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.606192 10976 consensus_queue.cc:260] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:03.608604 10976 ts_tablet_manager.cc:1434] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:03.609470 10976 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap starting.
I20260709 13:04:03.629519 10976 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.630525 10976 tablet_bootstrap.cc:492] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Bootstrap complete.
I20260709 13:04:03.631263 10976 ts_tablet_manager.cc:1403] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.002s
I20260709 13:04:03.634382 10976 raft_consensus.cc:359] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.635015 10976 raft_consensus.cc:740] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.635643 10976 consensus_queue.cc:260] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:03.637904 10976 ts_tablet_manager.cc:1434] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:03.791765 11063 raft_consensus.cc:3060] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.850992 11063 raft_consensus.cc:3060] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.248725   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:12.306044 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677"
dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:04:12.306901 10393 raft_consensus.cc:606] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.317996 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b734032a14447b91008890f867d801"
dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:37106
I20260709 13:04:12.318463 10322 raft_consensus.cc:606] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.320839 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92"
dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:04:12.321300 10393 raft_consensus.cc:606] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.333231 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:12.333726 10246 raft_consensus.cc:606] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.336405 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9"
dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:37106
I20260709 13:04:12.336900 10322 raft_consensus.cc:606] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.339434 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f48ec6559166499ca5242a577701f114"
dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:37106
I20260709 13:04:12.339946 10322 raft_consensus.cc:606] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:12.341130   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:12.342290   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:12.444252 11155 raft_consensus.cc:993] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.445008 11152 raft_consensus.cc:1081] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.446853 11063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f48ec6559166499ca5242a577701f114"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34516
I20260709 13:04:12.447556 11063 raft_consensus.cc:493] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.447886 11063 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.455363 11063 raft_consensus.cc:515] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.458621 11063 leader_election.cc:290] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:12.459080 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:12.459429 10314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48ec6559166499ca5242a577701f114" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:12.459956 10248 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.460114 10314 raft_consensus.cc:3055] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.460589 10314 raft_consensus.cc:740] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:12.461723 11153 raft_consensus.cc:993] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.461606 10314 consensus_queue.cc:260] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.462210 11153 raft_consensus.cc:1081] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.463142 10314 raft_consensus.cc:3060] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.468729 10248 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.470739 10971 leader_election.cc:304] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:12.470743 11063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34514
I20260709 13:04:12.471875 11063 raft_consensus.cc:493] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.472286 11063 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.487285 11155 raft_consensus.cc:993] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.487957 11063 raft_consensus.cc:515] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:12.490087 11063 leader_election.cc:290] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:12.491055 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:12.491671 10392 raft_consensus.cc:3055] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:12.492017 10392 raft_consensus.cc:740] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:12.495066 11152 raft_consensus.cc:1081] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.496129 10392 consensus_queue.cc:260] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:12.502442 10392 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.505286 10314 raft_consensus.cc:2468] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.515457 11062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34516
I20260709 13:04:12.516086 11062 raft_consensus.cc:493] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.516463 11062 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.517773 10392 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 3.
I20260709 13:04:12.521952 11175 raft_consensus.cc:2804] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:12.515161 10971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33927, user_credentials={real_user=slave}} blocked reactor thread for 44673.4us
I20260709 13:04:12.528205 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b3af5323c84e73b6cc311b8e672e92" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:12.528934 10248 raft_consensus.cc:3060] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.522759 11152 raft_consensus.cc:993] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.526326 10973 leader_election.cc:304] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:12.530269 11152 raft_consensus.cc:1081] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.528180 11062 raft_consensus.cc:515] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.535140 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:12.535816 10246 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.537848 10314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f8b0aa61814f979d50f80c58aa1da9" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:12.538664 10314 raft_consensus.cc:3055] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.539007 10314 raft_consensus.cc:740] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:12.540031 10314 consensus_queue.cc:260] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.541354 10314 raft_consensus.cc:3060] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.537348 10248 raft_consensus.cc:2468] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 3.
I20260709 13:04:12.545987 10246 raft_consensus.cc:2468] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.546561 11062 leader_election.cc:290] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:12.557157 10971 leader_election.cc:304] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:12.558604 11179 raft_consensus.cc:2804] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:12.560328 11178 raft_consensus.cc:2804] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.560111 10314 raft_consensus.cc:2468] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.561849 11063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b734032a14447b91008890f867d801"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34516
I20260709 13:04:12.562423 11063 raft_consensus.cc:493] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.562794 11063 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.568233 11179 raft_consensus.cc:697] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.569473 11179 consensus_queue.cc:237] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:12.571411 11063 raft_consensus.cc:515] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.578974 10314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:12.579597 10314 raft_consensus.cc:3055] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:12.579906 10314 raft_consensus.cc:740] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7e7b27d524749fbbbc0fa9855c2c5d1, State: Running, Role: LEADER
I20260709 13:04:12.580034 11063 leader_election.cc:290] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:04:12.580801 10314 consensus_queue.cc:260] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.581360 11175 raft_consensus.cc:697] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.582278 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b734032a14447b91008890f867d801" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:12.582927 10392 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.582579 11175 consensus_queue.cc:237] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.583392 11178 raft_consensus.cc:697] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.584934 11178 consensus_queue.cc:237] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:12.590660 10314 raft_consensus.cc:3060] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.601166 10314 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 3.
I20260709 13:04:12.602351 10970 leader_election.cc:304] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:04:12.608073 10392 raft_consensus.cc:2468] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 3.
I20260709 13:04:12.609198 11181 raft_consensus.cc:2804] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:12.610080 11181 raft_consensus.cc:697] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.614166 11181 consensus_queue.cc:237] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.631966 10072 catalog_manager.cc:5697] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.642212 11167 raft_consensus.cc:993] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.642766 11167 raft_consensus.cc:1081] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.644505 11063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34514
I20260709 13:04:12.645140 11063 raft_consensus.cc:493] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.645495 11063 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.652428 11063 raft_consensus.cc:515] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.655584 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:12.656177 10392 raft_consensus.cc:3055] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.656539 10392 raft_consensus.cc:740] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:12.657285 10392 consensus_queue.cc:260] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.659024 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eea7ab12e34becb6bc5d54471e2677" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:12.659605 10322 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.662645 11063 leader_election.cc:290] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:04:12.664915 10392 raft_consensus.cc:3060] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.666639 10322 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.668231 10970 leader_election.cc:304] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:04:12.669149 11175 raft_consensus.cc:2804] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.668804 10072 catalog_manager.cc:5697] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 2 to 3, leader changed from c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.669677 11175 raft_consensus.cc:697] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.670751 11175 consensus_queue.cc:237] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.671759 10392 raft_consensus.cc:2468] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.671768 10072 catalog_manager.cc:5697] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.673677 10072 catalog_manager.cc:5697] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 2 to 3, leader changed from b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.702306 10072 catalog_manager.cc:5697] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.731575 11168 raft_consensus.cc:993] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.732223 11174 raft_consensus.cc:1081] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:12.734133 11063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:12.734845 11063 raft_consensus.cc:493] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.735177 11063 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.741655 11063 raft_consensus.cc:515] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.742988 11063 leader_election.cc:290] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:04:12.743745 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:12.743891 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2969d49bd76040d8afcb37a6dcf16976" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:12.744349 10246 raft_consensus.cc:3055] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.744434 10392 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.744652 10246 raft_consensus.cc:740] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:12.745342 10246 consensus_queue.cc:260] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.746279 10246 raft_consensus.cc:3060] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.749361 10392 raft_consensus.cc:2468] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.750541 10973 leader_election.cc:304] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:12.751287 11175 raft_consensus.cc:2804] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.751780 11175 raft_consensus.cc:697] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:12.752784 10246 raft_consensus.cc:2468] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:12.752633 11175 consensus_queue.cc:237] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:12.762192 10072 catalog_manager.cc:5697] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.010921 10322 raft_consensus.cc:1275] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.012121 11175 consensus_queue.cc:1048] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.028270 10246 raft_consensus.cc:1275] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.031141 11175 consensus_queue.cc:1048] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.040740 10314 raft_consensus.cc:1275] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:13.057484 11181 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:13.073441 10322 raft_consensus.cc:1275] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.075204 11181 consensus_queue.cc:1048] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.086081 10392 raft_consensus.cc:1275] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:13.092731 10396 raft_consensus.cc:1275] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.097692 11180 consensus_queue.cc:1048] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.099392 11180 consensus_queue.cc:1048] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:13.100570 10392 raft_consensus.cc:1275] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:13.102825 11181 consensus_queue.cc:1048] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.120200 10246 raft_consensus.cc:1275] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 3 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:13.127581 11181 consensus_queue.cc:1048] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.142865 10246 raft_consensus.cc:1275] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.148643 11181 consensus_queue.cc:1048] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.184669 10322 raft_consensus.cc:1275] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.186493 11179 consensus_queue.cc:1048] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.309939 10392 raft_consensus.cc:1275] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.311611 11179 consensus_queue.cc:1048] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.329324 10246 raft_consensus.cc:1275] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.335021 11181 consensus_queue.cc:1048] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.343354   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.419919   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.461143 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:13.461680 10246 raft_consensus.cc:606] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:13.464056 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8"
dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:04:13.464840 10396 raft_consensus.cc:606] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:13.468851 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:13.469482 10246 raft_consensus.cc:606] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:13.472360 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:13.473101 10246 raft_consensus.cc:606] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:13.476619 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:13.477380 10246 raft_consensus.cc:606] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:13.478478   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:13.480237   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:13.658927 11206 raft_consensus.cc:993] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.659857 11162 raft_consensus.cc:1081] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.661612 11061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:13.662159 11061 raft_consensus.cc:493] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.662500 11061 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.670341 11061 raft_consensus.cc:515] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.675132 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:13.675444 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713471af698942b9b05f26e036e3bf4e" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:13.675846 10246 raft_consensus.cc:3055] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.676003 11061 leader_election.cc:290] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:13.676105 10321 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.676352 10246 raft_consensus.cc:740] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:13.677326 10246 consensus_queue.cc:260] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.678130 10246 raft_consensus.cc:3060] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.684687 10246 raft_consensus.cc:2468] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.686041 10971 leader_election.cc:304] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7; no voters: 
I20260709 13:04:13.686439 10321 raft_consensus.cc:2468] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.687831 11175 raft_consensus.cc:2804] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.688719 11175 raft_consensus.cc:697] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:13.689894 11175 consensus_queue.cc:237] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.700908 10070 catalog_manager.cc:5697] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.772679 11206 raft_consensus.cc:993] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.773186 11206 raft_consensus.cc:1081] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.774730 11062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:13.775286 11062 raft_consensus.cc:493] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.775616 11062 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.781484 11062 raft_consensus.cc:515] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.783064 11062 leader_election.cc:290] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:13.783876 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:13.784134 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3edbb4b0647f8a4c252423178ce18" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:13.784468 10246 raft_consensus.cc:3055] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.784682 10321 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.784814 10246 raft_consensus.cc:740] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:13.785678 10246 consensus_queue.cc:260] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.786653 10246 raft_consensus.cc:3060] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.789862 10321 raft_consensus.cc:2468] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.791122 10970 leader_election.cc:304] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:04:13.791780 10246 raft_consensus.cc:2468] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.791812 11175 raft_consensus.cc:2804] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.792887 11175 raft_consensus.cc:697] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:13.794035 11175 consensus_queue.cc:237] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.806226 10070 catalog_manager.cc:5697] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.878839 11162 raft_consensus.cc:993] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.879307 11206 raft_consensus.cc:1081] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.880859 11062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:13.881502 11062 raft_consensus.cc:493] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.881852 11062 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.883944 11206 raft_consensus.cc:993] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.884663 11162 raft_consensus.cc:1081] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.886303 11061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:13.886854 11061 raft_consensus.cc:493] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.887465 11061 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.890065 11062 raft_consensus.cc:515] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.892551 11062 leader_election.cc:290] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927), b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585)
I20260709 13:04:13.893424 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:13.893535 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de7767ee77c4969bba8c9350190f185" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:13.894248 10321 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.894327 10246 raft_consensus.cc:3055] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.894757 10246 raft_consensus.cc:740] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:13.895571 11061 raft_consensus.cc:515] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:13.895581 10246 consensus_queue.cc:260] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.897710 11061 leader_election.cc:290] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:13.898720 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:13.899382 10248 raft_consensus.cc:3055] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.899688 10248 raft_consensus.cc:740] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:13.899879 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03c643c1bde4551be180d6ce6a7f407" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:13.900532 10396 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.900514 10248 consensus_queue.cc:260] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:13.902320 10248 raft_consensus.cc:3060] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.897205 10246 raft_consensus.cc:3060] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.905200 10321 raft_consensus.cc:2468] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.906729 10970 leader_election.cc:304] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:04:13.911438 11175 raft_consensus.cc:2804] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.913115 11175 raft_consensus.cc:697] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:13.914029 11175 consensus_queue.cc:237] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } }
I20260709 13:04:13.916102 10396 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.919940 10973 leader_election.cc:304] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:13.920097 10248 raft_consensus.cc:2468] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.920929 11178 raft_consensus.cc:2804] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.921432 11178 raft_consensus.cc:697] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:13.922667 11178 consensus_queue.cc:237] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:13.924434 10246 raft_consensus.cc:2468] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.932782 10070 catalog_manager.cc:5697] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.949182 10070 catalog_manager.cc:5697] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.960703 11153 raft_consensus.cc:993] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.961159 11153 raft_consensus.cc:1081] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:13.963096 11061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34514
I20260709 13:04:13.964282 11061 raft_consensus.cc:493] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.964640 11061 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.968953 11061 raft_consensus.cc:515] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:13.970280 11061 leader_election.cc:290] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585), c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853)
I20260709 13:04:13.971122 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:13.971717 10396 raft_consensus.cc:3055] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.971928 10396 raft_consensus.cc:740] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b5b492fca940a3883a22eec56a4f9f, State: Running, Role: LEADER
I20260709 13:04:13.970999 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590ebc0addd48ceb9f37bffbe5de9c8" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1"
I20260709 13:04:13.972433 10321 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.972692 10396 consensus_queue.cc:260] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:13.974105 10396 raft_consensus.cc:3060] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.978369 10321 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.979384 10396 raft_consensus.cc:2468] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:13.979481 10970 leader_election.cc:304] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, b7e7b27d524749fbbbc0fa9855c2c5d1; no voters: 
I20260709 13:04:13.980273 11178 raft_consensus.cc:2804] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.980808 11178 raft_consensus.cc:697] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:13.981619 11178 consensus_queue.cc:237] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } }
I20260709 13:04:13.993117 10070 catalog_manager.cc:5697] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.113252 10314 raft_consensus.cc:1275] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.114750 11181 consensus_queue.cc:1048] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.138161 10246 raft_consensus.cc:1275] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.140108 11181 consensus_queue.cc:1048] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.290423 10321 raft_consensus.cc:1275] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.291514 11175 consensus_queue.cc:1048] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.295280 10314 raft_consensus.cc:1275] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.297021 11175 consensus_queue.cc:1048] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.300488 10246 raft_consensus.cc:1275] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.303033 11178 consensus_queue.cc:1048] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.325336 10248 raft_consensus.cc:1275] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.327112 11181 consensus_queue.cc:1048] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.382766 10248 raft_consensus.cc:1275] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.383885 11181 consensus_queue.cc:1048] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.395324 10396 raft_consensus.cc:1275] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.399181 11178 consensus_queue.cc:1048] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.406437 10321 raft_consensus.cc:1275] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.408003 11178 consensus_queue.cc:1048] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e7b27d524749fbbbc0fa9855c2c5d1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.425170 10397 raft_consensus.cc:1275] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.426669 11181 consensus_queue.cc:1048] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.481299   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.527009   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.575919 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:14.576519 10246 raft_consensus.cc:606] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:14.579958 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:14.580792 10246 raft_consensus.cc:606] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:14.583858 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9"
dest_uuid: "caa864648e614090be53d8ece3cd29b7"
mode: GRACEFUL
new_leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:04:14.584395 10246 raft_consensus.cc:606] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Received request to transfer leadership to TS 03e8e4753ffb400b8e90eaff84fc1f10
I20260709 13:04:14.585392   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:14.586637   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:14.904834 11206 raft_consensus.cc:993] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.905421 11230 raft_consensus.cc:1081] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.907011 11062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:14.907645 11062 raft_consensus.cc:493] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.908069 11062 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.914120 11062 raft_consensus.cc:515] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.915956 11062 leader_election.cc:290] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:14.916854 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:14.917150 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05527a68e23b4b8e93c8f818819cc68a" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:14.917749 10397 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.918104 10246 raft_consensus.cc:3055] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:14.918444 10246 raft_consensus.cc:740] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:14.919435 10246 consensus_queue.cc:260] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.920848 10246 raft_consensus.cc:3060] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.924131 10397 raft_consensus.cc:2468] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:14.925097 10973 leader_election.cc:304] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:14.925779 11181 raft_consensus.cc:2804] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.926280 11181 raft_consensus.cc:697] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:14.927089 11181 consensus_queue.cc:237] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.927688 10246 raft_consensus.cc:2468] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:14.949764 11230 raft_consensus.cc:993] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.950263 11230 raft_consensus.cc:1081] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.954079 11061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:14.954659 11061 raft_consensus.cc:493] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.954975 11061 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.955861 10072 catalog_manager.cc:5697] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.965085 11061 raft_consensus.cc:515] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.967583 11061 leader_election.cc:290] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:14.968372 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:14.969045 10397 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.969653 11230 raft_consensus.cc:993] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: : Instructing follower 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.970177 11230 raft_consensus.cc:1081] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Signalling peer 03e8e4753ffb400b8e90eaff84fc1f10 to start an election
I20260709 13:04:14.971864 11062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c"
dest_uuid: "03e8e4753ffb400b8e90eaff84fc1f10"
 from {username='slave'} at 127.0.0.1:34510
I20260709 13:04:14.972478 11062 raft_consensus.cc:493] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.972751 11062 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.971292 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287703ffe0634dd5a45da31c0ad95de9" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:14.976246 10246 raft_consensus.cc:3055] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:14.977173 10246 raft_consensus.cc:740] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:14.980527 11062 raft_consensus.cc:515] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.980597 10246 consensus_queue.cc:260] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.983649 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "caa864648e614090be53d8ece3cd29b7"
I20260709 13:04:14.984251 10248 raft_consensus.cc:3055] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:14.982605 11062 leader_election.cc:290] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Requested vote from peers c4b5b492fca940a3883a22eec56a4f9f (127.0.107.196:35853), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:14.983242 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037e0166c77b44e4b4fcf5ec317fc05c" candidate_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b5b492fca940a3883a22eec56a4f9f"
I20260709 13:04:14.984580 10248 raft_consensus.cc:740] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: caa864648e614090be53d8ece3cd29b7, State: Running, Role: LEADER
I20260709 13:04:14.985203 10396 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.985414 10248 consensus_queue.cc:260] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.986711 10248 raft_consensus.cc:3060] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.977800 10397 raft_consensus.cc:2468] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:14.988013 10973 leader_election.cc:304] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:14.989077 11181 raft_consensus.cc:2804] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.989545 11181 raft_consensus.cc:697] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:14.990394 11181 consensus_queue.cc:237] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:14.998947 10396 raft_consensus.cc:2468] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:14.984591 10246 raft_consensus.cc:3060] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.000141 10973 leader_election.cc:304] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e8e4753ffb400b8e90eaff84fc1f10, c4b5b492fca940a3883a22eec56a4f9f; no voters: 
I20260709 13:04:15.002135 11226 raft_consensus.cc:2804] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.001211 10248 raft_consensus.cc:2468] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:15.014578 10246 raft_consensus.cc:2468] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e8e4753ffb400b8e90eaff84fc1f10 in term 2.
I20260709 13:04:15.017840 11226 raft_consensus.cc:697] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Becoming Leader. State: Replica: 03e8e4753ffb400b8e90eaff84fc1f10, State: Running, Role: LEADER
I20260709 13:04:15.019373 11226 consensus_queue.cc:237] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:15.033516 10072 catalog_manager.cc:5697] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.035130 10072 catalog_manager.cc:5697] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 reported cstate change: term changed from 1 to 2, leader changed from caa864648e614090be53d8ece3cd29b7 (127.0.107.194) to 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.388289 10246 raft_consensus.cc:1275] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.389631 11226 consensus_queue.cc:1048] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.394891 10248 raft_consensus.cc:1275] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.397291 11245 consensus_queue.cc:1048] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:15.428784 10396 raft_consensus.cc:1275] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.431149 10397 raft_consensus.cc:1275] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.431594 11226 consensus_queue.cc:1048] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.444887 11244 consensus_queue.cc:1048] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.496624 10397 raft_consensus.cc:1275] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.497980 11245 consensus_queue.cc:1048] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.508263 10246 raft_consensus.cc:1275] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Refusing update from remote peer 03e8e4753ffb400b8e90eaff84fc1f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.511534 11244 consensus_queue.cc:1048] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.587771   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.626967   431 tablet_server.cc:179] TabletServer@127.0.107.193:35805 shutting down...
W20260709 13:04:15.631726 10364 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 241 similar messages]
W20260709 13:04:15.639240 10364 consensus_peers.cc:597] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.655398 10289 consensus_peers.cc:597] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.662730 10364 consensus_peers.cc:597] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.667625   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:15.668814   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.669536   431 raft_consensus.cc:2243] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.670517   431 raft_consensus.cc:2272] T 5590ebc0addd48ceb9f37bffbe5de9c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.673676   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.674904   431 raft_consensus.cc:2243] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.676201   431 raft_consensus.cc:2272] T f48ec6559166499ca5242a577701f114 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.676360 10215 consensus_peers.cc:597] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.679366   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.680437   431 raft_consensus.cc:2243] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.681262   431 raft_consensus.cc:2272] T 74aa2caa4cef407db88d87691e1e3e3c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.684685   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:15.685400 10215 consensus_peers.cc:597] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.685792   431 raft_consensus.cc:2243] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.686750   431 raft_consensus.cc:2272] T b03c643c1bde4551be180d6ce6a7f407 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.687070 10215 consensus_peers.cc:597] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.689483   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.690168   431 raft_consensus.cc:2243] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.690949   431 raft_consensus.cc:2272] T 21b734032a14447b91008890f867d801 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.693163   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.694006   431 raft_consensus.cc:2243] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.694432   431 raft_consensus.cc:2272] T b7cf8b715d234c44aac72258d0bac01f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.697134   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.697746   431 raft_consensus.cc:2243] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.698230   431 raft_consensus.cc:2272] T aa3d6f0a40934634966942872cb2fcc3 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.700699   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.701303   431 raft_consensus.cc:2243] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.702253   431 raft_consensus.cc:2272] T 287703ffe0634dd5a45da31c0ad95de9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.704617   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.705214   431 raft_consensus.cc:2243] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.705981   431 raft_consensus.cc:2272] T ffe3edbb4b0647f8a4c252423178ce18 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.708020   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.708726   431 raft_consensus.cc:2243] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.709532   431 raft_consensus.cc:2272] T 60f8b0aa61814f979d50f80c58aa1da9 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.712688   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.713666   431 raft_consensus.cc:2243] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.714107   431 raft_consensus.cc:2272] T 2c96e8c718214d359041be0247dd3c4b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.716602   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.717216   431 raft_consensus.cc:2243] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.717628   431 raft_consensus.cc:2272] T 2a72a81e18bd4f33ab1f087ecbd1c83d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.719838   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.720510   431 raft_consensus.cc:2243] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.721146   431 raft_consensus.cc:2272] T a7608db3fe6943948ba234b016c7f8b8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.723381 10215 consensus_peers.cc:597] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.723572   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.724478   431 raft_consensus.cc:2243] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.724980   431 raft_consensus.cc:2272] T 82534bc4cd7045f6a24502bff235976d P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.727608   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.728397   431 raft_consensus.cc:2243] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.728976   431 raft_consensus.cc:2272] T 60901c3e414849a18fdd33dbe5c1f878 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.730535 10215 consensus_peers.cc:597] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.731741   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.732457   431 raft_consensus.cc:2243] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.732887   431 raft_consensus.cc:2272] T 5a9e7f66e663495dac8f9b10d847b0f6 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.735112   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.735934   431 raft_consensus.cc:2243] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.736446   431 raft_consensus.cc:2272] T f33497a7cce7475fb1f48d994ccdb42e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.739679   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:15.740046 10289 consensus_peers.cc:597] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.740732   431 raft_consensus.cc:2243] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.741400   431 raft_consensus.cc:2272] T d884577f53054c19b81aad58eca5d459 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.744118   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.745003   431 raft_consensus.cc:2243] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.745635   431 raft_consensus.cc:2272] T 7f990deb05e0436ab18c7ac796c66c3a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.748865   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.749886   431 raft_consensus.cc:2243] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.750419   431 raft_consensus.cc:2272] T ff063a758e5e46bb8e8277d3b6d4ee07 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.753746   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.754667   431 raft_consensus.cc:2243] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.755203   431 raft_consensus.cc:2272] T 13a5c8e6908849eba50516a7beb99556 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.758602   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.759444   431 raft_consensus.cc:2243] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.759903   431 raft_consensus.cc:2272] T 1325c482dbf64578a5799209e1af6370 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.762022 10364 consensus_peers.cc:597] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.762712 10364 consensus_peers.cc:597] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.762728   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.763674   431 raft_consensus.cc:2243] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.764243   431 raft_consensus.cc:2272] T 78e7bbdd88eb4f6ea262e8951785f78a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.767297   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.768087   431 raft_consensus.cc:2243] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.768595   431 raft_consensus.cc:2272] T 16b86688c0044287ad4812aa1134a0c8 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.771657   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.772553   431 raft_consensus.cc:2243] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.773144   431 raft_consensus.cc:2272] T efdaf286bda5432ba867269e864dfd32 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.776203   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.777066   431 raft_consensus.cc:2243] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.777635   431 raft_consensus.cc:2272] T b795492ea96e4371835f5f4cacaf9141 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.780925   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.781737   431 raft_consensus.cc:2243] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.782269   431 raft_consensus.cc:2272] T 289c2698ec0e4ce5aa73380329eaeb85 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.785176   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.786010   431 raft_consensus.cc:2243] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.786532   431 raft_consensus.cc:2272] T 4c269356f5284edabf474b9034c8da3f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.789400   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.790180   431 raft_consensus.cc:2243] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.791229   431 raft_consensus.cc:2272] T 05527a68e23b4b8e93c8f818819cc68a P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.794341   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.795222   431 raft_consensus.cc:2243] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:15.795302 10289 consensus_peers.cc:597] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.795663   431 raft_consensus.cc:2272] T daa66713733740428121c8683ffb7c90 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.798255   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.798882   431 raft_consensus.cc:2243] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.799321   431 raft_consensus.cc:2272] T 6c9543c32b3846c78cd39da12cdbf781 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.802986   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.803817   431 raft_consensus.cc:2243] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.804953   431 raft_consensus.cc:2272] T 037e0166c77b44e4b4fcf5ec317fc05c P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.808965   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.809803   431 raft_consensus.cc:2243] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.810909   431 raft_consensus.cc:2272] T 389b7d02e091434d92c8b6ed3ad13c15 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.813793   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.814338   431 raft_consensus.cc:2243] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.814801   431 raft_consensus.cc:2272] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.817597   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.818220   431 raft_consensus.cc:2243] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.819209   431 raft_consensus.cc:2272] T 713471af698942b9b05f26e036e3bf4e P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.821825   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.822364   431 raft_consensus.cc:2243] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.822808   431 raft_consensus.cc:2272] T d7187ede0b76425593900305a48a4aa2 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.825541   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.826114   431 raft_consensus.cc:2243] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.827071   431 raft_consensus.cc:2272] T 2de7767ee77c4969bba8c9350190f185 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.829576   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.830189   431 raft_consensus.cc:2243] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.830690   431 raft_consensus.cc:2272] T 14f42bc2234743f1bf7ae96281ec598b P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.833105   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.833565   431 raft_consensus.cc:2243] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.834244   431 raft_consensus.cc:2272] T 2969d49bd76040d8afcb37a6dcf16976 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.836143   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.836684   431 raft_consensus.cc:2243] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.837209   431 raft_consensus.cc:2272] T 38417199a01548d58b4afa4478c87a09 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.840351   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.841209   431 raft_consensus.cc:2243] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.841786   431 raft_consensus.cc:2272] T 50a00d13ac4c46b980527f87fe684f46 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.843779   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.844440   431 raft_consensus.cc:2243] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.845294   431 raft_consensus.cc:2272] T 13eea7ab12e34becb6bc5d54471e2677 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.847661   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.848281   431 raft_consensus.cc:2243] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.848955   431 raft_consensus.cc:2272] T 136327a8d9d14b05838f2e67d241c7f7 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.851635   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.852191   431 raft_consensus.cc:2243] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.852982   431 raft_consensus.cc:2272] T 26b3af5323c84e73b6cc311b8e672e92 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.855194   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.855660   431 raft_consensus.cc:2243] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.856024   431 raft_consensus.cc:2272] T bd84114c08b54e2892bb67e63f67b987 P 03e8e4753ffb400b8e90eaff84fc1f10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.870007 10215 consensus_peers.cc:597] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.889590 10215 consensus_peers.cc:597] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.896104 10364 consensus_peers.cc:597] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.906418 10364 consensus_peers.cc:597] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.932747 10364 consensus_peers.cc:597] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.933475   431 tablet_server.cc:196] TabletServer@127.0.107.193:35805 shutdown complete.
W20260709 13:04:15.938782 10215 consensus_peers.cc:597] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.951123 10289 consensus_peers.cc:597] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.985605 10364 consensus_peers.cc:597] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.986202 10364 consensus_peers.cc:597] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.995769 10364 consensus_peers.cc:597] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.001791 10364 consensus_peers.cc:597] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.013589 10289 consensus_peers.cc:597] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.023792 10289 consensus_peers.cc:597] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.048789 10364 consensus_peers.cc:597] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.050477   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:16.072510 10215 consensus_peers.cc:597] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.086133 10287 consensus_peers.cc:597] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.086467 10362 consensus_peers.cc:597] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.090839 10215 consensus_peers.cc:597] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.092133 10362 consensus_peers.cc:597] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.094475 10287 consensus_peers.cc:597] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.095191   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:16.096355   431 tablet_replica.cc:333] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.097434   431 raft_consensus.cc:2243] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.098107   431 raft_consensus.cc:2272] T b03c643c1bde4551be180d6ce6a7f407 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.101044   431 tablet_replica.cc:333] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
W20260709 13:04:16.101536 10289 consensus_peers.cc:597] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.102005   431 raft_consensus.cc:2243] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.103626   431 raft_consensus.cc:2272] T 78e7bbdd88eb4f6ea262e8951785f78a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.106055   431 tablet_replica.cc:333] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.106814   431 raft_consensus.cc:2243] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.107771   431 raft_consensus.cc:2272] T 136327a8d9d14b05838f2e67d241c7f7 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.110188   431 tablet_replica.cc:333] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.110862   431 raft_consensus.cc:2243] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.111729   431 raft_consensus.cc:2272] T d27c8a705d134d5f96385dc1ed5aaa3d P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.113929   431 tablet_replica.cc:333] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.114488   431 raft_consensus.cc:2243] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.115216   431 raft_consensus.cc:2272] T 50a00d13ac4c46b980527f87fe684f46 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.117973   431 tablet_replica.cc:333] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.118610   431 raft_consensus.cc:2243] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.119633   431 raft_consensus.cc:2272] T fc4d416a3b0a41bb80cd831c381eb1bf P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.121868   431 tablet_replica.cc:333] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.122457   431 raft_consensus.cc:2243] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.122891   431 raft_consensus.cc:2272] T 14f42bc2234743f1bf7ae96281ec598b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.124948   431 tablet_replica.cc:333] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.125531   431 raft_consensus.cc:2243] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.126343   431 raft_consensus.cc:2272] T d884577f53054c19b81aad58eca5d459 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.128525   431 tablet_replica.cc:333] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.129098   431 raft_consensus.cc:2243] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.129528   431 raft_consensus.cc:2272] T f33497a7cce7475fb1f48d994ccdb42e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.131693   431 tablet_replica.cc:333] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.132474   431 raft_consensus.cc:2243] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.133036   431 raft_consensus.cc:2272] T 9c69db33a1ce4b1894e7cc946d24270c P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.135495   431 tablet_replica.cc:333] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.136066   431 raft_consensus.cc:2243] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.136596   431 raft_consensus.cc:2272] T 26b3af5323c84e73b6cc311b8e672e92 P caa864648e614090be53d8ece3cd29b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.139036   431 tablet_replica.cc:333] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.139925   431 raft_consensus.cc:2243] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.140960   431 raft_consensus.cc:2272] T 2c96e8c718214d359041be0247dd3c4b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.143313   431 tablet_replica.cc:333] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.144071   431 raft_consensus.cc:2243] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.144538   431 raft_consensus.cc:2272] T f48ec6559166499ca5242a577701f114 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.146382   431 tablet_replica.cc:333] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.147043   431 raft_consensus.cc:2243] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.147498   431 raft_consensus.cc:2272] T e981dc5ffbe9413a941979a7e31690e1 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.149778   431 tablet_replica.cc:333] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.150385   431 raft_consensus.cc:2243] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.150851   431 raft_consensus.cc:2272] T dff683367d884f7799d765efa95a0c5a P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.152981   431 tablet_replica.cc:333] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.153537   431 raft_consensus.cc:2243] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.153934   431 raft_consensus.cc:2272] T 05527a68e23b4b8e93c8f818819cc68a P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.156797   431 tablet_replica.cc:333] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.157371   431 raft_consensus.cc:2243] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.158102   431 raft_consensus.cc:2272] T daa66713733740428121c8683ffb7c90 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.159869   431 tablet_replica.cc:333] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.160426   431 raft_consensus.cc:2243] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.161170   431 raft_consensus.cc:2272] T e27f9cdf5f7448b1b83691579db44a27 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.163256   431 tablet_replica.cc:333] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.163802   431 raft_consensus.cc:2243] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.164248   431 raft_consensus.cc:2272] T 289c2698ec0e4ce5aa73380329eaeb85 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.166674   431 tablet_replica.cc:333] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.167203   431 raft_consensus.cc:2243] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.167994   431 raft_consensus.cc:2272] T f34d9d4b33884f7e8f29d0379b00614f P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.170343 10287 consensus_peers.cc:597] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.171053   431 tablet_replica.cc:333] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.172055   431 raft_consensus.cc:2243] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.172667   431 raft_consensus.cc:2272] T 2969d49bd76040d8afcb37a6dcf16976 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.175163   431 tablet_replica.cc:333] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.176123   431 raft_consensus.cc:2243] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.176765   431 raft_consensus.cc:2272] T 38417199a01548d58b4afa4478c87a09 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.179003   431 tablet_replica.cc:333] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.179584   431 raft_consensus.cc:2243] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.180020   431 raft_consensus.cc:2272] T bae79c759a874e5ab8c3a59dbde5aa0e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.182238   431 tablet_replica.cc:333] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.182835   431 raft_consensus.cc:2243] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.183270   431 raft_consensus.cc:2272] T 41a65ec678174d949e2450a98c0f072b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.185261   431 tablet_replica.cc:333] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.185791   431 raft_consensus.cc:2243] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.186527   431 raft_consensus.cc:2272] T 6c9543c32b3846c78cd39da12cdbf781 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.188467   431 tablet_replica.cc:333] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.188980   431 raft_consensus.cc:2243] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.189364   431 raft_consensus.cc:2272] T 037e0166c77b44e4b4fcf5ec317fc05c P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.192168   431 tablet_replica.cc:333] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.192956   431 raft_consensus.cc:2243] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.193509   431 raft_consensus.cc:2272] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.195895   431 tablet_replica.cc:333] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.196554   431 raft_consensus.cc:2243] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.197075   431 raft_consensus.cc:2272] T 713471af698942b9b05f26e036e3bf4e P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.197466 10364 consensus_peers.cc:597] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.199383   431 tablet_replica.cc:333] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.200071   431 raft_consensus.cc:2243] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.200519   431 raft_consensus.cc:2272] T d7187ede0b76425593900305a48a4aa2 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.203193   431 tablet_replica.cc:333] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.203941   431 raft_consensus.cc:2243] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.204916   431 raft_consensus.cc:2272] T ff063a758e5e46bb8e8277d3b6d4ee07 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.207465   431 tablet_replica.cc:333] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.208141   431 raft_consensus.cc:2243] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.208715   431 raft_consensus.cc:2272] T 13a5c8e6908849eba50516a7beb99556 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.209368 10287 consensus_peers.cc:597] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.211076   431 tablet_replica.cc:333] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.211876   431 raft_consensus.cc:2243] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.212414   431 raft_consensus.cc:2272] T 60901c3e414849a18fdd33dbe5c1f878 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.214772   431 tablet_replica.cc:333] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.215504   431 raft_consensus.cc:2243] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.216038   431 raft_consensus.cc:2272] T feaf74617ea14c089e379068bd362ac8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.219134   431 tablet_replica.cc:333] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.219929   431 raft_consensus.cc:2243] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.220625   431 raft_consensus.cc:2272] T 86dad9027a254289ad29f258e8fbf67b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.221499 10362 consensus_peers.cc:597] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.222544 10289 consensus_peers.cc:597] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Couldn't send request to peer 03e8e4753ffb400b8e90eaff84fc1f10. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.223605   431 tablet_replica.cc:333] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.224438   431 raft_consensus.cc:2243] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:16.224992 10287 consensus_peers.cc:597] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.225028   431 raft_consensus.cc:2272] T 7d927f3c7f024383ae5d8d4e018327fa P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.227926   431 tablet_replica.cc:333] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.228572   431 raft_consensus.cc:2243] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.228987   431 raft_consensus.cc:2272] T ffe3edbb4b0647f8a4c252423178ce18 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.230981   431 tablet_replica.cc:333] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.231695   431 raft_consensus.cc:2243] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.232617   431 raft_consensus.cc:2272] T 2e11d29a68964be6ba9535eba55c272e P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.234885   431 tablet_replica.cc:333] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.235666   431 raft_consensus.cc:2243] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.236192   431 raft_consensus.cc:2272] T b795492ea96e4371835f5f4cacaf9141 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.238628   431 tablet_replica.cc:333] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.239127   431 raft_consensus.cc:2243] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.239899   431 raft_consensus.cc:2272] T 16b86688c0044287ad4812aa1134a0c8 P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.242527   431 tablet_replica.cc:333] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.243072   431 raft_consensus.cc:2243] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.243512   431 raft_consensus.cc:2272] T 07e39f05718844ce83488f64c90de17b P caa864648e614090be53d8ece3cd29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.245594   431 tablet_replica.cc:333] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.246106   431 raft_consensus.cc:2243] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.246490   431 raft_consensus.cc:2272] T 60f8b0aa61814f979d50f80c58aa1da9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.248404   431 tablet_replica.cc:333] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.248895   431 raft_consensus.cc:2243] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.249665   431 raft_consensus.cc:2272] T 82534bc4cd7045f6a24502bff235976d P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.251714   431 tablet_replica.cc:333] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.252380   431 raft_consensus.cc:2243] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.252997   431 raft_consensus.cc:2272] T 287703ffe0634dd5a45da31c0ad95de9 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.256564   431 tablet_replica.cc:333] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7: stopping tablet replica
I20260709 13:04:16.257318   431 raft_consensus.cc:2243] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.257834   431 raft_consensus.cc:2272] T 2de7767ee77c4969bba8c9350190f185 P caa864648e614090be53d8ece3cd29b7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.266068 10287 consensus_peers.cc:597] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.290313 10287 consensus_peers.cc:597] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.368201   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:16.389919 10287 consensus_peers.cc:597] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.399969 10287 consensus_peers.cc:597] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.449988 10362 consensus_peers.cc:597] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.452796   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:16.467338 10287 consensus_peers.cc:597] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.482285 10362 consensus_peers.cc:597] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.497937 10361 consensus_peers.cc:597] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.498476 10361 consensus_peers.cc:597] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.500029 10287 consensus_peers.cc:597] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.508037 10362 consensus_peers.cc:597] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.529263   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:16.530189   431 tablet_replica.cc:333] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.530875   431 raft_consensus.cc:2243] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.531405   431 raft_consensus.cc:2272] T d27c8a705d134d5f96385dc1ed5aaa3d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.533424   431 tablet_replica.cc:333] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.533981   431 raft_consensus.cc:2243] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.534394   431 raft_consensus.cc:2272] T 136327a8d9d14b05838f2e67d241c7f7 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.536422   431 tablet_replica.cc:333] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.537170   431 raft_consensus.cc:2243] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.537667   431 raft_consensus.cc:2272] T 13eea7ab12e34becb6bc5d54471e2677 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.540043   431 tablet_replica.cc:333] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.540867   431 raft_consensus.cc:2243] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.541504   431 raft_consensus.cc:2272] T 50a00d13ac4c46b980527f87fe684f46 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.544004   431 tablet_replica.cc:333] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.544615   431 raft_consensus.cc:2243] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.545064   431 raft_consensus.cc:2272] T 2a72a81e18bd4f33ab1f087ecbd1c83d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.547518   431 tablet_replica.cc:333] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.548121   431 raft_consensus.cc:2243] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.548594   431 raft_consensus.cc:2272] T aa3d6f0a40934634966942872cb2fcc3 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.550580   431 tablet_replica.cc:333] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.551139   431 raft_consensus.cc:2243] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.551934   431 raft_consensus.cc:2272] T 14f42bc2234743f1bf7ae96281ec598b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.553843   431 tablet_replica.cc:333] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.554402   431 raft_consensus.cc:2243] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.555368   431 raft_consensus.cc:2272] T b7cf8b715d234c44aac72258d0bac01f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.557861   431 tablet_replica.cc:333] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.558492   431 raft_consensus.cc:2243] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.559100   431 raft_consensus.cc:2272] T 2c96e8c718214d359041be0247dd3c4b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.561987   431 tablet_replica.cc:333] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.562790   431 raft_consensus.cc:2243] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.563771   431 raft_consensus.cc:2272] T e981dc5ffbe9413a941979a7e31690e1 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.566258   431 tablet_replica.cc:333] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.566812   431 raft_consensus.cc:2243] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.567224   431 raft_consensus.cc:2272] T 78e7bbdd88eb4f6ea262e8951785f78a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.569182   431 tablet_replica.cc:333] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.569698   431 raft_consensus.cc:2243] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.570367   431 raft_consensus.cc:2272] T 1325c482dbf64578a5799209e1af6370 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.572147   431 tablet_replica.cc:333] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.572719   431 raft_consensus.cc:2243] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.573076   431 raft_consensus.cc:2272] T f48ec6559166499ca5242a577701f114 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.574800   431 tablet_replica.cc:333] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.575330   431 raft_consensus.cc:2243] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.575724   431 raft_consensus.cc:2272] T 86dad9027a254289ad29f258e8fbf67b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.577672   431 tablet_replica.cc:333] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.578188   431 raft_consensus.cc:2243] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.578949   431 raft_consensus.cc:2272] T 7d927f3c7f024383ae5d8d4e018327fa P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.580837   431 tablet_replica.cc:333] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.581466   431 raft_consensus.cc:2243] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.581897   431 raft_consensus.cc:2272] T feaf74617ea14c089e379068bd362ac8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.583906   431 tablet_replica.cc:333] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.584491   431 raft_consensus.cc:2243] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.584919   431 raft_consensus.cc:2272] T 21b734032a14447b91008890f867d801 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.587283   431 tablet_replica.cc:333] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.587908   431 raft_consensus.cc:2243] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.588747   431 raft_consensus.cc:2272] T 13a5c8e6908849eba50516a7beb99556 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.589748 10362 consensus_peers.cc:597] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Couldn't send request to peer caa864648e614090be53d8ece3cd29b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.590965   431 tablet_replica.cc:333] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.591650   431 raft_consensus.cc:2243] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.592062   431 raft_consensus.cc:2272] T bd84114c08b54e2892bb67e63f67b987 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.594187   431 tablet_replica.cc:333] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.594767   431 raft_consensus.cc:2243] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.595180   431 raft_consensus.cc:2272] T e27f9cdf5f7448b1b83691579db44a27 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.597647   431 tablet_replica.cc:333] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.598228   431 raft_consensus.cc:2243] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.598990   431 raft_consensus.cc:2272] T 289c2698ec0e4ce5aa73380329eaeb85 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.601106   431 tablet_replica.cc:333] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.601660   431 raft_consensus.cc:2243] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.602044   431 raft_consensus.cc:2272] T f34d9d4b33884f7e8f29d0379b00614f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.603801   431 tablet_replica.cc:333] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.604380   431 raft_consensus.cc:2243] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.605500   431 raft_consensus.cc:2272] T bae79c759a874e5ab8c3a59dbde5aa0e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.608026   431 tablet_replica.cc:333] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.608734   431 raft_consensus.cc:2243] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.609618   431 raft_consensus.cc:2272] T 41a65ec678174d949e2450a98c0f072b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.612275   431 tablet_replica.cc:333] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.613142   431 raft_consensus.cc:2243] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.613649   431 raft_consensus.cc:2272] T 5a9e7f66e663495dac8f9b10d847b0f6 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.615552   431 tablet_replica.cc:333] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.616120   431 raft_consensus.cc:2243] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.616575   431 raft_consensus.cc:2272] T 7f990deb05e0436ab18c7ac796c66c3a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.618528   431 tablet_replica.cc:333] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.619052   431 raft_consensus.cc:2243] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.619809   431 raft_consensus.cc:2272] T dff683367d884f7799d765efa95a0c5a P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.622160   431 tablet_replica.cc:333] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.622727   431 raft_consensus.cc:2243] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.623170   431 raft_consensus.cc:2272] T 4c269356f5284edabf474b9034c8da3f P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.625105   431 tablet_replica.cc:333] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.625643   431 raft_consensus.cc:2243] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.626053   431 raft_consensus.cc:2272] T 713471af698942b9b05f26e036e3bf4e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.628150   431 tablet_replica.cc:333] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.628856   431 raft_consensus.cc:2243] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.629735   431 raft_consensus.cc:2272] T b795492ea96e4371835f5f4cacaf9141 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.631413 10361 consensus_peers.cc:597] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.632050   431 tablet_replica.cc:333] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.632640   431 raft_consensus.cc:2243] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.633358   431 raft_consensus.cc:2272] T efdaf286bda5432ba867269e864dfd32 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.635279   431 tablet_replica.cc:333] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.635808   431 raft_consensus.cc:2243] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.636210   431 raft_consensus.cc:2272] T 16b86688c0044287ad4812aa1134a0c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.638303   431 tablet_replica.cc:333] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.638844   431 raft_consensus.cc:2243] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.639324   431 raft_consensus.cc:2272] T fc4d416a3b0a41bb80cd831c381eb1bf P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.642114   431 tablet_replica.cc:333] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.642694   431 raft_consensus.cc:2243] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.643215   431 raft_consensus.cc:2272] T a7608db3fe6943948ba234b016c7f8b8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.645828   431 tablet_replica.cc:333] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.646427   431 raft_consensus.cc:2243] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.646857   431 raft_consensus.cc:2272] T 2de7767ee77c4969bba8c9350190f185 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.648995   431 tablet_replica.cc:333] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.649551   431 raft_consensus.cc:2243] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.650477   431 raft_consensus.cc:2272] T 07e39f05718844ce83488f64c90de17b P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.652969   431 tablet_replica.cc:333] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.653680   431 raft_consensus.cc:2243] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.654188   431 raft_consensus.cc:2272] T 60f8b0aa61814f979d50f80c58aa1da9 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.656695   431 tablet_replica.cc:333] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.657428   431 raft_consensus.cc:2243] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.658428   431 raft_consensus.cc:2272] T 9c69db33a1ce4b1894e7cc946d24270c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.661352   431 tablet_replica.cc:333] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.662050   431 raft_consensus.cc:2243] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.662551   431 raft_consensus.cc:2272] T 74aa2caa4cef407db88d87691e1e3e3c P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.664845   431 tablet_replica.cc:333] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.665344   431 raft_consensus.cc:2243] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.666033   431 raft_consensus.cc:2272] T 389b7d02e091434d92c8b6ed3ad13c15 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.668203   431 tablet_replica.cc:333] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.668893   431 raft_consensus.cc:2243] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.669384   431 raft_consensus.cc:2272] T ffe3edbb4b0647f8a4c252423178ce18 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.671985   431 tablet_replica.cc:333] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.672559   431 raft_consensus.cc:2243] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.672931   431 raft_consensus.cc:2272] T 5590ebc0addd48ceb9f37bffbe5de9c8 P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.675027   431 tablet_replica.cc:333] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.675482   431 raft_consensus.cc:2243] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.675869   431 raft_consensus.cc:2272] T 2e11d29a68964be6ba9535eba55c272e P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.677817   431 tablet_replica.cc:333] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1: stopping tablet replica
I20260709 13:04:16.678258   431 raft_consensus.cc:2243] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.678650   431 raft_consensus.cc:2272] T 82534bc4cd7045f6a24502bff235976d P b7e7b27d524749fbbbc0fa9855c2c5d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.695184 10361 consensus_peers.cc:597] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.695983 10361 consensus_peers.cc:597] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.716979 10361 consensus_peers.cc:597] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.750221   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:04:16.761023 10361 consensus_peers.cc:597] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.822690   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:04:16.861121 10361 consensus_peers.cc:597] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f -> Peer b7e7b27d524749fbbbc0fa9855c2c5d1 (127.0.107.195:45585): Couldn't send request to peer b7e7b27d524749fbbbc0fa9855c2c5d1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.878456   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:16.879320   431 tablet_replica.cc:333] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.879977   431 raft_consensus.cc:2243] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.880849   431 raft_consensus.cc:2272] T 2a72a81e18bd4f33ab1f087ecbd1c83d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.883186   431 tablet_replica.cc:333] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.883761   431 raft_consensus.cc:2243] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.884197   431 raft_consensus.cc:2272] T 13eea7ab12e34becb6bc5d54471e2677 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.886256   431 tablet_replica.cc:333] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.886816   431 raft_consensus.cc:2243] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.887199   431 raft_consensus.cc:2272] T b03c643c1bde4551be180d6ce6a7f407 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.889353   431 tablet_replica.cc:333] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.889904   431 raft_consensus.cc:2243] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.890358   431 raft_consensus.cc:2272] T d27c8a705d134d5f96385dc1ed5aaa3d P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.892241   431 tablet_replica.cc:333] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.892956   431 raft_consensus.cc:2243] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.893371   431 raft_consensus.cc:2272] T 26b3af5323c84e73b6cc311b8e672e92 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.895249   431 tablet_replica.cc:333] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.895877   431 raft_consensus.cc:2243] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.896397   431 raft_consensus.cc:2272] T b7cf8b715d234c44aac72258d0bac01f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.898990   431 tablet_replica.cc:333] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.899715   431 raft_consensus.cc:2243] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.900291   431 raft_consensus.cc:2272] T e981dc5ffbe9413a941979a7e31690e1 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.902627   431 tablet_replica.cc:333] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.903158   431 raft_consensus.cc:2243] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.903506   431 raft_consensus.cc:2272] T 1325c482dbf64578a5799209e1af6370 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.905458   431 tablet_replica.cc:333] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.905983   431 raft_consensus.cc:2243] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.906364   431 raft_consensus.cc:2272] T dff683367d884f7799d765efa95a0c5a P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.908272   431 tablet_replica.cc:333] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.908824   431 raft_consensus.cc:2243] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.909230   431 raft_consensus.cc:2272] T 05527a68e23b4b8e93c8f818819cc68a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.910985   431 tablet_replica.cc:333] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.911486   431 raft_consensus.cc:2243] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.912247   431 raft_consensus.cc:2272] T 4c269356f5284edabf474b9034c8da3f P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.914111   431 tablet_replica.cc:333] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.914608   431 raft_consensus.cc:2243] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.915060   431 raft_consensus.cc:2272] T daa66713733740428121c8683ffb7c90 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.916963   431 tablet_replica.cc:333] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.917484   431 raft_consensus.cc:2243] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.918190   431 raft_consensus.cc:2272] T bd84114c08b54e2892bb67e63f67b987 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.920032   431 tablet_replica.cc:333] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.920600   431 raft_consensus.cc:2243] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.920976   431 raft_consensus.cc:2272] T e27f9cdf5f7448b1b83691579db44a27 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.923527   431 tablet_replica.cc:333] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.924088   431 raft_consensus.cc:2243] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.924525   431 raft_consensus.cc:2272] T f34d9d4b33884f7e8f29d0379b00614f P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.927150   431 tablet_replica.cc:333] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.927894   431 raft_consensus.cc:2243] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.928385   431 raft_consensus.cc:2272] T 2969d49bd76040d8afcb37a6dcf16976 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.930778   431 tablet_replica.cc:333] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.931335   431 raft_consensus.cc:2243] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.932087   431 raft_consensus.cc:2272] T 38417199a01548d58b4afa4478c87a09 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.934011   431 tablet_replica.cc:333] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.934581   431 raft_consensus.cc:2243] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.934955   431 raft_consensus.cc:2272] T bae79c759a874e5ab8c3a59dbde5aa0e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.936969   431 tablet_replica.cc:333] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.937724   431 raft_consensus.cc:2243] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.938126   431 raft_consensus.cc:2272] T 41a65ec678174d949e2450a98c0f072b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.940070   431 tablet_replica.cc:333] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.940718   431 raft_consensus.cc:2243] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.940749 11264 raft_consensus.cc:493] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 03e8e4753ffb400b8e90eaff84fc1f10)
I20260709 13:04:16.941480 11264 raft_consensus.cc:515] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b5b492fca940a3883a22eec56a4f9f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35853 } } peers { permanent_uuid: "03e8e4753ffb400b8e90eaff84fc1f10" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35805 } } peers { permanent_uuid: "caa864648e614090be53d8ece3cd29b7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33927 } }
I20260709 13:04:16.941919   431 raft_consensus.cc:2272] T feaf74617ea14c089e379068bd362ac8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.943260 11264 leader_election.cc:290] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805), caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927)
I20260709 13:04:16.944461   431 tablet_replica.cc:333] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.945250   431 raft_consensus.cc:2243] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.945892   431 raft_consensus.cc:2272] T 7d927f3c7f024383ae5d8d4e018327fa P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.947118 10364 leader_election.cc:336] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03e8e4753ffb400b8e90eaff84fc1f10 (127.0.107.193:35805): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35805: connect: Connection refused (error 111)
W20260709 13:04:16.947618 10362 leader_election.cc:336] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer caa864648e614090be53d8ece3cd29b7 (127.0.107.194:33927): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33927: connect: Connection refused (error 111)
I20260709 13:04:16.947952 10362 leader_election.cc:304] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b5b492fca940a3883a22eec56a4f9f; no voters: 03e8e4753ffb400b8e90eaff84fc1f10, caa864648e614090be53d8ece3cd29b7
I20260709 13:04:16.948377   431 tablet_replica.cc:333] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.948503 11264 raft_consensus.cc:2749] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:16.949038   431 raft_consensus.cc:2243] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.949844   431 raft_consensus.cc:2272] T 86dad9027a254289ad29f258e8fbf67b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.951653   431 tablet_replica.cc:333] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.952270   431 raft_consensus.cc:2243] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.953047   431 raft_consensus.cc:2272] T 21b734032a14447b91008890f867d801 P c4b5b492fca940a3883a22eec56a4f9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.955333   431 tablet_replica.cc:333] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.955897   431 raft_consensus.cc:2243] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.956835   431 raft_consensus.cc:2272] T 60901c3e414849a18fdd33dbe5c1f878 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.958901   431 tablet_replica.cc:333] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.959396   431 raft_consensus.cc:2243] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.959741   431 raft_consensus.cc:2272] T 5590ebc0addd48ceb9f37bffbe5de9c8 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.961513   431 tablet_replica.cc:333] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.961987   431 raft_consensus.cc:2243] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.962440   431 raft_consensus.cc:2272] T 2e11d29a68964be6ba9535eba55c272e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.964726   431 tablet_replica.cc:333] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.965240   431 raft_consensus.cc:2243] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.965631   431 raft_consensus.cc:2272] T 9c69db33a1ce4b1894e7cc946d24270c P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.967692   431 tablet_replica.cc:333] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.968192   431 raft_consensus.cc:2243] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.968946   431 raft_consensus.cc:2272] T 74aa2caa4cef407db88d87691e1e3e3c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.970690   431 tablet_replica.cc:333] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.971165   431 raft_consensus.cc:2243] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.971505   431 raft_consensus.cc:2272] T 07e39f05718844ce83488f64c90de17b P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.973217   431 tablet_replica.cc:333] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.973687   431 raft_consensus.cc:2243] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.974021   431 raft_consensus.cc:2272] T fc4d416a3b0a41bb80cd831c381eb1bf P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.975695   431 tablet_replica.cc:333] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.976179   431 raft_consensus.cc:2243] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.976929   431 raft_consensus.cc:2272] T a7608db3fe6943948ba234b016c7f8b8 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.978715   431 tablet_replica.cc:333] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.979194   431 raft_consensus.cc:2243] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.979522   431 raft_consensus.cc:2272] T efdaf286bda5432ba867269e864dfd32 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.981272   431 tablet_replica.cc:333] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.981712   431 raft_consensus.cc:2243] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.982044   431 raft_consensus.cc:2272] T ff063a758e5e46bb8e8277d3b6d4ee07 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.983595   431 tablet_replica.cc:333] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.984061   431 raft_consensus.cc:2243] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.984428   431 raft_consensus.cc:2272] T d884577f53054c19b81aad58eca5d459 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.986159   431 tablet_replica.cc:333] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.986610   431 raft_consensus.cc:2243] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.987287   431 raft_consensus.cc:2272] T 5a9e7f66e663495dac8f9b10d847b0f6 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.989066   431 tablet_replica.cc:333] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.989506   431 raft_consensus.cc:2243] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.990152   431 raft_consensus.cc:2272] T f33497a7cce7475fb1f48d994ccdb42e P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.991848   431 tablet_replica.cc:333] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.992465   431 raft_consensus.cc:2243] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.993198   431 raft_consensus.cc:2272] T 7f990deb05e0436ab18c7ac796c66c3a P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.995095   431 tablet_replica.cc:333] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.995571   431 raft_consensus.cc:2243] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.996490   431 raft_consensus.cc:2272] T aa3d6f0a40934634966942872cb2fcc3 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.998528   431 tablet_replica.cc:333] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:16.999032   431 raft_consensus.cc:2243] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.999402   431 raft_consensus.cc:2272] T 287703ffe0634dd5a45da31c0ad95de9 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.001252   431 tablet_replica.cc:333] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:17.001848   431 raft_consensus.cc:2243] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.002313   431 raft_consensus.cc:2272] T 6c9543c32b3846c78cd39da12cdbf781 P c4b5b492fca940a3883a22eec56a4f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.004760   431 tablet_replica.cc:333] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:17.005358   431 raft_consensus.cc:2243] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.005867   431 raft_consensus.cc:2272] T 037e0166c77b44e4b4fcf5ec317fc05c P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.007748   431 tablet_replica.cc:333] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:17.008231   431 raft_consensus.cc:2243] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.009012   431 raft_consensus.cc:2272] T 9d1a9d1c53c442ff8ea9c6cdbd02031f P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.010922   431 tablet_replica.cc:333] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:17.011397   431 raft_consensus.cc:2243] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.012235   431 raft_consensus.cc:2272] T d7187ede0b76425593900305a48a4aa2 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.014362   431 tablet_replica.cc:333] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f: stopping tablet replica
I20260709 13:04:17.014873   431 raft_consensus.cc:2243] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.015297   431 raft_consensus.cc:2272] T 389b7d02e091434d92c8b6ed3ad13c15 P c4b5b492fca940a3883a22eec56a4f9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.080521   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:17.146799   431 master.cc:562] Master@127.0.107.254:45551 shutting down...
I20260709 13:04:17.174741   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.175274   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.175578   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4bf765e26dce43228243ec94afa24335: stopping tablet replica
I20260709 13:04:17.196383   431 master.cc:584] Master@127.0.107.254:45551 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28994 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:17.289608   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34631
I20260709 13:04:17.291224   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.297504 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.297983 11272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.297971 11270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.299122   431 server_base.cc:1061] running on GCE node
I20260709 13:04:17.300127   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.300343   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.300508   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602257300492 us; error 0 us; skew 500 ppm
I20260709 13:04:17.301051   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.304698   431 webserver.cc:533] Webserver started at http://127.0.107.254:45773/ using document root <none> and password file <none>
I20260709 13:04:17.305265   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.305430   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.305649   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.306695   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "57475ba400fd46c8903ad7386e14f07b"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.311573   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:04:17.315559 11277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.316630   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:17.316975   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "57475ba400fd46c8903ad7386e14f07b"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.317286   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.335860   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.337179   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.378692   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34631
I20260709 13:04:17.378835 11328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34631 every 8 connection(s)
I20260709 13:04:17.382894 11329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.394816 11329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b: Bootstrap starting.
I20260709 13:04:17.400189 11329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.405350 11329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b: No bootstrap required, opened a new log
I20260709 13:04:17.407756 11329 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER }
I20260709 13:04:17.408209 11329 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.408473 11329 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57475ba400fd46c8903ad7386e14f07b, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.409047 11329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER }
I20260709 13:04:17.409482 11329 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:17.409686 11329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:17.409914 11329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.415313 11329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER }
I20260709 13:04:17.415907 11329 leader_election.cc:304] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57475ba400fd46c8903ad7386e14f07b; no voters: 
I20260709 13:04:17.417075 11329 leader_election.cc:290] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:17.417493 11332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.418843 11332 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 1 LEADER]: Becoming Leader. State: Replica: 57475ba400fd46c8903ad7386e14f07b, State: Running, Role: LEADER
I20260709 13:04:17.419528 11332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER }
I20260709 13:04:17.420060 11329 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:17.424948 11333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57475ba400fd46c8903ad7386e14f07b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER } }
I20260709 13:04:17.426139 11333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:17.425652 11334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57475ba400fd46c8903ad7386e14f07b. Latest consensus state: current_term: 1 leader_uuid: "57475ba400fd46c8903ad7386e14f07b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57475ba400fd46c8903ad7386e14f07b" member_type: VOTER } }
I20260709 13:04:17.426783 11334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:17.429493 11340 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:17.434958 11340 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:17.438701   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:17.444064 11340 catalog_manager.cc:1383] Generated new cluster ID: a37c8b10c4f94844b78fe4dbfb24bce6
I20260709 13:04:17.444358 11340 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:17.462023 11340 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:17.463505 11340 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:17.476915 11340 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b: Generated new TSK 0
I20260709 13:04:17.477645 11340 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:17.505995   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.512496 11350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.513707 11351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.515203 11353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.516255   431 server_base.cc:1061] running on GCE node
I20260709 13:04:17.517381   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.517586   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.517714   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602257517702 us; error 0 us; skew 500 ppm
I20260709 13:04:17.518252   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.521236   431 webserver.cc:533] Webserver started at http://127.0.107.193:37793/ using document root <none> and password file <none>
I20260709 13:04:17.521873   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.522051   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.522328   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.523438   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "abb873328aa44b4ea0ecd97ffa35df06"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.528935   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:04:17.533133 11358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.533921   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:04:17.534319   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "abb873328aa44b4ea0ecd97ffa35df06"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.534667   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.547828   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.549095   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.550740   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:17.553238   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:17.553444   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.553674   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:17.553855   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.600471   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45305
I20260709 13:04:17.600601 11420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45305 every 8 connection(s)
I20260709 13:04:17.606336   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.614295 11425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.614475 11426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.617128 11428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.618077   431 server_base.cc:1061] running on GCE node
I20260709 13:04:17.619542   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.619808   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.619997   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602257619977 us; error 0 us; skew 500 ppm
I20260709 13:04:17.620625   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.623430 11421 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34631
I20260709 13:04:17.623848 11421 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:17.624728   431 webserver.cc:533] Webserver started at http://127.0.107.194:44593/ using document root <none> and password file <none>
I20260709 13:04:17.624867 11421 heartbeater.cc:507] Master 127.0.107.254:34631 requested a full tablet report, sending...
I20260709 13:04:17.625483   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.625730   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.626221   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.627404 11294 ts_manager.cc:194] Registered new tserver with Master: abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305)
I20260709 13:04:17.627461   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "e611d553b96c45deb9b233eda3fd4253"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.629487 11294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39456
I20260709 13:04:17.633284   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:17.637145 11433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.638024   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:17.638332   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "e611d553b96c45deb9b233eda3fd4253"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.638614   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.654647   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.655963   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.657706   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:17.660193   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:17.660454   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:17.660712   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:17.660869   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.709448   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33821
I20260709 13:04:17.709568 11495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33821 every 8 connection(s)
I20260709 13:04:17.714324   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.722481 11499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.724094 11500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.725899 11502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.727243   431 server_base.cc:1061] running on GCE node
I20260709 13:04:17.727797 11496 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34631
I20260709 13:04:17.728268   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.728609   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.728771   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602257728758 us; error 0 us; skew 500 ppm
I20260709 13:04:17.728996 11496 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:17.729352   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.729995 11496 heartbeater.cc:507] Master 127.0.107.254:34631 requested a full tablet report, sending...
I20260709 13:04:17.732649   431 webserver.cc:533] Webserver started at http://127.0.107.195:33007/ using document root <none> and password file <none>
I20260709 13:04:17.733310   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.733265 11294 ts_manager.cc:194] Registered new tserver with Master: e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:17.733783   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.734102   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.735046 11294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39462
I20260709 13:04:17.735378   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "3c70efd1c172434bad95204cecb0edf9"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.740653   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:04:17.744680 11507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.745709   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:17.745990   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "3c70efd1c172434bad95204cecb0edf9"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:17.746246   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.770571   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.771781   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.773401   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:17.775799   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:17.776031   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.776284   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:17.776479   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:17.827458   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38597
I20260709 13:04:17.827580 11569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38597 every 8 connection(s)
I20260709 13:04:17.842911 11570 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34631
I20260709 13:04:17.843411 11570 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:17.844132 11570 heartbeater.cc:507] Master 127.0.107.254:34631 requested a full tablet report, sending...
I20260709 13:04:17.846457 11294 ts_manager.cc:194] Registered new tserver with Master: 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:17.847010   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016350746s
I20260709 13:04:17.848359 11294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39474
I20260709 13:04:17.875633 11294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39480:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:17.878400 11294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:17.984453 11386 tablet_service.cc:1511] Processing CreateTablet for tablet 06f150fcff48426fa8f7fff511796958 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:17.985627 11386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f150fcff48426fa8f7fff511796958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.988031 11385 tablet_service.cc:1511] Processing CreateTablet for tablet f16342a8bb384363878f3f16a54a6154 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:17.989535 11385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16342a8bb384363878f3f16a54a6154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.990334 11534 tablet_service.cc:1511] Processing CreateTablet for tablet f16342a8bb384363878f3f16a54a6154 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:17.991940 11534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16342a8bb384363878f3f16a54a6154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.993124 11381 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaff45dd9404b0099fb1ca28439e235 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:17.993362 11533 tablet_service.cc:1511] Processing CreateTablet for tablet 6629f781f1d945c69b2055b1fb4a4fcf (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:17.994599 11381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaff45dd9404b0099fb1ca28439e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.994885 11532 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:17.997440 11384 tablet_service.cc:1511] Processing CreateTablet for tablet 6629f781f1d945c69b2055b1fb4a4fcf (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:17.997822 11535 tablet_service.cc:1511] Processing CreateTablet for tablet 06f150fcff48426fa8f7fff511796958 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:17.993602 11531 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebe549f836145b881d01e752222c510 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.000347 11383 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:18.002660 11530 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaff45dd9404b0099fb1ca28439e235 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:18.004127 11380 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd602f93b4c46d8a39f0783d598d25e (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.005215 11529 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd602f93b4c46d8a39f0783d598d25e (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.006479 11379 tablet_service.cc:1511] Processing CreateTablet for tablet 03dcd53791e044e99650f2a895f4134a (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.007315 11528 tablet_service.cc:1511] Processing CreateTablet for tablet 03dcd53791e044e99650f2a895f4134a (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.009096 11378 tablet_service.cc:1511] Processing CreateTablet for tablet b78d508c8de845b5a8eb4eba15f27d07 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.002731 11382 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebe549f836145b881d01e752222c510 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.012920 11527 tablet_service.cc:1511] Processing CreateTablet for tablet b78d508c8de845b5a8eb4eba15f27d07 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.013571 11377 tablet_service.cc:1511] Processing CreateTablet for tablet 3347777d385f4a79b9a3369a10c33816 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:17.994602 11533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629f781f1d945c69b2055b1fb4a4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.014394 11526 tablet_service.cc:1511] Processing CreateTablet for tablet 3347777d385f4a79b9a3369a10c33816 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:18.015509 11529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd602f93b4c46d8a39f0783d598d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.016522 11526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3347777d385f4a79b9a3369a10c33816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.017282 11528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dcd53791e044e99650f2a895f4134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.020743 11530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaff45dd9404b0099fb1ca28439e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.021520 11531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebe549f836145b881d01e752222c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.999114 11384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629f781f1d945c69b2055b1fb4a4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.025586 11378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78d508c8de845b5a8eb4eba15f27d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.026841 11382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebe549f836145b881d01e752222c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.028690 11380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd602f93b4c46d8a39f0783d598d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.030668 11527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78d508c8de845b5a8eb4eba15f27d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.032773 11379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dcd53791e044e99650f2a895f4134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.034883 11383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.035660 11535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f150fcff48426fa8f7fff511796958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.036839 11377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3347777d385f4a79b9a3369a10c33816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.040741 11532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.081244 11461 tablet_service.cc:1511] Processing CreateTablet for tablet 06f150fcff48426fa8f7fff511796958 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:18.082785 11461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f150fcff48426fa8f7fff511796958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.085525 11460 tablet_service.cc:1511] Processing CreateTablet for tablet f16342a8bb384363878f3f16a54a6154 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:18.089725 11459 tablet_service.cc:1511] Processing CreateTablet for tablet 6629f781f1d945c69b2055b1fb4a4fcf (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:18.093050 11458 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:18.095482 11457 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebe549f836145b881d01e752222c510 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.097791 11456 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaff45dd9404b0099fb1ca28439e235 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:18.100239 11455 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd602f93b4c46d8a39f0783d598d25e (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.103462 11453 tablet_service.cc:1511] Processing CreateTablet for tablet b78d508c8de845b5a8eb4eba15f27d07 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.105742 11452 tablet_service.cc:1511] Processing CreateTablet for tablet 3347777d385f4a79b9a3369a10c33816 (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:18.085623 11454 tablet_service.cc:1511] Processing CreateTablet for tablet 03dcd53791e044e99650f2a895f4134a (DEFAULT_TABLE table=test-workload [id=505ca7e221ec40f6aa8d57fd049b3aa2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.112999 11460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16342a8bb384363878f3f16a54a6154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.113750 11459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629f781f1d945c69b2055b1fb4a4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.119572 11454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dcd53791e044e99650f2a895f4134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.131284 11452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3347777d385f4a79b9a3369a10c33816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.133239 11455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd602f93b4c46d8a39f0783d598d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.136336 11456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaff45dd9404b0099fb1ca28439e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.139227 11458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9b4cd0aeae4b889c9799d57ef6b3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.139978 11453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78d508c8de845b5a8eb4eba15f27d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.140602 11457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebe549f836145b881d01e752222c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.168363 11585 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.240685 11586 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.243024 11585 tablet_bootstrap.cc:654] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.252956 11586 tablet_bootstrap.cc:654] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.254796 11587 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.269927 11587 tablet_bootstrap.cc:654] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.273160 11585 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.273722 11585 ts_tablet_manager.cc:1403] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.004s
I20260709 13:04:18.280478 11586 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.281045 11586 ts_tablet_manager.cc:1403] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.004s
I20260709 13:04:18.280733 11585 raft_consensus.cc:359] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.281651 11585 raft_consensus.cc:385] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.282006 11585 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.282255 11587 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.282739 11587 ts_tablet_manager.cc:1403] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.009s
I20260709 13:04:18.282819 11585 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.284003 11586 raft_consensus.cc:359] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.284756 11586 raft_consensus.cc:385] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.285044 11586 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.285051 11421 heartbeater.cc:499] Master 127.0.107.254:34631 was elected leader, sending a full tablet report...
I20260709 13:04:18.285499 11585 ts_tablet_manager.cc:1434] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:04:18.285202 11587 raft_consensus.cc:359] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.286070 11587 raft_consensus.cc:385] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.285851 11586 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.286357 11587 raft_consensus.cc:740] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.286674 11585 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.287241 11587 consensus_queue.cc:260] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.295702 11496 heartbeater.cc:499] Master 127.0.107.254:34631 was elected leader, sending a full tablet report...
I20260709 13:04:18.296754 11587 ts_tablet_manager.cc:1434] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.008s
I20260709 13:04:18.297863 11587 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.300082 11585 tablet_bootstrap.cc:654] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.304276 11587 tablet_bootstrap.cc:654] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.316105 11587 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.316700 11587 ts_tablet_manager.cc:1403] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:04:18.320120 11587 raft_consensus.cc:359] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.320928 11587 raft_consensus.cc:385] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.321218 11587 raft_consensus.cc:740] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.322211 11587 consensus_queue.cc:260] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.324685 11587 ts_tablet_manager.cc:1434] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:18.325650 11587 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.332254 11587 tablet_bootstrap.cc:654] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.333675 11594 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.334585 11570 heartbeater.cc:499] Master 127.0.107.254:34631 was elected leader, sending a full tablet report...
I20260709 13:04:18.334605 11594 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.336529 11586 ts_tablet_manager.cc:1434] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.055s	user 0.023s	sys 0.033s
I20260709 13:04:18.337853 11586 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.347285 11585 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.348698 11585 ts_tablet_manager.cc:1403] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.016s
I20260709 13:04:18.350638 11586 tablet_bootstrap.cc:654] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.352187 11587 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.352845 11587 ts_tablet_manager.cc:1403] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.006s
I20260709 13:04:18.355178 11585 raft_consensus.cc:359] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.355893 11587 raft_consensus.cc:359] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.356777 11587 raft_consensus.cc:385] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.357208 11585 raft_consensus.cc:385] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.358178 11587 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.358275 11585 raft_consensus.cc:740] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.359143 11587 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.360216 11585 consensus_queue.cc:260] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.361965 11587 ts_tablet_manager.cc:1434] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:18.363603 11587 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.372390 11587 tablet_bootstrap.cc:654] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.375607 11585 ts_tablet_manager.cc:1434] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:04:18.376864 11585 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.383947 11585 tablet_bootstrap.cc:654] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.387154 11586 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.387856 11586 ts_tablet_manager.cc:1403] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.050s	user 0.035s	sys 0.006s
I20260709 13:04:18.390255 11594 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.391433 11586 raft_consensus.cc:359] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.393129 11586 raft_consensus.cc:385] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.393522 11586 raft_consensus.cc:740] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.394394 11586 consensus_queue.cc:260] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.397029 11586 ts_tablet_manager.cc:1434] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 13:04:18.398200 11586 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.407218 11587 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.407835 11587 ts_tablet_manager.cc:1403] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.013s
I20260709 13:04:18.410784 11587 raft_consensus.cc:359] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.411514 11587 raft_consensus.cc:385] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.411804 11587 raft_consensus.cc:740] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.413043 11587 consensus_queue.cc:260] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.415714 11585 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.412953 11586 tablet_bootstrap.cc:654] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.416366 11585 ts_tablet_manager.cc:1403] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.015s
I20260709 13:04:18.424391 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
W20260709 13:04:18.426761 11511 leader_election.cc:343] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.420053 11585 raft_consensus.cc:359] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.427949 11585 raft_consensus.cc:385] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.428386 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.430795 11586 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.431299 11586 ts_tablet_manager.cc:1403] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.001s
W20260709 13:04:18.432046 11508 leader_election.cc:343] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.432577 11508 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9; no voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:18.432721 11587 ts_tablet_manager.cc:1434] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
W20260709 13:04:18.433379 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:18.433811 11594 raft_consensus.cc:2749] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.428437 11585 raft_consensus.cc:740] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.435307 11585 consensus_queue.cc:260] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.436810 11587 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.435202 11586 raft_consensus.cc:359] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.438616 11586 raft_consensus.cc:385] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.438915 11586 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.437814 11585 ts_tablet_manager.cc:1434] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:04:18.439779 11586 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.440789 11585 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.442334 11586 ts_tablet_manager.cc:1434] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:04:18.443405 11586 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.447670 11585 tablet_bootstrap.cc:654] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.448339 11587 tablet_bootstrap.cc:654] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.455956 11586 tablet_bootstrap.cc:654] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.458786 11587 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.459293 11587 ts_tablet_manager.cc:1403] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.010s
I20260709 13:04:18.462285 11587 raft_consensus.cc:359] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.462951 11585 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.463030 11587 raft_consensus.cc:385] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.463514 11587 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.463642 11585 ts_tablet_manager.cc:1403] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:04:18.464479 11587 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.466725 11585 raft_consensus.cc:359] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.467485 11585 raft_consensus.cc:385] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.467760 11585 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.468580 11585 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.470660 11585 ts_tablet_manager.cc:1434] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:18.471733 11585 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.474009 11587 ts_tablet_manager.cc:1434] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:04:18.477671 11587 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.478025 11585 tablet_bootstrap.cc:654] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.483335 11586 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.484071 11593 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.484247 11586 ts_tablet_manager.cc:1403] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.025s
I20260709 13:04:18.484707 11593 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.487012 11586 raft_consensus.cc:359] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.487584 11593 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.487790 11586 raft_consensus.cc:385] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.488193 11586 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.489079 11586 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.492296 11585 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.492962 11585 ts_tablet_manager.cc:1403] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:04:18.495400 11586 ts_tablet_manager.cc:1434] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:04:18.496094 11585 raft_consensus.cc:359] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.496932 11585 raft_consensus.cc:385] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.493290 11587 tablet_bootstrap.cc:654] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.497424 11585 raft_consensus.cc:740] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.498288 11585 consensus_queue.cc:260] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.501230 11585 ts_tablet_manager.cc:1434] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:18.502460 11585 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.503887 11586 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.510370 11585 tablet_bootstrap.cc:654] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.510462 11586 tablet_bootstrap.cc:654] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.511303 11587 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.511860 11587 ts_tablet_manager.cc:1403] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.013s
I20260709 13:04:18.515143 11587 raft_consensus.cc:359] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.515933 11587 raft_consensus.cc:385] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.516253 11587 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.521796 11587 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.523856 11585 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.524497 11585 ts_tablet_manager.cc:1403] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:04:18.527639 11585 raft_consensus.cc:359] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.528398 11585 raft_consensus.cc:385] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.528687 11585 raft_consensus.cc:740] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.529517 11585 consensus_queue.cc:260] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.530915 11587 ts_tablet_manager.cc:1434] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:04:18.532645 11585 ts_tablet_manager.cc:1434] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:18.533716 11585 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.534890 11587 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.540431 11585 tablet_bootstrap.cc:654] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.546411 11587 tablet_bootstrap.cc:654] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.552460 11585 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.552600 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.553056 11585 ts_tablet_manager.cc:1403] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:04:18.554801 11593 raft_consensus.cc:493] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.555395 11593 raft_consensus.cc:515] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.556479 11587 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.557176 11587 ts_tablet_manager.cc:1403] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:04:18.556488 11585 raft_consensus.cc:359] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.557541 11585 raft_consensus.cc:385] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.557834 11585 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.557757 11593 leader_election.cc:290] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.558876 11585 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
W20260709 13:04:18.559067 11437 leader_election.cc:343] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.560423 11587 raft_consensus.cc:359] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.561148 11587 raft_consensus.cc:385] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.561292 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.561579 11587 raft_consensus.cc:740] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.562041 11396 raft_consensus.cc:2468] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 0.
I20260709 13:04:18.564431 11585 ts_tablet_manager.cc:1434] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:04:18.565496 11585 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.571779 11591 raft_consensus.cc:493] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.572345 11591 raft_consensus.cc:515] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.562459 11587 consensus_queue.cc:260] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.570344 11437 leader_election.cc:304] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.577090 11593 raft_consensus.cc:2804] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.577510 11593 raft_consensus.cc:493] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.577869 11593 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.581878 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.583735 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
W20260709 13:04:18.587816 11437 leader_election.cc:343] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.588555 11591 leader_election.cc:290] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.588428 11437 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:18.591506 11586 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.592156 11586 ts_tablet_manager.cc:1403] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.095s	user 0.033s	sys 0.050s
I20260709 13:04:18.595871 11586 raft_consensus.cc:359] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.596782 11586 raft_consensus.cc:385] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.597178 11586 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.598141 11587 ts_tablet_manager.cc:1434] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:04:18.598778 11620 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.598996 11437 leader_election.cc:343] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.599599 11587 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.600121 11586 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.602243 11586 ts_tablet_manager.cc:1434] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:18.603294 11586 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.605942 11585 tablet_bootstrap.cc:654] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.609629 11586 tablet_bootstrap.cc:654] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.599399 11620 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.614449 11620 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.615082 11620 raft_consensus.cc:2749] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.615814 11594 raft_consensus.cc:493] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.616338 11594 raft_consensus.cc:515] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.616485 11593 raft_consensus.cc:515] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.617623 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.618718 11594 leader_election.cc:290] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.619053 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.619580 11593 leader_election.cc:290] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
W20260709 13:04:18.621268 11437 leader_election.cc:343] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.622794 11587 tablet_bootstrap.cc:654] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.624135 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.624521 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.624786 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:18.624923 11395 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
W20260709 13:04:18.624264 11437 leader_election.cc:343] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:18.626068 11508 leader_election.cc:343] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.626802 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:18.627491 11396 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.633646 11594 raft_consensus.cc:493] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.634338 11594 raft_consensus.cc:515] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.635341 11511 leader_election.cc:304] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:18.636355 11592 raft_consensus.cc:2804] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.626183 11437 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:18.636759 11592 raft_consensus.cc:493] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.637579 11592 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:18.637713 11437 leader_election.cc:343] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.638612 11593 raft_consensus.cc:2749] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.640120 11594 leader_election.cc:290] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.641709 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.642516 11471 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
I20260709 13:04:18.643929 11508 leader_election.cc:304] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.648532 11594 raft_consensus.cc:2804] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.648999 11594 raft_consensus.cc:493] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.647899 11396 raft_consensus.cc:2468] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:18.649324 11594 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.650791 11437 leader_election.cc:304] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:18.652493 11593 raft_consensus.cc:2804] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.653057 11593 raft_consensus.cc:697] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:18.654114 11593 consensus_queue.cc:237] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.659358 11592 raft_consensus.cc:515] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.664855 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.665859 11396 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
I20260709 13:04:18.671180 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.672197 11544 raft_consensus.cc:2393] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abb873328aa44b4ea0ecd97ffa35df06 in current term 1: Already voted for candidate 3c70efd1c172434bad95204cecb0edf9 in this term.
I20260709 13:04:18.672734 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.673413 11591 raft_consensus.cc:493] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.674656 11508 leader_election.cc:343] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.674404 11591 raft_consensus.cc:515] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.677349 11591 leader_election.cc:290] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.677582 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:18.678603 11396 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.679807 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.687006 11625 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.687696 11625 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.692842 11586 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.693480 11586 ts_tablet_manager.cc:1403] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.044s
I20260709 13:04:18.693802 11396 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
I20260709 13:04:18.694197 11291 catalog_manager.cc:5697] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 0 to 1, leader changed from <none> to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.696429 11586 raft_consensus.cc:359] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.697441 11586 raft_consensus.cc:385] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.697933 11586 raft_consensus.cc:740] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.698741 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.698853 11586 consensus_queue.cc:260] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.699764 11471 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
I20260709 13:04:18.700469 11511 leader_election.cc:304] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:18.700745 11585 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.701413 11585 ts_tablet_manager.cc:1403] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.136s	user 0.023s	sys 0.014s
I20260709 13:04:18.702163 11592 leader_election.cc:290] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.703594 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.707460 11585 raft_consensus.cc:359] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
W20260709 13:04:18.701061 11362 leader_election.cc:343] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.701236 11508 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.706744 11592 raft_consensus.cc:2804] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.709280 11585 raft_consensus.cc:385] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.709733 11585 raft_consensus.cc:740] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.710493 11585 consensus_queue.cc:260] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.710909 11594 raft_consensus.cc:515] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.702337 11625 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.712754 11625 raft_consensus.cc:2804] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.713125 11625 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.713466 11625 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.716264 11591 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.716962 11591 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.718302 11594 leader_election.cc:290] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.716516 11592 raft_consensus.cc:697] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:18.719760 11592 consensus_queue.cc:237] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.725028 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.725880 11470 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 0.
I20260709 13:04:18.722752 11591 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.727277 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.728111 11544 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 0.
I20260709 13:04:18.728281 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.729592 11362 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:18.730087 11625 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.730584 11585 ts_tablet_manager.cc:1434] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:04:18.731971 11585 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.730999 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.738231 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.738251 11359 leader_election.cc:304] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:18.739651 11469 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.742100 11586 ts_tablet_manager.cc:1434] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.003s
I20260709 13:04:18.743243 11586 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.745136 11591 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:18.747792 11511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45305, user_credentials={real_user=slave}} blocked reactor thread for 47424.2us
I20260709 13:04:18.749759 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:18.750301 11396 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.748087 11591 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.752533 11591 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.759303 11292 catalog_manager.cc:5697] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:18.760125 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.761119 11471 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.761289 11396 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
W20260709 13:04:18.766323 11511 leader_election.cc:343] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.768908 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:18.771512 11471 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
I20260709 13:04:18.772114 11469 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
I20260709 13:04:18.774887 11508 leader_election.cc:304] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.776214 11629 raft_consensus.cc:2804] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.776518 11587 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.777287 11587 ts_tablet_manager.cc:1403] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.178s	user 0.043s	sys 0.055s
I20260709 13:04:18.772780 11625 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:18.776885 11629 raft_consensus.cc:697] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:18.779225 11508 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
W20260709 13:04:18.780357 11359 leader_election.cc:343] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:18.782774 11511 leader_election.cc:343] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.780766 11629 consensus_queue.cc:237] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
W20260709 13:04:18.783237 11359 leader_election.cc:343] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.783226 11630 raft_consensus.cc:2804] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.784861 11630 raft_consensus.cc:493] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.785297 11630 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.785611 11586 tablet_bootstrap.cc:654] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.786374 11585 tablet_bootstrap.cc:654] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.781780 11625 raft_consensus.cc:2804] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.787405 11625 raft_consensus.cc:697] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:18.789149 11587 raft_consensus.cc:359] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.789681 11587 raft_consensus.cc:385] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.789891 11587 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.790450 11587 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.792935 11359 leader_election.cc:304] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06; no voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:18.788273 11625 consensus_queue.cc:237] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.802692 11587 ts_tablet_manager.cc:1434] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:18.803987 11587 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.808568 11630 raft_consensus.cc:515] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.812112 11587 tablet_bootstrap.cc:654] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.812130 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:18.813079 11544 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.814062 11630 leader_election.cc:290] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Requested vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.823664 11586 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.823921 11630 raft_consensus.cc:2749] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.824337 11586 ts_tablet_manager.cc:1403] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.009s
I20260709 13:04:18.827534 11591 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
W20260709 13:04:18.829334 11359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33821, user_credentials={real_user=slave}} blocked reactor thread for 46119us
I20260709 13:04:18.830363 11591 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Requested vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.831679 11585 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.832231 11585 ts_tablet_manager.cc:1403] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.003s
I20260709 13:04:18.832722 11636 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.833231 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.833925 11471 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.833403 11636 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.835232 11585 raft_consensus.cc:359] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.838327 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.839859 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.842175 11469 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.842206 11470 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 0.
I20260709 13:04:18.842775 11587 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.843152 11585 raft_consensus.cc:385] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.843354 11587 ts_tablet_manager.cc:1403] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:04:18.843801 11359 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.840257 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:18.841146 11543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.843487 11585 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.842350 11636 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.845753 11593 raft_consensus.cc:493] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.846266 11591 raft_consensus.cc:493] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.845961 11585 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.846819 11630 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.847891 11543 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 0.
I20260709 13:04:18.851147 11630 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.851850 11630 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.845742 11545 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.853103 11585 ts_tablet_manager.cc:1434] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:04:18.854139 11585 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:18.854542 11471 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.848616 11587 raft_consensus.cc:359] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.850371 11593 raft_consensus.cc:515] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.827459 11544 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.856683 11359 leader_election.cc:304] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.857578 11636 raft_consensus.cc:2804] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.855944 11587 raft_consensus.cc:385] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.858475 11587 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.858767 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:18.859192 11587 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.861994 11469 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.864720 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.865355 11587 ts_tablet_manager.cc:1434] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
W20260709 13:04:18.866106 11437 leader_election.cc:343] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.866328 11587 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: Bootstrap starting.
I20260709 13:04:18.857674 11593 leader_election.cc:290] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.867311 11359 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.867033 11293 catalog_manager.cc:5697] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:18.869808 11585 tablet_bootstrap.cc:654] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.868891 11293 catalog_manager.cc:5697] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:18.863231 11591 raft_consensus.cc:515] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.872153 11396 raft_consensus.cc:2468] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 0.
I20260709 13:04:18.874682 11630 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.875360 11437 leader_election.cc:304] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:18.879931 11593 raft_consensus.cc:2804] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.880357 11593 raft_consensus.cc:493] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.880702 11593 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.878146 11545 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.886804 11587 tablet_bootstrap.cc:654] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.890267 11591 leader_election.cc:290] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.890583 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:18.891335 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:18.891974 11586 raft_consensus.cc:359] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.892740 11586 raft_consensus.cc:385] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:18.892659 11362 leader_election.cc:343] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.893483 11586 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.894351 11636 raft_consensus.cc:697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Becoming Leader. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Running, Role: LEADER
I20260709 13:04:18.896677 11586 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.897365 11636 consensus_queue.cc:237] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.898741 11586 ts_tablet_manager.cc:1434] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:04:18.899756 11586 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.903569 11630 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Requested vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.903637 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:18.905582 11471 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.908522 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:18.909792 11545 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.910112 11585 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: No bootstrap required, opened a new log
I20260709 13:04:18.910666 11585 ts_tablet_manager.cc:1403] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.011s
I20260709 13:04:18.912092 11293 catalog_manager.cc:5697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "abb873328aa44b4ea0ecd97ffa35df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.913363 11585 raft_consensus.cc:359] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.914058 11585 raft_consensus.cc:385] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.914296 11585 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.915642 11640 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.916378 11640 raft_consensus.cc:697] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Becoming Leader. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Running, Role: LEADER
I20260709 13:04:18.916921 11585 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.917610 11640 consensus_queue.cc:237] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.918989 11585 ts_tablet_manager.cc:1434] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:18.905282 11593 raft_consensus.cc:515] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.921013 11469 raft_consensus.cc:2393] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abb873328aa44b4ea0ecd97ffa35df06 in current term 1: Already voted for candidate e611d553b96c45deb9b233eda3fd4253 in this term.
I20260709 13:04:18.923857 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:18.924965 11396 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.922847 11586 tablet_bootstrap.cc:654] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.922672 11359 leader_election.cc:304] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06; no voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:18.926788 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
W20260709 13:04:18.934620 11437 leader_election.cc:343] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.936870 11396 raft_consensus.cc:2468] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:18.937640 11636 raft_consensus.cc:2749] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.939420 11471 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.941701 11437 leader_election.cc:304] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:18.942917 11619 raft_consensus.cc:2804] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.943428 11619 raft_consensus.cc:697] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:18.943598 11359 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:18.922057 11593 leader_election.cc:290] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:18.944370 11619 consensus_queue.cc:237] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.921530 11545 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:18.948176 11640 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.948844 11640 raft_consensus.cc:697] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Becoming Leader. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Running, Role: LEADER
I20260709 13:04:18.949637 11640 consensus_queue.cc:237] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.950291 11587 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: No bootstrap required, opened a new log
I20260709 13:04:18.950798 11587 ts_tablet_manager.cc:1403] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.026s
I20260709 13:04:18.951423 11586 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.951894 11586 ts_tablet_manager.cc:1403] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.052s	user 0.003s	sys 0.007s
I20260709 13:04:18.953446 11587 raft_consensus.cc:359] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.954259 11587 raft_consensus.cc:385] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.954520 11587 raft_consensus.cc:740] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.954813 11586 raft_consensus.cc:359] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.955262 11587 consensus_queue.cc:260] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.955474 11586 raft_consensus.cc:385] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.956038 11586 raft_consensus.cc:740] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.956808 11586 consensus_queue.cc:260] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.957698 11587 ts_tablet_manager.cc:1434] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:18.955375 11293 catalog_manager.cc:5697] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "abb873328aa44b4ea0ecd97ffa35df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.960836 11586 ts_tablet_manager.cc:1434] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:04:18.961906 11586 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.967600 11586 tablet_bootstrap.cc:654] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.971302 11291 catalog_manager.cc:5697] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 0 to 1, leader changed from <none> to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.976485 11292 catalog_manager.cc:5697] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "abb873328aa44b4ea0ecd97ffa35df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.978864 11586 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.979316 11586 ts_tablet_manager.cc:1403] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:04:18.981562 11586 raft_consensus.cc:359] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.982210 11586 raft_consensus.cc:385] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.982484 11586 raft_consensus.cc:740] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.983019 11586 consensus_queue.cc:260] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.984884 11586 ts_tablet_manager.cc:1434] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:18.985904 11586 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: Bootstrap starting.
I20260709 13:04:18.991268 11586 tablet_bootstrap.cc:654] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.995445 11586 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: No bootstrap required, opened a new log
I20260709 13:04:18.995802 11586 ts_tablet_manager.cc:1403] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:18.997740 11586 raft_consensus.cc:359] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:18.998196 11586 raft_consensus.cc:385] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.998385 11586 raft_consensus.cc:740] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.998857 11586 consensus_queue.cc:260] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.000226 11586 ts_tablet_manager.cc:1434] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:04:19.002418 11619 raft_consensus.cc:493] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.002866 11619 raft_consensus.cc:515] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.004482 11619 leader_election.cc:290] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:19.005137 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:19.005825 11396 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 0.
I20260709 13:04:19.006705 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:19.006783 11437 leader_election.cc:304] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:19.007434 11545 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 0.
I20260709 13:04:19.007645 11619 raft_consensus.cc:2804] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.008078 11619 raft_consensus.cc:493] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.008427 11619 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.013804 11619 raft_consensus.cc:515] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.015311 11619 leader_election.cc:290] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:19.016075 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:19.016201 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:19.016604 11396 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.016749 11545 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.021843 11545 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:19.022027 11396 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:19.022935 11437 leader_election.cc:304] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:19.023574 11619 raft_consensus.cc:2804] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.024024 11619 raft_consensus.cc:697] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:19.024781 11619 consensus_queue.cc:237] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.031569 11292 catalog_manager.cc:5697] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 0 to 1, leader changed from <none> to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.097718 11545 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.103657 11640 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.104234 11640 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.104883 11619 consensus_queue.cc:1048] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.106043 11640 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:19.146673 11625 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.148697 11625 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.155485 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:19.152498 11640 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.156574 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:19.157850 11640 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.158131 11469 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
I20260709 13:04:19.161106 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:19.162310 11471 raft_consensus.cc:2393] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abb873328aa44b4ea0ecd97ffa35df06 in current term 1: Already voted for candidate 3c70efd1c172434bad95204cecb0edf9 in this term.
I20260709 13:04:19.162596 11396 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 0.
I20260709 13:04:19.163347 11508 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:19.164762 11629 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.165215 11629 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.165383 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:19.165709 11629 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.166929 11625 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:19.167806 11362 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06; no voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:19.169637 11636 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.166445 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:19.171502 11471 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 0.
I20260709 13:04:19.172752 11359 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:19.173942 11630 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.174314 11630 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.174623 11630 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.177553 11640 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:19.180256 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:19.187074 11636 raft_consensus.cc:2749] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.188799 11630 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.191797 11629 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.192183 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:19.192857 11471 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.193253 11544 raft_consensus.cc:2393] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abb873328aa44b4ea0ecd97ffa35df06 in current term 1: Already voted for candidate 3c70efd1c172434bad95204cecb0edf9 in this term.
I20260709 13:04:19.195382 11629 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:19.196839 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:19.198065 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:19.198875 11396 raft_consensus.cc:2393] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c70efd1c172434bad95204cecb0edf9 in current term 1: Already voted for candidate abb873328aa44b4ea0ecd97ffa35df06 in this term.
I20260709 13:04:19.196731 11619 consensus_queue.cc:1048] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.200428 11511 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9; no voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:19.201805 11625 raft_consensus.cc:2749] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.202931 11630 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Requested vote from peers e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:19.206609 11471 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abb873328aa44b4ea0ecd97ffa35df06 in term 1.
I20260709 13:04:19.207660 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "abb873328aa44b4ea0ecd97ffa35df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:19.208158 11359 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:19.208702 11544 raft_consensus.cc:2393] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abb873328aa44b4ea0ecd97ffa35df06 in current term 1: Already voted for candidate 3c70efd1c172434bad95204cecb0edf9 in this term.
I20260709 13:04:19.215145 11630 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.216144 11630 raft_consensus.cc:697] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Becoming Leader. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Running, Role: LEADER
I20260709 13:04:19.217502 11630 consensus_queue.cc:237] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.232445 11291 catalog_manager.cc:5697] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "abb873328aa44b4ea0ecd97ffa35df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.241631 11629 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.253127 11471 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.261559 11627 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.279457 11627 consensus_queue.cc:1048] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.293237 11627 consensus_queue.cc:1048] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.309376 11630 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.309453 11627 raft_consensus.cc:493] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.310384 11627 raft_consensus.cc:515] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:19.314205 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06" is_pre_election: true
I20260709 13:04:19.314436 11627 leader_election.cc:290] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:19.315654 11396 raft_consensus.cc:2393] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c70efd1c172434bad95204cecb0edf9 in current term 1: Already voted for candidate e611d553b96c45deb9b233eda3fd4253 in this term.
I20260709 13:04:19.315681 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:19.318565 11625 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.318650 11508 leader_election.cc:304] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9; no voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:19.325110 11627 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.325922 11630 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.338236 11630 consensus_queue.cc:1048] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.340446 11627 raft_consensus.cc:2749] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.350479 11627 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.369947 11630 consensus_queue.cc:1048] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.435060   431 ts_manager.cc:295] Set tserver state for abb873328aa44b4ea0ecd97ffa35df06 to MAINTENANCE_MODE
W20260709 13:04:19.435988 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:19.436033   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:19.464287   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:19.465342   431 tablet_replica.cc:333] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.466235   431 raft_consensus.cc:2243] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.466912   431 pending_rounds.cc:70] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Trying to abort 1 pending ops.
I20260709 13:04:19.467087   431 pending_rounds.cc:77] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634853767946240 op_type: NO_OP noop_request { }
I20260709 13:04:19.467368   431 raft_consensus.cc:2889] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:19.467633   431 raft_consensus.cc:2272] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.470619   431 tablet_replica.cc:333] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.471459   431 raft_consensus.cc:2243] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.471947   431 raft_consensus.cc:2272] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.475179   431 tablet_replica.cc:333] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.475829   431 raft_consensus.cc:2243] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.476368   431 raft_consensus.cc:2272] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.478730   431 tablet_replica.cc:333] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.479421   431 raft_consensus.cc:2243] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.480360   431 raft_consensus.cc:2272] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.483724   431 tablet_replica.cc:333] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.484556   431 raft_consensus.cc:2243] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.485117   431 raft_consensus.cc:2272] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:19.486248 11437 consensus_peers.cc:597] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.488838   431 tablet_replica.cc:333] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.489496   431 raft_consensus.cc:2243] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.489980   431 raft_consensus.cc:2272] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.492465   431 tablet_replica.cc:333] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.493110   431 raft_consensus.cc:2243] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.493985   431 pending_rounds.cc:70] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Trying to abort 1 pending ops.
I20260709 13:04:19.494170   431 pending_rounds.cc:77] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634852668194816 op_type: NO_OP noop_request { }
I20260709 13:04:19.494436   431 raft_consensus.cc:2889] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:19.494835   431 raft_consensus.cc:2272] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.497797   431 tablet_replica.cc:333] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.498289   431 raft_consensus.cc:2243] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.498698   431 raft_consensus.cc:2272] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.501937   431 tablet_replica.cc:333] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.502588   431 raft_consensus.cc:2243] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.503595   431 raft_consensus.cc:2272] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.505774 11620 consensus_queue.cc:1048] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.507691   431 tablet_replica.cc:333] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: stopping tablet replica
I20260709 13:04:19.508381   431 raft_consensus.cc:2243] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.508842   431 raft_consensus.cc:2272] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.552544   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:19.553208 11437 consensus_peers.cc:597] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.599556 11593 consensus_queue.cc:1048] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:19.615988 11437 consensus_peers.cc:597] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.683471 11511 consensus_peers.cc:597] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.740234 11511 consensus_peers.cc:597] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.758767 11511 consensus_peers.cc:597] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.437197 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:20.740499 11511 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111) [suppressed 110 similar messages]
I20260709 13:04:20.824025 11625 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abb873328aa44b4ea0ecd97ffa35df06)
I20260709 13:04:20.824817 11625 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.827353 11625 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:20.828639 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:20.831199 11619 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abb873328aa44b4ea0ecd97ffa35df06)
I20260709 13:04:20.832078 11619 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.834378 11619 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
W20260709 13:04:20.835162 11511 leader_election.cc:336] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.835620 11511 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9; no voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:20.836280 11675 raft_consensus.cc:2749] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:20.837411 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
W20260709 13:04:20.837987 11437 leader_election.cc:336] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.838018 11544 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:20.839366 11437 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:20.840231 11619 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:20.840584 11619 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abb873328aa44b4ea0ecd97ffa35df06)
I20260709 13:04:20.840852 11619 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.847576 11619 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.849618 11619 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:20.851691 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:20.852423 11544 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.853754 11437 leader_election.cc:336] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.858634 11544 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:20.859803 11437 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:20.860522 11619 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.861330 11619 raft_consensus.cc:697] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:20.862738 11619 consensus_queue.cc:237] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.868014 11675 raft_consensus.cc:493] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abb873328aa44b4ea0ecd97ffa35df06)
I20260709 13:04:20.868847 11675 raft_consensus.cc:515] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.871191 11675 leader_election.cc:290] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:20.872756 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:20.872622 11291 catalog_manager.cc:5697] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 1 to 2, leader changed from abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.873451 11469 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
I20260709 13:04:20.874666 11508 leader_election.cc:304] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:20.875440 11675 raft_consensus.cc:2804] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:20.875895 11675 raft_consensus.cc:493] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abb873328aa44b4ea0ecd97ffa35df06)
W20260709 13:04:20.876077 11511 leader_election.cc:336] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.876327 11675 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.883001 11675 raft_consensus.cc:515] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.885355 11675 leader_election.cc:290] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:20.885993 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:20.886480 11469 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.890143 11511 leader_election.cc:336] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.894349 11469 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:20.895583 11508 leader_election.cc:304] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:20.896350 11675 raft_consensus.cc:2804] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.896795 11675 raft_consensus.cc:697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:20.897719 11675 consensus_queue.cc:237] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.906411 11291 catalog_manager.cc:5697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 1 to 2, leader changed from abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.946028 11619 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.946673 11619 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.949733 11619 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:20.951344 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9" is_pre_election: true
I20260709 13:04:20.952257 11544 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 1.
I20260709 13:04:20.953326 11437 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
W20260709 13:04:20.953962 11437 leader_election.cc:336] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.953972 11619 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:20.954404 11619 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.954645 11619 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.960450 11619 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.962666 11619 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:20.963964 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:20.964835 11544 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.965764 11437 leader_election.cc:336] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:20.972395 11544 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:20.973553 11437 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:20.974246 11619 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.974668 11619 raft_consensus.cc:697] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:20.975509 11619 consensus_queue.cc:237] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:20.983494 11291 catalog_manager.cc:5697] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 1 to 2, leader changed from abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.043715 11675 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.044528 11675 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:21.047578 11675 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:21.048981 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253" is_pre_election: true
I20260709 13:04:21.049681 11469 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 1.
I20260709 13:04:21.050973 11508 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:21.052062 11675 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:21.052495 11675 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:21.052553 11511 leader_election.cc:336] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:21.052784 11675 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.058156 11675 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:21.059788 11675 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:21.061025 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:21.061770 11469 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:21.063532 11511 leader_election.cc:336] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111)
I20260709 13:04:21.067770 11469 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:21.069078 11508 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: abb873328aa44b4ea0ecd97ffa35df06
I20260709 13:04:21.069856 11675 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:21.070327 11675 raft_consensus.cc:697] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:21.071195 11675 consensus_queue.cc:237] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:21.079487 11291 catalog_manager.cc:5697] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 1 to 2, leader changed from abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:21.316283 11437 consensus_peers.cc:597] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.354031 11544 raft_consensus.cc:1275] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.355698 11619 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:21.395780 11511 consensus_peers.cc:597] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.412045 11469 raft_consensus.cc:1275] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.413739 11675 consensus_queue.cc:1048] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:21.438088 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:21.446704 11544 raft_consensus.cc:1275] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:21.448344 11619 consensus_queue.cc:1048] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:21.461994 11437 consensus_peers.cc:597] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.539045 11469 raft_consensus.cc:1275] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:21.540472 11689 consensus_queue.cc:1048] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:21.558040 11511 consensus_peers.cc:597] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.958572 11437 consensus_peers.cc:597] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.079728 11511 consensus_peers.cc:597] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.123595 11437 consensus_peers.cc:597] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.202975 11511 consensus_peers.cc:597] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.269438 11437 consensus_peers.cc:597] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.320446 11511 consensus_peers.cc:597] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.439038 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:23.440140 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:24.006192 11437 consensus_peers.cc:597] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.044363 11437 consensus_peers.cc:597] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.060163 11511 consensus_peers.cc:597] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.128976 11511 consensus_peers.cc:597] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.441241 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:24.497712 11511 consensus_peers.cc:597] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.533326 11437 consensus_peers.cc:597] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.538697 11437 consensus_peers.cc:597] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:24.583616   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:24.592514 11698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:24.597762 11699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:24.598685 11702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:24.601693   431 server_base.cc:1061] running on GCE node
I20260709 13:04:24.603506   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:24.603793   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:24.603998   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602264603974 us; error 0 us; skew 500 ppm
I20260709 13:04:24.605437   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:24.610002   431 webserver.cc:533] Webserver started at http://127.0.107.193:37793/ using document root <none> and password file <none>
I20260709 13:04:24.610603   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:24.610805   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:24.615844   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:24.620078 11706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:24.621006   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:24.621405   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "abb873328aa44b4ea0ecd97ffa35df06"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-021n"
I20260709 13:04:24.621788   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:24.636261   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:24.637660   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:24.639215   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:24.644038 11713 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:04:24.712294   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:24.712679   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.070s	user 0.004s	sys 0.000s
I20260709 13:04:24.713228   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:24.718840 11713 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
W20260709 13:04:24.732131 11511 consensus_peers.cc:597] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:24.740213 11713 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:24.741178 11713 tablet_bootstrap.cc:492] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.741799 11713 ts_tablet_manager.cc:1403] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:04:24.744547 11713 raft_consensus.cc:359] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.745267 11713 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.745997 11713 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.748771 11713 ts_tablet_manager.cc:1434] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:24.749492 11713 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.762529 11713 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:24.763521 11713 tablet_bootstrap.cc:492] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.764503 11713 ts_tablet_manager.cc:1403] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:04:24.768642 11713 raft_consensus.cc:359] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.769618 11713 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.770429   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:24.771657   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.058s	user 0.057s	sys 0.001s
I20260709 13:04:24.770818 11713 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.773415 11713 ts_tablet_manager.cc:1434] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:24.774109 11713 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.792680 11713 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.793813 11713 tablet_bootstrap.cc:492] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.794713 11713 ts_tablet_manager.cc:1403] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 13:04:24.798166 11713 raft_consensus.cc:359] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.798991 11713 raft_consensus.cc:740] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.799811 11713 consensus_queue.cc:260] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.802227 11713 ts_tablet_manager.cc:1434] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:04:24.803247 11713 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
W20260709 13:04:24.816128 11511 consensus_peers.cc:597] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:24.818427 11713 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.819238 11713 tablet_bootstrap.cc:492] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.819823 11713 ts_tablet_manager.cc:1403] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:04:24.822124 11713 raft_consensus.cc:359] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.822650 11713 raft_consensus.cc:740] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.823478 11713 consensus_queue.cc:260] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.826082 11713 ts_tablet_manager.cc:1434] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:04:24.826902 11713 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.839202   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45305
I20260709 13:04:24.839372 11776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45305 every 8 connection(s)
I20260709 13:04:24.840828 11713 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.841624 11713 tablet_bootstrap.cc:492] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.842188 11713 ts_tablet_manager.cc:1403] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
W20260709 13:04:24.843899 11778 tablet.cc:2406] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:24.844481   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:24.845316 11713 raft_consensus.cc:359] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.846184 11713 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.847008 11713 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.850251 11713 ts_tablet_manager.cc:1434] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:24.851256 11713 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.867255 11713 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.867970 11777 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34631
I20260709 13:04:24.868482 11777 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:24.868786 11713 tablet_bootstrap.cc:492] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.869401 11777 heartbeater.cc:507] Master 127.0.107.254:34631 requested a full tablet report, sending...
I20260709 13:04:24.869802 11713 ts_tablet_manager.cc:1403] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:04:24.873420 11713 raft_consensus.cc:359] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.874127 11713 raft_consensus.cc:740] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.874812 11713 consensus_queue.cc:260] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.874960 11469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06f150fcff48426fa8f7fff511796958"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:24.875671 11469 raft_consensus.cc:606] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:24.876732 11713 ts_tablet_manager.cc:1434] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:24.877658 11713 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.878280 11469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ebe549f836145b881d01e752222c510"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:24.878810 11469 raft_consensus.cc:606] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:24.881971 11293 ts_manager.cc:194] Re-registered known tserver with Master: abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305)
I20260709 13:04:24.893033 11713 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.894145 11713 tablet_bootstrap.cc:492] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.894860 11713 ts_tablet_manager.cc:1403] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:04:24.895290 11293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60096
I20260709 13:04:24.896951 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:24.897614 11544 raft_consensus.cc:606] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:24.897460 11713 raft_consensus.cc:359] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.898223 11713 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.899071   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:24.898938 11713 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.899248 11777 heartbeater.cc:499] Master 127.0.107.254:34631 was elected leader, sending a full tablet report...
I20260709 13:04:24.899667   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:24.900398   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:24.901101 11713 ts_tablet_manager.cc:1434] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:24.902086 11713 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.918509 11713 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.919519 11713 tablet_bootstrap.cc:492] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.920094 11713 ts_tablet_manager.cc:1403] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:04:24.922466 11713 raft_consensus.cc:359] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.923177 11713 raft_consensus.cc:740] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.923836 11713 consensus_queue.cc:260] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.925693 11713 ts_tablet_manager.cc:1434] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:24.926498 11713 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.937507 11788 raft_consensus.cc:993] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:24.938030 11619 raft_consensus.cc:1081] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:24.939841 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06f150fcff48426fa8f7fff511796958"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:24.940734 11544 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.941051 11544 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.941582 11713 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.942505 11713 tablet_bootstrap.cc:492] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.943039 11713 ts_tablet_manager.cc:1403] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:04:24.945086 11713 raft_consensus.cc:359] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.945668 11713 raft_consensus.cc:740] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.947249 11713 consensus_queue.cc:260] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.950879 11713 ts_tablet_manager.cc:1434] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:24.950652 11544 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.952016 11713 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap starting.
I20260709 13:04:24.953949 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:24.954813 11750 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.955633 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:24.958215 11469 raft_consensus.cc:3055] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.958582 11469 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:24.959447 11469 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.960614 11469 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.966626 11750 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:24.967350 11544 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:24.968281 11511 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:24.972687 11697 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:24.973253 11697 raft_consensus.cc:697] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:24.974154 11697 consensus_queue.cc:237] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.975610 11713 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.975551 11469 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:24.976728 11713 tablet_bootstrap.cc:492] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Bootstrap complete.
I20260709 13:04:24.980037 11713 ts_tablet_manager.cc:1403] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.015s
I20260709 13:04:24.982506 11713 raft_consensus.cc:359] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.983160 11713 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abb873328aa44b4ea0ecd97ffa35df06, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.984169 11713 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:24.984054 11293 catalog_manager.cc:5697] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 2 to 3, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.987282 11713 ts_tablet_manager.cc:1434] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:25.050570 11788 raft_consensus.cc:993] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:25.051076 11619 raft_consensus.cc:1081] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:25.052778 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ebe549f836145b881d01e752222c510"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:25.053288 11544 raft_consensus.cc:493] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.053566 11544 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.058820 11544 raft_consensus.cc:515] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.060516 11544 leader_election.cc:290] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:25.061388 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:25.061554 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebe549f836145b881d01e752222c510" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:25.062127 11750 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.062198 11469 raft_consensus.cc:3055] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.062760 11469 raft_consensus.cc:740] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:25.063827 11469 consensus_queue.cc:260] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.065726 11469 raft_consensus.cc:3060] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.071388 11750 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:25.072885 11511 leader_election.cc:304] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:25.073257 11469 raft_consensus.cc:2468] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:25.073680 11697 raft_consensus.cc:2804] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.074361 11697 raft_consensus.cc:697] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:25.075286 11697 consensus_queue.cc:237] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.078258 11750 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.085029 11293 catalog_manager.cc:5697] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 1 to 2, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.103956 11750 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.139046 11714 raft_consensus.cc:993] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:25.139525 11714 raft_consensus.cc:1081] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:25.141314 11469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:25.141908 11469 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.142215 11469 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.148590 11469 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.150707 11469 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:25.151741 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:25.151741 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:25.152618 11544 raft_consensus.cc:3055] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.152679 11750 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.152943 11544 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:25.153831 11544 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.154928 11544 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.158609 11750 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 3.
I20260709 13:04:25.159938 11437 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:25.160851 11544 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 3.
I20260709 13:04:25.160867 11619 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.161523 11619 raft_consensus.cc:697] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:25.162420 11619 consensus_queue.cc:237] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:25.170972 11291 catalog_manager.cc:5697] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 2 to 3, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.403198 11750 raft_consensus.cc:1275] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.404829 11714 consensus_queue.cc:1048] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:25.405325 11714 consensus_queue.cc:1243] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Peer abb873328aa44b4ea0ecd97ffa35df06 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:04:25.407371 11750 pending_rounds.cc:85] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Aborting all ops after (but not including) 0
I20260709 13:04:25.407651 11750 pending_rounds.cc:107] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:25.407859 11750 raft_consensus.cc:2889] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:25.417021 11469 raft_consensus.cc:1275] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.419865 11805 consensus_queue.cc:1048] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:25.442194 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:25.477787 11469 raft_consensus.cc:1275] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.479143 11805 consensus_queue.cc:1048] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.494910 11750 raft_consensus.cc:1275] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.496237 11697 consensus_queue.cc:1048] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.551587 11750 raft_consensus.cc:1275] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.552978 11808 consensus_queue.cc:1048] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:25.553452 11808 consensus_queue.cc:1243] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Peer abb873328aa44b4ea0ecd97ffa35df06 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:04:25.555518 11750 pending_rounds.cc:85] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Aborting all ops after (but not including) 0
I20260709 13:04:25.555810 11750 pending_rounds.cc:107] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:25.556015 11750 raft_consensus.cc:2889] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:25.564440 11544 raft_consensus.cc:1275] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.567086 11808 consensus_queue.cc:1048] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.912151   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.921223 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:25.921738 11544 raft_consensus.cc:606] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:25.925208 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:25.925890 11544 raft_consensus.cc:606] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:25.928560 11469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:25.929102 11469 raft_consensus.cc:606] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:25.930347   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:25.930997   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:25.931763   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.238869 11697 raft_consensus.cc:993] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:26.239360 11805 raft_consensus.cc:1081] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:26.240231 11805 raft_consensus.cc:993] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:26.240679 11697 raft_consensus.cc:1081] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:26.240860 11469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:26.241420 11469 raft_consensus.cc:493] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.241760 11469 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.242343 11470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:26.243330 11470 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.243851 11470 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.250649 11469 raft_consensus.cc:515] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.253327 11469 leader_election.cc:290] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:26.253739 11470 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.254281 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:26.254259 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9b4cd0aeae4b889c9799d57ef6b3e4" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:26.255066 11544 raft_consensus.cc:3055] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:26.255156 11750 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.255427 11544 raft_consensus.cc:740] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:26.255868 11470 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:26.256201 11544 consensus_queue.cc:260] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.256597 11749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:26.257201 11749 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.257542 11544 raft_consensus.cc:3060] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.261173 11545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:26.262260 11545 raft_consensus.cc:3055] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:26.262660 11545 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:26.263976 11545 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.265502 11545 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.266175 11544 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 3.
I20260709 13:04:26.266937 11749 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:26.267633 11437 leader_election.cc:304] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:26.268611 11812 raft_consensus.cc:2804] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.269295 11750 raft_consensus.cc:2468] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 3.
I20260709 13:04:26.269471 11812 raft_consensus.cc:697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:26.270363 11437 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:26.270689 11812 consensus_queue.cc:237] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.271232 11619 raft_consensus.cc:2804] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.271935 11619 raft_consensus.cc:697] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:26.272756 11619 consensus_queue.cc:237] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.273928 11545 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:26.278332 11291 catalog_manager.cc:5697] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 2 to 3, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.296243 11291 catalog_manager.cc:5697] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 1 to 2, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.334380 11812 raft_consensus.cc:993] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:26.334800 11619 raft_consensus.cc:1081] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:26.336107 11545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:26.336604 11545 raft_consensus.cc:493] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.336874 11545 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.342015 11545 raft_consensus.cc:515] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.344062 11545 leader_election.cc:290] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:26.344990 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:26.344856 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3347777d385f4a79b9a3369a10c33816" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:26.345525 11470 raft_consensus.cc:3055] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:26.345582 11750 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.345820 11470 raft_consensus.cc:740] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:26.346662 11470 consensus_queue.cc:260] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.347613 11470 raft_consensus.cc:3060] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.351620 11750 raft_consensus.cc:2468] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:26.352577 11470 raft_consensus.cc:2468] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:26.352802 11511 leader_election.cc:304] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:26.353636 11697 raft_consensus.cc:2804] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.354198 11697 raft_consensus.cc:697] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:26.354998 11697 consensus_queue.cc:237] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:26.362686 11291 catalog_manager.cc:5697] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 1 to 2, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:26.443166 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:26.722585 11750 raft_consensus.cc:1275] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.723966 11619 consensus_queue.cc:1048] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.735196 11545 raft_consensus.cc:1275] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.736719 11619 consensus_queue.cc:1048] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:26.768474 11750 raft_consensus.cc:1275] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.769928 11697 consensus_queue.cc:1048] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.779969 11470 raft_consensus.cc:1275] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.781587 11805 consensus_queue.cc:1048] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.830091 11545 raft_consensus.cc:1275] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.831880 11619 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.841365 11750 raft_consensus.cc:1275] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.842975 11808 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.938505   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.946650 11470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:26.947204 11470 raft_consensus.cc:606] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:26.950604 11545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:26.951279 11545 raft_consensus.cc:606] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:26.954387 11470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:26.955034 11470 raft_consensus.cc:606] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:26.956555   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:26.957063   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:26.957734   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.210199 11619 raft_consensus.cc:993] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:27.211035 11808 raft_consensus.cc:1081] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:27.212791 11545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:27.213284 11545 raft_consensus.cc:493] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.213583 11545 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.218694 11545 raft_consensus.cc:515] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.220621 11545 leader_election.cc:290] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 4 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:27.221397 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:27.221724 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78d508c8de845b5a8eb4eba15f27d07" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:27.222049 11750 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.222297 11470 raft_consensus.cc:3055] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:27.222597 11470 raft_consensus.cc:740] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:27.223297 11470 consensus_queue.cc:260] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.225517 11470 raft_consensus.cc:3060] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.228533 11750 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 4.
I20260709 13:04:27.228730 11812 raft_consensus.cc:993] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:27.229445 11812 raft_consensus.cc:1081] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:27.229902 11511 leader_election.cc:304] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:27.230765 11805 raft_consensus.cc:2804] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:27.231302 11805 raft_consensus.cc:697] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 4 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:27.232255 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:27.232905 11544 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.232610 11805 consensus_queue.cc:237] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.233311 11544 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.235944 11470 raft_consensus.cc:2468] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 4.
I20260709 13:04:27.240092 11544 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.240760 11293 catalog_manager.cc:5697] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 3 to 4, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.242298 11544 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:27.243219 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:27.244058 11750 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.249475 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:27.250216 11470 raft_consensus.cc:3055] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.250540 11470 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:27.251194 11750 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:27.251355 11470 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.252643 11511 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:27.252722 11470 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.254321 11827 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.254912 11827 raft_consensus.cc:697] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:27.255968 11827 consensus_queue.cc:237] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.263957 11470 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:27.264168 11293 catalog_manager.cc:5697] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 2 to 3, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:27.444128 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:27.526232 11827 raft_consensus.cc:993] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:27.526926 11697 raft_consensus.cc:1081] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:27.528594 11470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:27.529165 11470 raft_consensus.cc:493] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.529474 11470 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.535737 11470 raft_consensus.cc:515] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.537525 11470 leader_election.cc:290] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:27.538497 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:27.538676 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629f781f1d945c69b2055b1fb4a4fcf" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:27.539040 11750 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.539244 11544 raft_consensus.cc:3055] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:27.539551 11544 raft_consensus.cc:740] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:27.540409 11544 consensus_queue.cc:260] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.541360 11544 raft_consensus.cc:3060] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.544133 11750 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:27.545377 11437 leader_election.cc:304] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:27.546049 11812 raft_consensus.cc:2804] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:27.546103 11544 raft_consensus.cc:2468] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:27.546599 11812 raft_consensus.cc:697] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:27.547509 11812 consensus_queue.cc:237] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:27.555544 11293 catalog_manager.cc:5697] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 1 to 2, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.680532 11470 raft_consensus.cc:1275] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.681828 11697 consensus_queue.cc:1048] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.694885 11750 raft_consensus.cc:1275] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.696382 11827 consensus_queue.cc:1048] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.707500 11750 raft_consensus.cc:1275] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.709022 11827 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.719558 11470 raft_consensus.cc:1275] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.721662 11827 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.965118   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.973100 11470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:27.973759 11470 raft_consensus.cc:606] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:27.976236 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06f150fcff48426fa8f7fff511796958"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:27.976833 11544 raft_consensus.cc:606] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:27.979125 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:27.979550 11544 raft_consensus.cc:606] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:27.980582   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:27.981045   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:27.981603   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.046489 11750 raft_consensus.cc:1275] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.048274 11812 consensus_queue.cc:1048] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.060997 11544 raft_consensus.cc:1275] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.063730 11847 consensus_queue.cc:1048] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.341607 11827 raft_consensus.cc:993] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:28.342049 11697 raft_consensus.cc:1081] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:28.343528 11470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:28.344280 11470 raft_consensus.cc:493] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.345317 11470 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.353302 11470 raft_consensus.cc:515] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.355618 11470 leader_election.cc:290] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:28.356588 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:28.356482 11749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:28.357375 11544 raft_consensus.cc:3055] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.357450 11749 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.357805 11544 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:28.358647 11544 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.359896 11544 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.365127 11749 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:28.366808 11437 leader_election.cc:304] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:28.367306 11544 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 2.
I20260709 13:04:28.367812 11847 raft_consensus.cc:2804] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.368350 11847 raft_consensus.cc:697] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:28.369204 11847 consensus_queue.cc:237] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.376845 11291 catalog_manager.cc:5697] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 1 to 2, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.444003 11846 raft_consensus.cc:993] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:28.444665 11847 raft_consensus.cc:1081] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
W20260709 13:04:28.445322 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:28.446435 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:28.446996 11544 raft_consensus.cc:493] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.447268 11544 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.452935 11544 raft_consensus.cc:515] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.454515 11544 leader_election.cc:290] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:28.455513 11749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:28.455554 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dcd53791e044e99650f2a895f4134a" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:28.456127 11749 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.456244 11470 raft_consensus.cc:3055] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:28.456671 11470 raft_consensus.cc:740] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:28.457387 11470 consensus_queue.cc:260] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.458348 11470 raft_consensus.cc:3060] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.461345 11749 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:28.462486 11511 leader_election.cc:304] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:28.463260 11697 raft_consensus.cc:2804] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.463563 11470 raft_consensus.cc:2468] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:28.463663 11697 raft_consensus.cc:697] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:28.464604 11697 consensus_queue.cc:237] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.473248 11291 catalog_manager.cc:5697] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 2 to 3, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.479996 11827 raft_consensus.cc:993] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:28.480468 11827 raft_consensus.cc:1081] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:28.481949 11470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06f150fcff48426fa8f7fff511796958"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:28.482488 11470 raft_consensus.cc:493] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.482861 11470 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.489024 11470 raft_consensus.cc:515] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.492024 11470 leader_election.cc:290] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 4 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:28.492812 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:28.493078 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f150fcff48426fa8f7fff511796958" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:28.493477 11750 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.493705 11544 raft_consensus.cc:3055] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:28.494024 11544 raft_consensus.cc:740] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:28.494654 11544 consensus_queue.cc:260] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.495527 11544 raft_consensus.cc:3060] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.498406 11750 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 4.
I20260709 13:04:28.499445 11437 leader_election.cc:304] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:28.500038 11847 raft_consensus.cc:2804] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:28.500396 11544 raft_consensus.cc:2468] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 4.
I20260709 13:04:28.500491 11847 raft_consensus.cc:697] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 4 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:28.501564 11847 consensus_queue.cc:237] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:28.509073 11291 catalog_manager.cc:5697] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 3 to 4, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.787621 11544 raft_consensus.cc:1275] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.789166 11855 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.799803 11750 raft_consensus.cc:1275] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.801414 11846 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.925163 11750 raft_consensus.cc:1275] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.926481 11827 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.935622 11470 raft_consensus.cc:1275] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.937381 11697 consensus_queue.cc:1048] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.950548 11544 raft_consensus.cc:1275] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:28.952389 11855 consensus_queue.cc:1048] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.963138 11750 raft_consensus.cc:1275] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:28.965384 11846 consensus_queue.cc:1048] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.988057   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.996737 11470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:28.997304 11470 raft_consensus.cc:606] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:28.999881 11544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
mode: GRACEFUL
new_leader_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:04:29.000355 11544 raft_consensus.cc:606] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Received request to transfer leadership to TS e611d553b96c45deb9b233eda3fd4253
I20260709 13:04:29.002969 11470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
mode: GRACEFUL
new_leader_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:39212
I20260709 13:04:29.003463 11470 raft_consensus.cc:606] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Received request to transfer leadership to TS 3c70efd1c172434bad95204cecb0edf9
I20260709 13:04:29.004735   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:29.005551   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:29.006206   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.205487 11863 raft_consensus.cc:993] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: : Instructing follower e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:29.206820 11697 raft_consensus.cc:1081] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Signalling peer e611d553b96c45deb9b233eda3fd4253 to start an election
I20260709 13:04:29.209937 11469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e"
dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
 from {username='slave'} at 127.0.0.1:41242
I20260709 13:04:29.211162 11469 raft_consensus.cc:493] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.211536 11469 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.220002 11469 raft_consensus.cc:515] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.222342 11469 leader_election.cc:290] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 4 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195:38597)
I20260709 13:04:29.224804 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:29.225333 11544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd602f93b4c46d8a39f0783d598d25e" candidate_uuid: "e611d553b96c45deb9b233eda3fd4253" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
I20260709 13:04:29.225740 11750 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.225958 11544 raft_consensus.cc:3055] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:29.226521 11544 raft_consensus.cc:740] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:29.227746 11544 consensus_queue.cc:260] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.229431 11544 raft_consensus.cc:3060] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.236943 11750 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 4.
I20260709 13:04:29.241276 11437 leader_election.cc:304] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abb873328aa44b4ea0ecd97ffa35df06, e611d553b96c45deb9b233eda3fd4253; no voters: 
I20260709 13:04:29.241982 11544 raft_consensus.cc:2468] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e611d553b96c45deb9b233eda3fd4253 in term 4.
I20260709 13:04:29.242502 11855 raft_consensus.cc:2804] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:29.243117 11855 raft_consensus.cc:697] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 4 LEADER]: Becoming Leader. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:29.245065 11855 consensus_queue.cc:237] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.257557 11291 catalog_manager.cc:5697] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 reported cstate change: term changed from 3 to 4, leader changed from 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195) to e611d553b96c45deb9b233eda3fd4253 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e611d553b96c45deb9b233eda3fd4253" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.302556 11846 raft_consensus.cc:993] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:29.303009 11846 raft_consensus.cc:1081] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:29.305054 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:29.305667 11544 raft_consensus.cc:493] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.306010 11544 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.313549 11544 raft_consensus.cc:515] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.316026 11544 leader_election.cc:290] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:29.316486 11749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:29.316679 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16342a8bb384363878f3f16a54a6154" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:29.317256 11749 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.317340 11469 raft_consensus.cc:3055] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:29.317848 11469 raft_consensus.cc:740] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:29.318636 11469 consensus_queue.cc:260] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.319710 11469 raft_consensus.cc:3060] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.326613 11749 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:29.327111 11469 raft_consensus.cc:2468] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 3.
I20260709 13:04:29.327831 11511 leader_election.cc:304] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:29.328737 11863 raft_consensus.cc:2804] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:29.329229 11863 raft_consensus.cc:697] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:29.330442 11863 consensus_queue.cc:237] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.338469 11291 catalog_manager.cc:5697] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 2 to 3, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:29.446769 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:29.465659 11855 raft_consensus.cc:993] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: : Instructing follower 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:29.466517 11847 raft_consensus.cc:1081] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Signalling peer 3c70efd1c172434bad95204cecb0edf9 to start an election
I20260709 13:04:29.468104 11544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235"
dest_uuid: "3c70efd1c172434bad95204cecb0edf9"
 from {username='slave'} at 127.0.0.1:34610
I20260709 13:04:29.468628 11544 raft_consensus.cc:493] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.468919 11544 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.475069 11544 raft_consensus.cc:515] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.476593 11544 leader_election.cc:290] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Requested vote from peers abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305), e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821)
I20260709 13:04:29.477510 11750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abb873328aa44b4ea0ecd97ffa35df06"
I20260709 13:04:29.477571 11469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaff45dd9404b0099fb1ca28439e235" candidate_uuid: "3c70efd1c172434bad95204cecb0edf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e611d553b96c45deb9b233eda3fd4253"
I20260709 13:04:29.478119 11750 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.478214 11469 raft_consensus.cc:3055] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:29.478593 11469 raft_consensus.cc:740] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e611d553b96c45deb9b233eda3fd4253, State: Running, Role: LEADER
I20260709 13:04:29.479349 11469 consensus_queue.cc:260] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.480273 11469 raft_consensus.cc:3060] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.482844 11750 raft_consensus.cc:2468] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:29.483937 11511 leader_election.cc:304] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c70efd1c172434bad95204cecb0edf9, abb873328aa44b4ea0ecd97ffa35df06; no voters: 
I20260709 13:04:29.484576 11863 raft_consensus.cc:2804] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:29.484951 11863 raft_consensus.cc:697] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Becoming Leader. State: Replica: 3c70efd1c172434bad95204cecb0edf9, State: Running, Role: LEADER
I20260709 13:04:29.485059 11469 raft_consensus.cc:2468] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c70efd1c172434bad95204cecb0edf9 in term 2.
I20260709 13:04:29.485965 11863 consensus_queue.cc:237] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } }
I20260709 13:04:29.493640 11291 catalog_manager.cc:5697] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 reported cstate change: term changed from 1 to 2, leader changed from e611d553b96c45deb9b233eda3fd4253 (127.0.107.194) to 3c70efd1c172434bad95204cecb0edf9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3c70efd1c172434bad95204cecb0edf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.637565 11750 raft_consensus.cc:1275] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:29.638949 11847 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.649550 11544 raft_consensus.cc:1275] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Refusing update from remote peer e611d553b96c45deb9b233eda3fd4253: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:29.651149 11846 consensus_queue.cc:1048] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c70efd1c172434bad95204cecb0edf9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.836853 11750 raft_consensus.cc:1275] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.838521 11863 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.845415 11469 raft_consensus.cc:1275] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.847313 11697 consensus_queue.cc:1048] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:29.934468 11469 raft_consensus.cc:1275] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.935930 11697 consensus_queue.cc:1048] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e611d553b96c45deb9b233eda3fd4253" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.946391 11750 raft_consensus.cc:1275] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Refusing update from remote peer 3c70efd1c172434bad95204cecb0edf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.948730 11827 consensus_queue.cc:1048] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abb873328aa44b4ea0ecd97ffa35df06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:30.012624   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:30.046507   431 tablet_server.cc:179] TabletServer@127.0.107.193:45305 shutting down...
I20260709 13:04:30.070148   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.070890   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.071497   431 raft_consensus.cc:2243] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.071943   431 raft_consensus.cc:2272] T f16342a8bb384363878f3f16a54a6154 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.075227   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.076063   431 raft_consensus.cc:2243] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.076674   431 raft_consensus.cc:2272] T 6629f781f1d945c69b2055b1fb4a4fcf P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.079002   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.079564   431 raft_consensus.cc:2243] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.080021   431 raft_consensus.cc:2272] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.082300   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.083050   431 raft_consensus.cc:2243] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.083487   431 raft_consensus.cc:2272] T 4bd602f93b4c46d8a39f0783d598d25e P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.086771   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.087280   431 raft_consensus.cc:2243] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.087718   431 raft_consensus.cc:2272] T 3347777d385f4a79b9a3369a10c33816 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.089963   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.090498   431 raft_consensus.cc:2243] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.090966   431 raft_consensus.cc:2272] T 06f150fcff48426fa8f7fff511796958 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.093581   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.094120   431 raft_consensus.cc:2243] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.094551   431 raft_consensus.cc:2272] T 0eaff45dd9404b0099fb1ca28439e235 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.097486   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.098007   431 raft_consensus.cc:2243] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.098443   431 raft_consensus.cc:2272] T 4ebe549f836145b881d01e752222c510 P abb873328aa44b4ea0ecd97ffa35df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.100898   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.101369   431 raft_consensus.cc:2243] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.101815   431 raft_consensus.cc:2272] T 03dcd53791e044e99650f2a895f4134a P abb873328aa44b4ea0ecd97ffa35df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.103859   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.104262   431 raft_consensus.cc:2243] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.104959   431 raft_consensus.cc:2272] T b78d508c8de845b5a8eb4eba15f27d07 P abb873328aa44b4ea0ecd97ffa35df06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.142761   431 tablet_server.cc:196] TabletServer@127.0.107.193:45305 shutdown complete.
I20260709 13:04:30.171607   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:30.194648   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.195439   431 tablet_replica.cc:333] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.196584   431 raft_consensus.cc:2243] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.197400   431 raft_consensus.cc:2272] T 4ebe549f836145b881d01e752222c510 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.199946   431 tablet_replica.cc:333] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.200723   431 raft_consensus.cc:2243] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.201159   431 raft_consensus.cc:2272] T f16342a8bb384363878f3f16a54a6154 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.204913   431 tablet_replica.cc:333] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.205590   431 raft_consensus.cc:2243] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.206629   431 raft_consensus.cc:2272] T 4bd602f93b4c46d8a39f0783d598d25e P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.209519   431 tablet_replica.cc:333] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.210095   431 raft_consensus.cc:2243] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.210920   431 raft_consensus.cc:2272] T 6629f781f1d945c69b2055b1fb4a4fcf P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.213065   431 tablet_replica.cc:333] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.213673   431 raft_consensus.cc:2243] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.214526   431 raft_consensus.cc:2272] T 06f150fcff48426fa8f7fff511796958 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.216974   431 tablet_replica.cc:333] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.217722   431 raft_consensus.cc:2243] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.218161   431 raft_consensus.cc:2272] T 0eaff45dd9404b0099fb1ca28439e235 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.221060   431 tablet_replica.cc:333] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.221658   431 raft_consensus.cc:2243] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.222249   431 raft_consensus.cc:2272] T 03dcd53791e044e99650f2a895f4134a P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.224843   431 tablet_replica.cc:333] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.225494   431 raft_consensus.cc:2243] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.226012   431 raft_consensus.cc:2272] T b78d508c8de845b5a8eb4eba15f27d07 P e611d553b96c45deb9b233eda3fd4253 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.228225   431 tablet_replica.cc:333] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.228825   431 raft_consensus.cc:2243] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.229777   431 raft_consensus.cc:2272] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P e611d553b96c45deb9b233eda3fd4253 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.232383   431 tablet_replica.cc:333] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253: stopping tablet replica
I20260709 13:04:30.233320   431 raft_consensus.cc:2243] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.234098   431 raft_consensus.cc:2272] T 3347777d385f4a79b9a3369a10c33816 P e611d553b96c45deb9b233eda3fd4253 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.234422 11508 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 85 similar messages]
W20260709 13:04:30.238871 11508 consensus_peers.cc:597] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 -> Peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Couldn't send request to peer e611d553b96c45deb9b233eda3fd4253. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.272634   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:30.298259   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:30.322849 11508 consensus_peers.cc:597] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 -> Peer e611d553b96c45deb9b233eda3fd4253 (127.0.107.194:33821): Couldn't send request to peer e611d553b96c45deb9b233eda3fd4253. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.330333   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.331212   431 tablet_replica.cc:333] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.331976   431 raft_consensus.cc:2243] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.333014   431 raft_consensus.cc:2272] T 4ebe549f836145b881d01e752222c510 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.336026   431 tablet_replica.cc:333] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.336686   431 raft_consensus.cc:2243] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.337574   431 raft_consensus.cc:2272] T 3347777d385f4a79b9a3369a10c33816 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.340646   431 tablet_replica.cc:333] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.341372   431 raft_consensus.cc:2243] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.341935   431 raft_consensus.cc:2272] T 1b9b4cd0aeae4b889c9799d57ef6b3e4 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.344372 11511 consensus_peers.cc:597] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 -> Peer abb873328aa44b4ea0ecd97ffa35df06 (127.0.107.193:45305): Couldn't send request to peer abb873328aa44b4ea0ecd97ffa35df06. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.345127   431 tablet_replica.cc:333] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.345844   431 raft_consensus.cc:2243] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.346772   431 raft_consensus.cc:2272] T b78d508c8de845b5a8eb4eba15f27d07 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.349347   431 tablet_replica.cc:333] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.349915   431 raft_consensus.cc:2243] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.350723   431 raft_consensus.cc:2272] T 03dcd53791e044e99650f2a895f4134a P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.353178   431 tablet_replica.cc:333] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.353914   431 raft_consensus.cc:2243] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.354328   431 raft_consensus.cc:2272] T 4bd602f93b4c46d8a39f0783d598d25e P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.357695   431 tablet_replica.cc:333] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.358269   431 raft_consensus.cc:2243] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.359092   431 raft_consensus.cc:2272] T f16342a8bb384363878f3f16a54a6154 P 3c70efd1c172434bad95204cecb0edf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.362705   431 tablet_replica.cc:333] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.363258   431 raft_consensus.cc:2243] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.363735   431 raft_consensus.cc:2272] T 6629f781f1d945c69b2055b1fb4a4fcf P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.366082   431 tablet_replica.cc:333] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.366582   431 raft_consensus.cc:2243] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.367404   431 raft_consensus.cc:2272] T 0eaff45dd9404b0099fb1ca28439e235 P 3c70efd1c172434bad95204cecb0edf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.370124   431 tablet_replica.cc:333] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9: stopping tablet replica
I20260709 13:04:30.370738   431 raft_consensus.cc:2243] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.371301   431 raft_consensus.cc:2272] T 06f150fcff48426fa8f7fff511796958 P 3c70efd1c172434bad95204cecb0edf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.408366   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:30.437839   431 master.cc:562] Master@127.0.107.254:34631 shutting down...
W20260709 13:04:30.449373 11342 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:30.462159   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.462766   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.463084   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57475ba400fd46c8903ad7386e14f07b: stopping tablet replica
I20260709 13:04:30.486631   431 master.cc:584] Master@127.0.107.254:34631 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13244 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:30.533222   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44457
I20260709 13:04:30.534353   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:30.540062 11888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.540141 11889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.541133 11891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.542886   431 server_base.cc:1061] running on GCE node
I20260709 13:04:30.544153   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:30.544443   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:30.544605   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602270544586 us; error 0 us; skew 500 ppm
I20260709 13:04:30.545186   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:30.548197   431 webserver.cc:533] Webserver started at http://127.0.107.254:35087/ using document root <none> and password file <none>
I20260709 13:04:30.548868   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:30.549072   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:30.549381   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:30.550674   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "4e2aac0231934ccab25b085ac05450fd"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.556802   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:30.561223 11896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.562033   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:04:30.562323   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "4e2aac0231934ccab25b085ac05450fd"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.562601   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:30.598260   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:30.599788   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:30.646095   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44457
I20260709 13:04:30.646170 11947 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44457 every 8 connection(s)
I20260709 13:04:30.650825 11948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.663206 11948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd: Bootstrap starting.
I20260709 13:04:30.668519 11948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.673359 11948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd: No bootstrap required, opened a new log
I20260709 13:04:30.675594 11948 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER }
I20260709 13:04:30.675987 11948 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.676209 11948 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e2aac0231934ccab25b085ac05450fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.676839 11948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER }
I20260709 13:04:30.677323 11948 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:30.677541 11948 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:30.677786 11948 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.682638 11948 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER }
I20260709 13:04:30.683295 11948 leader_election.cc:304] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e2aac0231934ccab25b085ac05450fd; no voters: 
I20260709 13:04:30.684517 11948 leader_election.cc:290] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:30.685104 11951 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.686522 11951 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 1 LEADER]: Becoming Leader. State: Replica: 4e2aac0231934ccab25b085ac05450fd, State: Running, Role: LEADER
I20260709 13:04:30.687094 11951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER }
I20260709 13:04:30.687448 11948 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:30.691308 11952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e2aac0231934ccab25b085ac05450fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER } }
I20260709 13:04:30.691689 11953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e2aac0231934ccab25b085ac05450fd. Latest consensus state: current_term: 1 leader_uuid: "4e2aac0231934ccab25b085ac05450fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2aac0231934ccab25b085ac05450fd" member_type: VOTER } }
I20260709 13:04:30.692142 11952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:30.692471 11953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:30.695437 11958 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:30.700680 11958 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:30.703603   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:30.709860 11958 catalog_manager.cc:1383] Generated new cluster ID: 3d6836f6fe564d43b63218e2ad4c804f
I20260709 13:04:30.710095 11958 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:30.732110 11958 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:30.733428 11958 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:30.749519 11958 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd: Generated new TSK 0
I20260709 13:04:30.750195 11958 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:30.771241   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:30.778179 11969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.779039 11970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.781883 11972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.781960   431 server_base.cc:1061] running on GCE node
I20260709 13:04:30.783327   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:30.783577   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:30.783777   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602270783754 us; error 0 us; skew 500 ppm
I20260709 13:04:30.784441   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:30.787317   431 webserver.cc:533] Webserver started at http://127.0.107.193:40743/ using document root <none> and password file <none>
I20260709 13:04:30.787878   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:30.788071   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:30.788414   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:30.789748   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "5282321aa5a742be817b61ae70944736"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.795372   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:30.799437 11977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.800478   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:04:30.800896   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "5282321aa5a742be817b61ae70944736"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.801208   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:30.816716   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:30.817979   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:30.819465   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:30.821980   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:30.822176   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.822409   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:30.822583   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.875753   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38977
I20260709 13:04:30.875862 12039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38977 every 8 connection(s)
I20260709 13:04:30.880713   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:30.888793 12045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.888854 12044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.895834 12040 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44457
I20260709 13:04:30.896365 12040 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:30.896447   431 server_base.cc:1061] running on GCE node
W20260709 13:04:30.897053 12048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.897451 12040 heartbeater.cc:507] Master 127.0.107.254:44457 requested a full tablet report, sending...
I20260709 13:04:30.898110   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:30.898362   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:30.898555   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602270898538 us; error 0 us; skew 500 ppm
I20260709 13:04:30.899256   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:30.899595 11913 ts_manager.cc:194] Registered new tserver with Master: 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977)
I20260709 13:04:30.901724 11913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51096
I20260709 13:04:30.901732   431 webserver.cc:533] Webserver started at http://127.0.107.194:46859/ using document root <none> and password file <none>
I20260709 13:04:30.902370   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:30.902719   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:30.903048   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:30.904193   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "d036979fe8eb426f84691f778b3d68d1"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.908588   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:04:30.912004 12052 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.913026   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:04:30.913321   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "d036979fe8eb426f84691f778b3d68d1"
format_stamp: "Formatted at 2026-07-09 13:04:30 on dist-test-slave-021n"
I20260709 13:04:30.913594   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:30.933017   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:30.934257   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:30.935705   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:30.937942   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:30.938143   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.938362   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:30.938508   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.979607   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40359
I20260709 13:04:30.979786 12114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40359 every 8 connection(s)
I20260709 13:04:30.984484   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:30.991631 12118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.992766 12119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.994591 12121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.995884   431 server_base.cc:1061] running on GCE node
I20260709 13:04:30.997293   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:30.997558   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:30.997738   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602270997723 us; error 0 us; skew 500 ppm
I20260709 13:04:30.998378   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:30.998963 12115 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44457
I20260709 13:04:30.999457 12115 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.000248 12115 heartbeater.cc:507] Master 127.0.107.254:44457 requested a full tablet report, sending...
I20260709 13:04:31.001500   431 webserver.cc:533] Webserver started at http://127.0.107.195:42991/ using document root <none> and password file <none>
I20260709 13:04:31.002303   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.002606   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.002967   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.002877 11913 ts_manager.cc:194] Registered new tserver with Master: d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359)
I20260709 13:04:31.004647 11913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51100
I20260709 13:04:31.004658   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-021n"
I20260709 13:04:31.010581   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:31.014513 12126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.015524   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:31.015858   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-021n"
I20260709 13:04:31.016165   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.033877   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.035049   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.036527   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:31.038866   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:31.039072   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.039296   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:31.039445   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.086671   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46151
I20260709 13:04:31.086810 12188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46151 every 8 connection(s)
I20260709 13:04:31.102674 12189 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44457
I20260709 13:04:31.103176 12189 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.103979 12189 heartbeater.cc:507] Master 127.0.107.254:44457 requested a full tablet report, sending...
I20260709 13:04:31.106031 11913 ts_manager.cc:194] Registered new tserver with Master: 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.106704   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016566108s
I20260709 13:04:31.107493 11913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51112
I20260709 13:04:31.137742 11913 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51128:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:31.140287 11913 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:31.192821 12154 tablet_service.cc:1511] Processing CreateTablet for tablet 91aec7afae2d4f1da1f8f2f4e8238d12 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.195147 12153 tablet_service.cc:1511] Processing CreateTablet for tablet 444f5904c3a44fafaa9c0d2f9d573c08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.196278 12154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91aec7afae2d4f1da1f8f2f4e8238d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.196131 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 91aec7afae2d4f1da1f8f2f4e8238d12 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.197522 12153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444f5904c3a44fafaa9c0d2f9d573c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.197990 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91aec7afae2d4f1da1f8f2f4e8238d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.201402 12004 tablet_service.cc:1511] Processing CreateTablet for tablet 444f5904c3a44fafaa9c0d2f9d573c08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.202914 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444f5904c3a44fafaa9c0d2f9d573c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.210382 12080 tablet_service.cc:1511] Processing CreateTablet for tablet 91aec7afae2d4f1da1f8f2f4e8238d12 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.210979 12079 tablet_service.cc:1511] Processing CreateTablet for tablet 444f5904c3a44fafaa9c0d2f9d573c08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b288762b346d4f01b806e9a044527f52]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.212121 12080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91aec7afae2d4f1da1f8f2f4e8238d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.213718 12079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444f5904c3a44fafaa9c0d2f9d573c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.238790 12205 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: Bootstrap starting.
I20260709 13:04:31.241253 12204 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: Bootstrap starting.
I20260709 13:04:31.245821 12205 tablet_bootstrap.cc:654] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.250984 12206 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: Bootstrap starting.
I20260709 13:04:31.255322 12205 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: No bootstrap required, opened a new log
I20260709 13:04:31.255921 12205 ts_tablet_manager.cc:1403] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:04:31.258450 12205 raft_consensus.cc:359] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.259212 12205 raft_consensus.cc:385] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.259462 12205 raft_consensus.cc:740] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.260579 12205 consensus_queue.cc:260] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.254149 12204 tablet_bootstrap.cc:654] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.261035 12206 tablet_bootstrap.cc:654] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.266100 12205 ts_tablet_manager.cc:1434] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:04:31.266070 12115 heartbeater.cc:499] Master 127.0.107.254:44457 was elected leader, sending a full tablet report...
I20260709 13:04:31.267349 12205 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: Bootstrap starting.
I20260709 13:04:31.271221 12204 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: No bootstrap required, opened a new log
I20260709 13:04:31.272063 12204 ts_tablet_manager.cc:1403] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:04:31.274250 12205 tablet_bootstrap.cc:654] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.276156 12204 raft_consensus.cc:359] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.277348 12204 raft_consensus.cc:385] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.277761 12204 raft_consensus.cc:740] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd3e4fa126b4f0cb7c180355011d1d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.278870 12204 consensus_queue.cc:260] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.287003 12205 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: No bootstrap required, opened a new log
I20260709 13:04:31.287762 12205 ts_tablet_manager.cc:1403] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:04:31.288515 12189 heartbeater.cc:499] Master 127.0.107.254:44457 was elected leader, sending a full tablet report...
I20260709 13:04:31.290308 12206 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: No bootstrap required, opened a new log
I20260709 13:04:31.290652 12204 ts_tablet_manager.cc:1434] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:04:31.290964 12206 ts_tablet_manager.cc:1403] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.015s
I20260709 13:04:31.290903 12205 raft_consensus.cc:359] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.291823 12204 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: Bootstrap starting.
I20260709 13:04:31.292100 12205 raft_consensus.cc:385] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.292584 12205 raft_consensus.cc:740] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.293910 12205 consensus_queue.cc:260] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.294734 12206 raft_consensus.cc:359] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.295763 12206 raft_consensus.cc:385] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.296164 12206 raft_consensus.cc:740] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5282321aa5a742be817b61ae70944736, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.296710 12205 ts_tablet_manager.cc:1434] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:04:31.297348 12206 consensus_queue.cc:260] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.300071 12040 heartbeater.cc:499] Master 127.0.107.254:44457 was elected leader, sending a full tablet report...
I20260709 13:04:31.300334 12204 tablet_bootstrap.cc:654] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.304592 12206 ts_tablet_manager.cc:1434] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:31.306844 12206 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: Bootstrap starting.
I20260709 13:04:31.313107 12204 tablet_bootstrap.cc:492] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: No bootstrap required, opened a new log
I20260709 13:04:31.313773 12204 ts_tablet_manager.cc:1403] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:04:31.316780 12204 raft_consensus.cc:359] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.317590 12206 tablet_bootstrap.cc:654] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.317539 12204 raft_consensus.cc:385] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.318106 12204 raft_consensus.cc:740] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd3e4fa126b4f0cb7c180355011d1d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.318953 12204 consensus_queue.cc:260] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.321200 12204 ts_tablet_manager.cc:1434] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:31.323354 12206 tablet_bootstrap.cc:492] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: No bootstrap required, opened a new log
I20260709 13:04:31.323932 12206 ts_tablet_manager.cc:1403] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:04:31.326293 12206 raft_consensus.cc:359] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.326828 12206 raft_consensus.cc:385] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.327039 12206 raft_consensus.cc:740] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5282321aa5a742be817b61ae70944736, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.327601 12206 consensus_queue.cc:260] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.329267 12206 ts_tablet_manager.cc:1434] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:31.369433 12212 raft_consensus.cc:493] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.370069 12212 raft_consensus.cc:515] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.370898 12208 raft_consensus.cc:493] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.371362 12208 raft_consensus.cc:515] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.372467 12212 leader_election.cc:290] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359)
I20260709 13:04:31.373740 12208 leader_election.cc:290] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.389658 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444f5904c3a44fafaa9c0d2f9d573c08" candidate_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736" is_pre_election: true
I20260709 13:04:31.391007 12015 raft_consensus.cc:2468] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bd3e4fa126b4f0cb7c180355011d1d4 in term 0.
I20260709 13:04:31.392252 12090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444f5904c3a44fafaa9c0d2f9d573c08" candidate_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d036979fe8eb426f84691f778b3d68d1" is_pre_election: true
I20260709 13:04:31.393039 12090 raft_consensus.cc:2468] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bd3e4fa126b4f0cb7c180355011d1d4 in term 0.
I20260709 13:04:31.393518 12128 leader_election.cc:304] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, 8bd3e4fa126b4f0cb7c180355011d1d4; no voters: 
I20260709 13:04:31.394755 12212 raft_consensus.cc:2804] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.395375 12212 raft_consensus.cc:493] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.396338 12212 raft_consensus.cc:3060] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.396788 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" is_pre_election: true
I20260709 13:04:31.397535 12164 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.398851 12056 leader_election.cc:304] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd3e4fa126b4f0cb7c180355011d1d4, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.399698 12208 raft_consensus.cc:2804] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.400059 12208 raft_consensus.cc:493] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.400348 12208 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.400286 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736" is_pre_election: true
I20260709 13:04:31.401193 12015 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.405227 12212 raft_consensus.cc:515] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.406936 12208 raft_consensus.cc:515] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.407302 12212 leader_election.cc:290] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359)
I20260709 13:04:31.408360 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444f5904c3a44fafaa9c0d2f9d573c08" candidate_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736"
I20260709 13:04:31.408447 12090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444f5904c3a44fafaa9c0d2f9d573c08" candidate_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
I20260709 13:04:31.409096 12090 raft_consensus.cc:3060] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.409138 12208 leader_election.cc:290] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Requested vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.410198 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:31.410492 12015 raft_consensus.cc:3060] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.410995 12164 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.410235 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736"
I20260709 13:04:31.411625 12014 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.418494 12090 raft_consensus.cc:2468] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bd3e4fa126b4f0cb7c180355011d1d4 in term 1.
I20260709 13:04:31.418978 12015 raft_consensus.cc:2468] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bd3e4fa126b4f0cb7c180355011d1d4 in term 1.
I20260709 13:04:31.419484 12164 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.419718 12014 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.420217 12127 leader_election.cc:304] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd3e4fa126b4f0cb7c180355011d1d4, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.420825 12054 leader_election.cc:304] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.421100 12212 raft_consensus.cc:2804] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.421664 12208 raft_consensus.cc:2804] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.422122 12212 raft_consensus.cc:697] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 LEADER]: Becoming Leader. State: Replica: 8bd3e4fa126b4f0cb7c180355011d1d4, State: Running, Role: LEADER
I20260709 13:04:31.422926 12208 raft_consensus.cc:697] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Leader. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:31.423259 12212 consensus_queue.cc:237] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.423868 12208 consensus_queue.cc:237] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:31.434973 11911 catalog_manager.cc:5697] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.435420 11912 catalog_manager.cc:5697] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d036979fe8eb426f84691f778b3d68d1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d036979fe8eb426f84691f778b3d68d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.508010 11912 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51144:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:31.510361 11912 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:31.536844 12004 tablet_service.cc:1511] Processing CreateTablet for tablet 7d88161b6133456d86e6bec722eced10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.538013 12079 tablet_service.cc:1511] Processing CreateTablet for tablet 7d88161b6133456d86e6bec722eced10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.538710 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d88161b6133456d86e6bec722eced10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.539441 12079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d88161b6133456d86e6bec722eced10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.540439 12153 tablet_service.cc:1511] Processing CreateTablet for tablet 7d88161b6133456d86e6bec722eced10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:31.541901 12153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d88161b6133456d86e6bec722eced10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.542264 12005 tablet_service.cc:1511] Processing CreateTablet for tablet a39e1e884d734cc49e693e5040f710f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.543628 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39e1e884d734cc49e693e5040f710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.554498 12080 tablet_service.cc:1511] Processing CreateTablet for tablet a39e1e884d734cc49e693e5040f710f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.556175 12080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39e1e884d734cc49e693e5040f710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.558544 12205 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: Bootstrap starting.
I20260709 13:04:31.561215 12204 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: Bootstrap starting.
I20260709 13:04:31.565788 12206 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: Bootstrap starting.
I20260709 13:04:31.569095 12204 tablet_bootstrap.cc:654] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.570379 12205 tablet_bootstrap.cc:654] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.573268 12206 tablet_bootstrap.cc:654] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.579934 12204 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: No bootstrap required, opened a new log
I20260709 13:04:31.580515 12204 ts_tablet_manager.cc:1403] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:04:31.585023 12153 tablet_service.cc:1511] Processing CreateTablet for tablet a39e1e884d734cc49e693e5040f710f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=90b49aeda3834c838453172da2ac4773]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:31.586457 12153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39e1e884d734cc49e693e5040f710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.599285 12204 raft_consensus.cc:359] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.600260 12204 raft_consensus.cc:385] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.600647 12204 raft_consensus.cc:740] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd3e4fa126b4f0cb7c180355011d1d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.600941 12206 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: No bootstrap required, opened a new log
I20260709 13:04:31.601549 12206 ts_tablet_manager.cc:1403] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.007s
I20260709 13:04:31.601653 12204 consensus_queue.cc:260] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.604343 12205 tablet_bootstrap.cc:492] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: No bootstrap required, opened a new log
I20260709 13:04:31.604748 12204 ts_tablet_manager.cc:1434] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:04:31.604820 12206 raft_consensus.cc:359] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.604957 12205 ts_tablet_manager.cc:1403] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.012s
I20260709 13:04:31.605937 12206 raft_consensus.cc:385] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.606359 12206 raft_consensus.cc:740] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5282321aa5a742be817b61ae70944736, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.607264 12206 consensus_queue.cc:260] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.609177 12205 raft_consensus.cc:359] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.610011 12205 raft_consensus.cc:385] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.610343 12205 raft_consensus.cc:740] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.610752 12204 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: Bootstrap starting.
I20260709 13:04:31.611202 12205 consensus_queue.cc:260] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.612650 12206 ts_tablet_manager.cc:1434] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:31.613888 12206 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: Bootstrap starting.
I20260709 13:04:31.614074 12205 ts_tablet_manager.cc:1434] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:04:31.615412 12205 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Bootstrap starting.
I20260709 13:04:31.618824 12204 tablet_bootstrap.cc:654] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.621618 12206 tablet_bootstrap.cc:654] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.623723 12205 tablet_bootstrap.cc:654] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.631775 12204 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: No bootstrap required, opened a new log
I20260709 13:04:31.632493 12204 ts_tablet_manager.cc:1403] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:04:31.636097 12204 raft_consensus.cc:359] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.637173 12204 raft_consensus.cc:385] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.637662 12204 raft_consensus.cc:740] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd3e4fa126b4f0cb7c180355011d1d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.638705 12204 consensus_queue.cc:260] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.641156 12206 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: No bootstrap required, opened a new log
I20260709 13:04:31.641794 12206 ts_tablet_manager.cc:1403] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 13:04:31.641861 12204 ts_tablet_manager.cc:1434] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:31.645079 12206 raft_consensus.cc:359] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.645850 12206 raft_consensus.cc:385] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.646173 12206 raft_consensus.cc:740] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5282321aa5a742be817b61ae70944736, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.647019 12206 consensus_queue.cc:260] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.647682 12205 tablet_bootstrap.cc:492] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: No bootstrap required, opened a new log
I20260709 13:04:31.648243 12205 ts_tablet_manager.cc:1403] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 13:04:31.649315 12206 ts_tablet_manager.cc:1434] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:04:31.651342 12205 raft_consensus.cc:359] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.651927 12205 raft_consensus.cc:385] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.652164 12205 raft_consensus.cc:740] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.652983 12205 consensus_queue.cc:260] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.654776 12205 ts_tablet_manager.cc:1434] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:04:31.699015 11961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:31.749123 12208 raft_consensus.cc:493] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.749845 12208 raft_consensus.cc:515] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.751725 12208 leader_election.cc:290] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.752727 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736" is_pre_election: true
I20260709 13:04:31.753026 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" is_pre_election: true
I20260709 13:04:31.753435 12014 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.753799 12164 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.754671 12054 leader_election.cc:304] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.755708 12208 raft_consensus.cc:2804] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.756090 12208 raft_consensus.cc:493] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.756448 12208 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.762804 12208 raft_consensus.cc:515] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.764622 12208 leader_election.cc:290] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Requested vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.765506 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736"
I20260709 13:04:31.765671 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:31.766073 12014 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.766252 12164 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.771386 12164 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.771386 12014 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.772548 12056 leader_election.cc:304] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd3e4fa126b4f0cb7c180355011d1d4, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.773224 12208 raft_consensus.cc:2804] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.773676 12208 raft_consensus.cc:697] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Leader. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:31.774427 12208 consensus_queue.cc:237] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.783233 11911 catalog_manager.cc:5697] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d036979fe8eb426f84691f778b3d68d1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d036979fe8eb426f84691f778b3d68d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.856405 12212 consensus_queue.cc:1048] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.869284 12212 consensus_queue.cc:1048] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.897001 12208 consensus_queue.cc:1048] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.908751 12208 consensus_queue.cc:1048] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.912211 12242 raft_consensus.cc:493] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.912969 12242 raft_consensus.cc:515] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.915405 12242 leader_election.cc:290] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.916642 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736" is_pre_election: true
I20260709 13:04:31.917232 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" is_pre_election: true
I20260709 13:04:31.917474 12015 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.917968 12164 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 0.
I20260709 13:04:31.918560 12054 leader_election.cc:304] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.919404 12242 raft_consensus.cc:2804] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.919744 12242 raft_consensus.cc:493] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.919997 12242 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.925455 12242 raft_consensus.cc:515] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.927029 12242 leader_election.cc:290] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Requested vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:31.927706 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5282321aa5a742be817b61ae70944736"
I20260709 13:04:31.927929 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:31.928398 12015 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.928498 12164 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.933332 12164 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.933902 12015 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 1.
I20260709 13:04:31.934266 12056 leader_election.cc:304] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd3e4fa126b4f0cb7c180355011d1d4, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:31.935027 12242 raft_consensus.cc:2804] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.935467 12242 raft_consensus.cc:697] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Leader. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:31.936295 12242 consensus_queue.cc:237] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:31.942582 11913 catalog_manager.cc:5697] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d036979fe8eb426f84691f778b3d68d1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d036979fe8eb426f84691f778b3d68d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.988457 12090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12"
dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
mode: GRACEFUL
new_leader_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:04:31.989194 12090 raft_consensus.cc:606] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Received request to transfer leadership to TS 5282321aa5a742be817b61ae70944736
I20260709 13:04:31.999241 12090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d88161b6133456d86e6bec722eced10"
dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
mode: GRACEFUL
new_leader_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:04:31.999783 12090 raft_consensus.cc:606] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Received request to transfer leadership to TS 5282321aa5a742be817b61ae70944736
I20260709 13:04:32.006078 12090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0"
dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
mode: GRACEFUL
new_leader_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:04:32.006613 12090 raft_consensus.cc:606] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Received request to transfer leadership to TS 5282321aa5a742be817b61ae70944736
I20260709 13:04:32.284053 12242 consensus_queue.cc:1048] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.294862 12208 consensus_queue.cc:1048] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.302898 12208 raft_consensus.cc:993] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: : Instructing follower 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.303493 12220 raft_consensus.cc:1081] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Signalling peer 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.305327 12015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0"
dest_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:47648
I20260709 13:04:32.306035 12015 raft_consensus.cc:493] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.306502 12015 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.312748 12015 raft_consensus.cc:515] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.323748 12015 leader_election.cc:290] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Requested vote from peers d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:32.336109 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:32.336102 12090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
I20260709 13:04:32.336757 12164 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.336887 12090 raft_consensus.cc:3055] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.337303 12090 raft_consensus.cc:740] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:32.338019 12090 consensus_queue.cc:260] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.339002 12090 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.342139 12164 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.343259 11981 leader_election.cc:304] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, 8bd3e4fa126b4f0cb7c180355011d1d4; no voters: 
I20260709 13:04:32.343946 12213 raft_consensus.cc:2804] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.344337 12090 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.345252 12213 raft_consensus.cc:697] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Becoming Leader. State: Replica: 5282321aa5a742be817b61ae70944736, State: Running, Role: LEADER
I20260709 13:04:32.346082 12213 consensus_queue.cc:237] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.352205 11913 catalog_manager.cc:5697] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 reported cstate change: term changed from 1 to 2, leader changed from d036979fe8eb426f84691f778b3d68d1 (127.0.107.194) to 5282321aa5a742be817b61ae70944736 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5282321aa5a742be817b61ae70944736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.369405 12220 consensus_queue.cc:1048] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.382349 12220 consensus_queue.cc:1048] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.390028 12242 raft_consensus.cc:993] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: : Instructing follower 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.390558 12220 raft_consensus.cc:1081] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Signalling peer 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.393153 12015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d88161b6133456d86e6bec722eced10"
dest_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:47648
I20260709 13:04:32.394119 12015 raft_consensus.cc:493] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.394744 12015 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.395553 12208 raft_consensus.cc:993] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: : Instructing follower 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.396116 12220 raft_consensus.cc:1081] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Signalling peer 5282321aa5a742be817b61ae70944736 to start an election
I20260709 13:04:32.398063 12014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12"
dest_uuid: "5282321aa5a742be817b61ae70944736"
 from {username='slave'} at 127.0.0.1:47648
I20260709 13:04:32.398758 12014 raft_consensus.cc:493] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.399160 12014 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.404194 12015 raft_consensus.cc:515] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.405436 12014 raft_consensus.cc:515] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:32.406152 12015 leader_election.cc:290] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Requested vote from peers d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:32.406958 12090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
I20260709 13:04:32.407338 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d88161b6133456d86e6bec722eced10" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:32.407662 12090 raft_consensus.cc:3055] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.408047 12164 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.408030 12090 raft_consensus.cc:740] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:32.408278 12163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:32.408768 12014 leader_election.cc:290] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Requested vote from peers 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151), d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359)
I20260709 13:04:32.409402 12089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91aec7afae2d4f1da1f8f2f4e8238d12" candidate_uuid: "5282321aa5a742be817b61ae70944736" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
I20260709 13:04:32.410068 12089 raft_consensus.cc:3055] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.410386 12089 raft_consensus.cc:740] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:32.409121 12090 consensus_queue.cc:260] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.411296 12089 consensus_queue.cc:260] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:32.411512 12090 raft_consensus.cc:3060] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.410622 12163 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.412719 12089 raft_consensus.cc:3060] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.416976 12164 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.418471 11981 leader_election.cc:304] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, 8bd3e4fa126b4f0cb7c180355011d1d4; no voters: 
I20260709 13:04:32.419406 12213 raft_consensus.cc:2804] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.419847 12213 raft_consensus.cc:697] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Becoming Leader. State: Replica: 5282321aa5a742be817b61ae70944736, State: Running, Role: LEADER
I20260709 13:04:32.420333 12163 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.420531 12090 raft_consensus.cc:2468] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.420688 12213 consensus_queue.cc:237] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.421878 11981 leader_election.cc:304] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, 8bd3e4fa126b4f0cb7c180355011d1d4; no voters: 
I20260709 13:04:32.422789 12089 raft_consensus.cc:2468] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282321aa5a742be817b61ae70944736 in term 2.
I20260709 13:04:32.422873 12252 raft_consensus.cc:2804] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.424687 12252 raft_consensus.cc:697] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Becoming Leader. State: Replica: 5282321aa5a742be817b61ae70944736, State: Running, Role: LEADER
I20260709 13:04:32.425506 12252 consensus_queue.cc:237] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } }
I20260709 13:04:32.428831 11913 catalog_manager.cc:5697] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 reported cstate change: term changed from 1 to 2, leader changed from d036979fe8eb426f84691f778b3d68d1 (127.0.107.194) to 5282321aa5a742be817b61ae70944736 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5282321aa5a742be817b61ae70944736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.442775 11911 catalog_manager.cc:5697] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 reported cstate change: term changed from 1 to 2, leader changed from d036979fe8eb426f84691f778b3d68d1 (127.0.107.194) to 5282321aa5a742be817b61ae70944736 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5282321aa5a742be817b61ae70944736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.481346   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:32.483242   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:32.483659   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:32.496671 12015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0"
dest_uuid: "5282321aa5a742be817b61ae70944736"
mode: GRACEFUL
new_leader_uuid: "d036979fe8eb426f84691f778b3d68d1"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:04:32.497259 12015 raft_consensus.cc:606] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Received request to transfer leadership to TS d036979fe8eb426f84691f778b3d68d1
I20260709 13:04:32.498430   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:32.851097 12089 raft_consensus.cc:1275] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.852348 12252 consensus_queue.cc:1048] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.859926 12163 raft_consensus.cc:1275] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.861442 12213 consensus_queue.cc:1048] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.897902 12089 raft_consensus.cc:1275] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.899412 12252 consensus_queue.cc:1048] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.904865 12255 raft_consensus.cc:993] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: : Instructing follower d036979fe8eb426f84691f778b3d68d1 to start an election
I20260709 13:04:32.905370 12213 raft_consensus.cc:1081] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Signalling peer d036979fe8eb426f84691f778b3d68d1 to start an election
I20260709 13:04:32.907069 12090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0"
dest_uuid: "d036979fe8eb426f84691f778b3d68d1"
 from {username='slave'} at 127.0.0.1:36780
I20260709 13:04:32.908138 12090 raft_consensus.cc:493] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.908542 12090 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.909940 12163 raft_consensus.cc:1275] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.911701 12252 consensus_queue.cc:1048] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.913106 12164 raft_consensus.cc:1275] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.914916 12252 consensus_queue.cc:1048] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.916422 12090 raft_consensus.cc:515] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.922453 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5282321aa5a742be817b61ae70944736"
I20260709 13:04:32.923066 12015 raft_consensus.cc:3055] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:32.923408 12015 raft_consensus.cc:740] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5282321aa5a742be817b61ae70944736, State: Running, Role: LEADER
I20260709 13:04:32.924186 12015 consensus_queue.cc:260] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.925294 12015 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.926433 12089 raft_consensus.cc:1275] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Refusing update from remote peer 5282321aa5a742be817b61ae70944736: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.928001 12213 consensus_queue.cc:1048] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.930721 12090 leader_election.cc:290] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 3 election: Requested vote from peers 5282321aa5a742be817b61ae70944736 (127.0.107.193:38977), 8bd3e4fa126b4f0cb7c180355011d1d4 (127.0.107.195:46151)
I20260709 13:04:32.931797 12164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39e1e884d734cc49e693e5040f710f0" candidate_uuid: "d036979fe8eb426f84691f778b3d68d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4"
I20260709 13:04:32.932493 12164 raft_consensus.cc:3060] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.940213 12015 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 3.
I20260709 13:04:32.941969 12054 leader_election.cc:304] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282321aa5a742be817b61ae70944736, d036979fe8eb426f84691f778b3d68d1; no voters: 
I20260709 13:04:32.942965 12164 raft_consensus.cc:2468] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d036979fe8eb426f84691f778b3d68d1 in term 3.
I20260709 13:04:32.942973 12220 raft_consensus.cc:2804] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:32.948097 12220 raft_consensus.cc:697] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 LEADER]: Becoming Leader. State: Replica: d036979fe8eb426f84691f778b3d68d1, State: Running, Role: LEADER
I20260709 13:04:32.949107 12220 consensus_queue.cc:237] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } }
I20260709 13:04:32.955381 11912 catalog_manager.cc:5697] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 reported cstate change: term changed from 2 to 3, leader changed from 5282321aa5a742be817b61ae70944736 (127.0.107.193) to d036979fe8eb426f84691f778b3d68d1 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d036979fe8eb426f84691f778b3d68d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5282321aa5a742be817b61ae70944736" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d036979fe8eb426f84691f778b3d68d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bd3e4fa126b4f0cb7c180355011d1d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.120642   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:33.139353   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.140117   431 tablet_replica.cc:333] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736: stopping tablet replica
I20260709 13:04:33.140790   431 raft_consensus.cc:2243] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.141240   431 raft_consensus.cc:2272] T a39e1e884d734cc49e693e5040f710f0 P 5282321aa5a742be817b61ae70944736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.143862   431 tablet_replica.cc:333] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736: stopping tablet replica
I20260709 13:04:33.144500   431 raft_consensus.cc:2243] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.145391   431 raft_consensus.cc:2272] T 7d88161b6133456d86e6bec722eced10 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.148258   431 tablet_replica.cc:333] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736: stopping tablet replica
I20260709 13:04:33.148885   431 raft_consensus.cc:2243] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.149775   431 raft_consensus.cc:2272] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 5282321aa5a742be817b61ae70944736 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.152429   431 tablet_replica.cc:333] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736: stopping tablet replica
I20260709 13:04:33.152947   431 raft_consensus.cc:2243] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.153344   431 raft_consensus.cc:2272] T 444f5904c3a44fafaa9c0d2f9d573c08 P 5282321aa5a742be817b61ae70944736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.167459   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:33.179458   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:33.197935 12127 consensus_peers.cc:597] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 -> Peer d036979fe8eb426f84691f778b3d68d1 (127.0.107.194:40359): Couldn't send request to peer d036979fe8eb426f84691f778b3d68d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.202025   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.202692   431 tablet_replica.cc:333] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: stopping tablet replica
I20260709 13:04:33.203197   431 raft_consensus.cc:2243] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.203806   431 pending_rounds.cc:70] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Trying to abort 1 pending ops.
I20260709 13:04:33.203974   431 pending_rounds.cc:77] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634910007042048 op_type: NO_OP noop_request { }
I20260709 13:04:33.204234   431 raft_consensus.cc:2889] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.204519   431 raft_consensus.cc:2272] T a39e1e884d734cc49e693e5040f710f0 P d036979fe8eb426f84691f778b3d68d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.206657   431 tablet_replica.cc:333] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1: stopping tablet replica
I20260709 13:04:33.207219   431 raft_consensus.cc:2243] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.207633   431 raft_consensus.cc:2272] T 7d88161b6133456d86e6bec722eced10 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.209802   431 tablet_replica.cc:333] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1: stopping tablet replica
I20260709 13:04:33.210275   431 raft_consensus.cc:2243] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.210637   431 raft_consensus.cc:2272] T 444f5904c3a44fafaa9c0d2f9d573c08 P d036979fe8eb426f84691f778b3d68d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.212386   431 tablet_replica.cc:333] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1: stopping tablet replica
I20260709 13:04:33.212824   431 raft_consensus.cc:2243] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.213179   431 raft_consensus.cc:2272] T 91aec7afae2d4f1da1f8f2f4e8238d12 P d036979fe8eb426f84691f778b3d68d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.236058   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:33.248734   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:33.267023   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.267642   431 tablet_replica.cc:333] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4: stopping tablet replica
I20260709 13:04:33.268265   431 raft_consensus.cc:2243] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.268760   431 raft_consensus.cc:2272] T a39e1e884d734cc49e693e5040f710f0 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.271104   431 tablet_replica.cc:333] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4: stopping tablet replica
I20260709 13:04:33.271643   431 raft_consensus.cc:2243] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.272040   431 raft_consensus.cc:2272] T 7d88161b6133456d86e6bec722eced10 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.274263   431 tablet_replica.cc:333] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4: stopping tablet replica
I20260709 13:04:33.274767   431 raft_consensus.cc:2243] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.275540   431 raft_consensus.cc:2272] T 444f5904c3a44fafaa9c0d2f9d573c08 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.277356   431 tablet_replica.cc:333] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4: stopping tablet replica
I20260709 13:04:33.277916   431 raft_consensus.cc:2243] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.278344   431 raft_consensus.cc:2272] T 91aec7afae2d4f1da1f8f2f4e8238d12 P 8bd3e4fa126b4f0cb7c180355011d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.300351   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:33.314373   431 master.cc:562] Master@127.0.107.254:44457 shutting down...
I20260709 13:04:33.329453   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.330024   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.330354   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4e2aac0231934ccab25b085ac05450fd: stopping tablet replica
I20260709 13:04:33.349223   431 master.cc:584] Master@127.0.107.254:44457 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2845 ms)
[----------] 6 tests from LeaderRebalancerTest (336337 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:33.378692   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38963
I20260709 13:04:33.379804   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:33.385370 12265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.385480 12266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.386935 12268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.388384   431 server_base.cc:1061] running on GCE node
I20260709 13:04:33.389309   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:33.389492   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:33.389699   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602273389664 us; error 0 us; skew 500 ppm
I20260709 13:04:33.390254   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:33.393040   431 webserver.cc:533] Webserver started at http://127.0.107.254:39615/ using document root <none> and password file <none>
I20260709 13:04:33.393627   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:33.393848   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:33.394104   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:33.395340   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "bab9a74134ce4b18a16445772f190dbd"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.400821   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:04:33.404731 12273 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.405571   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:04:33.405858   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "bab9a74134ce4b18a16445772f190dbd"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.406126   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:33.422619   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:33.423925   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:33.467864   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38963
I20260709 13:04:33.467979 12324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38963 every 8 connection(s)
I20260709 13:04:33.472363 12325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:33.486302 12325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: Bootstrap starting.
I20260709 13:04:33.491513 12325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.495757 12325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: No bootstrap required, opened a new log
I20260709 13:04:33.497967 12325 raft_consensus.cc:359] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER }
I20260709 13:04:33.498360 12325 raft_consensus.cc:385] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.498582 12325 raft_consensus.cc:740] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab9a74134ce4b18a16445772f190dbd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.499193 12325 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER }
I20260709 13:04:33.499639 12325 raft_consensus.cc:399] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:33.499873 12325 raft_consensus.cc:493] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:33.500125 12325 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.506892 12325 raft_consensus.cc:515] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER }
I20260709 13:04:33.507539 12325 leader_election.cc:304] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab9a74134ce4b18a16445772f190dbd; no voters: 
I20260709 13:04:33.509223 12325 leader_election.cc:290] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:33.509625 12328 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.511243 12328 raft_consensus.cc:697] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 1 LEADER]: Becoming Leader. State: Replica: bab9a74134ce4b18a16445772f190dbd, State: Running, Role: LEADER
I20260709 13:04:33.511976 12328 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER }
I20260709 13:04:33.513000 12325 sys_catalog.cc:565] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:33.515110 12329 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bab9a74134ce4b18a16445772f190dbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER } }
I20260709 13:04:33.515110 12330 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab9a74134ce4b18a16445772f190dbd. Latest consensus state: current_term: 1 leader_uuid: "bab9a74134ce4b18a16445772f190dbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab9a74134ce4b18a16445772f190dbd" member_type: VOTER } }
I20260709 13:04:33.515983 12329 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:33.516064 12330 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:33.521602 12334 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:33.530400 12334 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:33.531687   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:33.541524 12334 catalog_manager.cc:1383] Generated new cluster ID: 1dd7898abf08434499361fa1a4fb9d77
I20260709 13:04:33.542048 12334 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:33.562147 12334 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:33.564427 12334 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:33.582942 12334 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: Generated new TSK 0
I20260709 13:04:33.583794 12334 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:33.598888   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:33.606179 12346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.607954 12347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.611310   431 server_base.cc:1061] running on GCE node
W20260709 13:04:33.611227 12349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.612668   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:33.612896   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:33.613062   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602273613038 us; error 0 us; skew 500 ppm
I20260709 13:04:33.613606   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:33.616400   431 webserver.cc:533] Webserver started at http://127.0.107.193:33345/ using document root <none> and password file <none>
I20260709 13:04:33.616930   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:33.617117   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:33.617391   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:33.618547   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "6238ce107b1e4c74b68b3de891221b4b"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.623659   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:33.628376 12354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.629344   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:33.629668   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "6238ce107b1e4c74b68b3de891221b4b"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.629936   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:33.642983   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:33.644649   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:33.646271   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:33.648908   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:33.649134   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.649334   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:33.649475   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.695677   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38435
I20260709 13:04:33.695814 12416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38435 every 8 connection(s)
I20260709 13:04:33.701556   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:33.709625 12422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.709558 12421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.714478 12417 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38963
I20260709 13:04:33.715440 12417 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:33.716349 12417 heartbeater.cc:507] Master 127.0.107.254:38963 requested a full tablet report, sending...
I20260709 13:04:33.716667   431 server_base.cc:1061] running on GCE node
W20260709 13:04:33.717211 12424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.718303   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:33.718534   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:33.718705   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602273718687 us; error 0 us; skew 500 ppm
I20260709 13:04:33.719249 12290 ts_manager.cc:194] Registered new tserver with Master: 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435)
I20260709 13:04:33.719344   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:33.721417 12290 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53846
I20260709 13:04:33.722182   431 webserver.cc:533] Webserver started at http://127.0.107.194:44747/ using document root <none> and password file <none>
I20260709 13:04:33.722730   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:33.722919   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:33.723191   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:33.724400   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "f136be7f233943ddbb244c5daa113417"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.729710   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:04:33.734429 12429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.735560   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:04:33.735930   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "f136be7f233943ddbb244c5daa113417"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.736258   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:33.745608   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:33.746687   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:33.748159   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:33.750480   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:33.750682   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.750909   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:33.751065   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.794988   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33265
I20260709 13:04:33.795109 12491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33265 every 8 connection(s)
I20260709 13:04:33.800182   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:04:33.817078 12492 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38963
I20260709 13:04:33.817704 12492 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:33.818568 12496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.818722 12492 heartbeater.cc:507] Master 127.0.107.254:38963 requested a full tablet report, sending...
W20260709 13:04:33.821281 12495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.821281 12290 ts_manager.cc:194] Registered new tserver with Master: f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:33.825906 12290 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53856
W20260709 13:04:33.826593 12498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.828647   431 server_base.cc:1061] running on GCE node
I20260709 13:04:33.829816   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:33.830041   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:33.830209   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602273830190 us; error 0 us; skew 500 ppm
I20260709 13:04:33.830726   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:33.833688   431 webserver.cc:533] Webserver started at http://127.0.107.195:46781/ using document root <none> and password file <none>
I20260709 13:04:33.834208   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:33.834372   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:33.834614   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:33.835764   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.841020   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:33.844854 12503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.845815   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:04:33.846143   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-021n"
I20260709 13:04:33.846458   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:33.870469   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:33.871521   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:33.873116   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:33.875473   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:33.875741   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.876024   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:33.876178   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.918776   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38065
I20260709 13:04:33.918897 12565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38065 every 8 connection(s)
I20260709 13:04:33.932267 12566 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38963
I20260709 13:04:33.932832 12566 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:33.933648 12566 heartbeater.cc:507] Master 127.0.107.254:38963 requested a full tablet report, sending...
I20260709 13:04:33.935660 12290 ts_manager.cc:194] Registered new tserver with Master: e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:33.936578   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014690665s
I20260709 13:04:33.937119 12290 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53866
I20260709 13:04:33.964941 12290 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53874:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:33.969249 12290 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:34.053216 12457 tablet_service.cc:1511] Processing CreateTablet for tablet 659b1001b708481eb6babdb52ee14932 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.054647 12457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b1001b708481eb6babdb52ee14932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.055349 12455 tablet_service.cc:1511] Processing CreateTablet for tablet e4f06730d1ea4198bd857096eacfb65b (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.056938 12455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f06730d1ea4198bd857096eacfb65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.057535 12456 tablet_service.cc:1511] Processing CreateTablet for tablet 67f457232dbf490fb66e384f63359610 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.058979 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f457232dbf490fb66e384f63359610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.061496 12454 tablet_service.cc:1511] Processing CreateTablet for tablet 13b74d76ad0d4e35a7c3b7a4b0167686 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.063001 12454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b74d76ad0d4e35a7c3b7a4b0167686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.065094 12453 tablet_service.cc:1511] Processing CreateTablet for tablet ebccc43d996443238d52afdd0323755a (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.066875 12453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebccc43d996443238d52afdd0323755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.069255 12452 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4f277c23d54d11b7d393c145245d1e (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.071617 12452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4f277c23d54d11b7d393c145245d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.074038 12451 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9ba9b18e24dd3b400e9eaf11be37d (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.075977 12451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9ba9b18e24dd3b400e9eaf11be37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.077795 12449 tablet_service.cc:1511] Processing CreateTablet for tablet 8282a433fc234c42aad9a6b1fde1a50c (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.072022 12450 tablet_service.cc:1511] Processing CreateTablet for tablet e44692cdc9a94782913b2c1c403cf937 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.081664 12449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8282a433fc234c42aad9a6b1fde1a50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.084187 12450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44692cdc9a94782913b2c1c403cf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.099787 12382 tablet_service.cc:1511] Processing CreateTablet for tablet 659b1001b708481eb6babdb52ee14932 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.101447 12382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b1001b708481eb6babdb52ee14932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.104460 12381 tablet_service.cc:1511] Processing CreateTablet for tablet 67f457232dbf490fb66e384f63359610 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.106003 12381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f457232dbf490fb66e384f63359610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.114485 12531 tablet_service.cc:1511] Processing CreateTablet for tablet 659b1001b708481eb6babdb52ee14932 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.116158 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b1001b708481eb6babdb52ee14932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.115875 12380 tablet_service.cc:1511] Processing CreateTablet for tablet e4f06730d1ea4198bd857096eacfb65b (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.117555 12380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f06730d1ea4198bd857096eacfb65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.121515 12379 tablet_service.cc:1511] Processing CreateTablet for tablet 13b74d76ad0d4e35a7c3b7a4b0167686 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.121732 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 67f457232dbf490fb66e384f63359610 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.123204 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f457232dbf490fb66e384f63359610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.124034 12526 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4f277c23d54d11b7d393c145245d1e (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.124351 12378 tablet_service.cc:1511] Processing CreateTablet for tablet ebccc43d996443238d52afdd0323755a (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.125631 12526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4f277c23d54d11b7d393c145245d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.126708 12377 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4f277c23d54d11b7d393c145245d1e (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.126827 12527 tablet_service.cc:1511] Processing CreateTablet for tablet ebccc43d996443238d52afdd0323755a (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.126827 12529 tablet_service.cc:1511] Processing CreateTablet for tablet e4f06730d1ea4198bd857096eacfb65b (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.129050 12376 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9ba9b18e24dd3b400e9eaf11be37d (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.129354 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 13b74d76ad0d4e35a7c3b7a4b0167686 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.131012 12527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebccc43d996443238d52afdd0323755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.131373 12375 tablet_service.cc:1511] Processing CreateTablet for tablet e44692cdc9a94782913b2c1c403cf937 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.131690 12525 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9ba9b18e24dd3b400e9eaf11be37d (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.134064 12374 tablet_service.cc:1511] Processing CreateTablet for tablet 8282a433fc234c42aad9a6b1fde1a50c (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.135092 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 8282a433fc234c42aad9a6b1fde1a50c (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.138312 12525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9ba9b18e24dd3b400e9eaf11be37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.136821 12524 tablet_service.cc:1511] Processing CreateTablet for tablet e44692cdc9a94782913b2c1c403cf937 (DEFAULT_TABLE table=test-workload [id=1aefa720ee3e455eb1baa707f485c683]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.139425 12524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44692cdc9a94782913b2c1c403cf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.140267 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b74d76ad0d4e35a7c3b7a4b0167686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.123134 12379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b74d76ad0d4e35a7c3b7a4b0167686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.141295 12378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebccc43d996443238d52afdd0323755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.141799 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8282a433fc234c42aad9a6b1fde1a50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.143836 12375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44692cdc9a94782913b2c1c403cf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.144822 12376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9ba9b18e24dd3b400e9eaf11be37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.144826 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f06730d1ea4198bd857096eacfb65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.145485 12377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4f277c23d54d11b7d393c145245d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.146268 12374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8282a433fc234c42aad9a6b1fde1a50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.252476 12582 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.266396 12582 tablet_bootstrap.cc:654] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.280107 12583 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.283747 12581 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.285233 12582 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.286557 12582 ts_tablet_manager.cc:1403] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 13:04:34.289310 12581 tablet_bootstrap.cc:654] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.290874 12582 raft_consensus.cc:359] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.291705 12582 raft_consensus.cc:385] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.292021 12582 raft_consensus.cc:740] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.292840 12582 consensus_queue.cc:260] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.293610 12583 tablet_bootstrap.cc:654] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.302305 12581 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.302743 12417 heartbeater.cc:499] Master 127.0.107.254:38963 was elected leader, sending a full tablet report...
I20260709 13:04:34.303049 12581 ts_tablet_manager.cc:1403] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:04:34.300951 12583 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.305235 12583 ts_tablet_manager.cc:1403] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 13:04:34.306339 12581 raft_consensus.cc:359] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.307032 12581 raft_consensus.cc:385] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.307281 12581 raft_consensus.cc:740] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.307902 12582 ts_tablet_manager.cc:1434] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:04:34.308032 12581 consensus_queue.cc:260] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.309360 12582 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.309820 12583 raft_consensus.cc:359] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.310722 12583 raft_consensus.cc:385] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.311199 12583 raft_consensus.cc:740] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.312284 12583 consensus_queue.cc:260] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.318017 12582 tablet_bootstrap.cc:654] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.318542 12581 ts_tablet_manager.cc:1434] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:04:34.319605 12492 heartbeater.cc:499] Master 127.0.107.254:38963 was elected leader, sending a full tablet report...
I20260709 13:04:34.322853 12583 ts_tablet_manager.cc:1434] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:04:34.324177 12566 heartbeater.cc:499] Master 127.0.107.254:38963 was elected leader, sending a full tablet report...
I20260709 13:04:34.325996 12581 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.333783 12581 tablet_bootstrap.cc:654] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.337423 12583 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.346177 12583 tablet_bootstrap.cc:654] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.348272 12582 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.348788 12581 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.348984 12582 ts_tablet_manager.cc:1403] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.010s
I20260709 13:04:34.349505 12581 ts_tablet_manager.cc:1403] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:04:34.352269 12582 raft_consensus.cc:359] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.353348 12582 raft_consensus.cc:385] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.353801 12582 raft_consensus.cc:740] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.353214 12581 raft_consensus.cc:359] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.355116 12581 raft_consensus.cc:385] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.355536 12586 raft_consensus.cc:493] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.355533 12581 raft_consensus.cc:740] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.356253 12586 raft_consensus.cc:515] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.357118 12581 consensus_queue.cc:260] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.358232 12583 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.359122 12586 leader_election.cc:290] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.354662 12582 consensus_queue.cc:260] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.361805 12582 ts_tablet_manager.cc:1434] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:34.362951 12582 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.363690 12583 ts_tablet_manager.cc:1403] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:04:34.368920 12582 tablet_bootstrap.cc:654] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.378422 12583 raft_consensus.cc:359] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.380867 12583 raft_consensus.cc:385] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.381408 12583 raft_consensus.cc:740] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.382268 12583 consensus_queue.cc:260] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.384989 12583 ts_tablet_manager.cc:1434] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:04:34.379369 12581 ts_tablet_manager.cc:1434] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:04:34.386545 12581 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.388103 12588 raft_consensus.cc:493] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.388725 12588 raft_consensus.cc:515] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.402704 12581 tablet_bootstrap.cc:654] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.412665 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:34.415055 12355 leader_election.cc:343] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.414880 12588 leader_election.cc:290] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.416980 12583 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.421689 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.422534 12541 raft_consensus.cc:2468] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:34.423110 12582 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.423785 12582 ts_tablet_manager.cc:1403] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.012s
I20260709 13:04:34.425267 12583 tablet_bootstrap.cc:654] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.429481 12582 raft_consensus.cc:359] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.430416 12582 raft_consensus.cc:385] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.430760 12356 leader_election.cc:304] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.431077 12589 raft_consensus.cc:493] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.431802 12589 raft_consensus.cc:515] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.432431 12586 raft_consensus.cc:2804] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.432930 12586 raft_consensus.cc:493] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.433315 12586 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.442808 12586 raft_consensus.cc:515] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.430764 12582 raft_consensus.cc:740] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.445333 12582 consensus_queue.cc:260] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.448822 12589 leader_election.cc:290] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.452752 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.453608 12392 raft_consensus.cc:2468] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:34.454242 12586 leader_election.cc:290] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.456102 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:34.457052 12541 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.459084 12582 ts_tablet_manager.cc:1434] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.001s
I20260709 13:04:34.460492 12582 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.461469 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
W20260709 13:04:34.463195 12355 leader_election.cc:343] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.468667 12602 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.469281 12602 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.473500 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:34.475296 12355 leader_election.cc:343] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.478034 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
W20260709 13:04:34.479710 12356 leader_election.cc:343] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.479949 12431 leader_election.cc:304] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.480191 12356 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b; no voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.481101 12588 raft_consensus.cc:2804] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.481154 12586 raft_consensus.cc:2749] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.481667 12588 raft_consensus.cc:493] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.481870 12602 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.482138 12588 raft_consensus.cc:3060] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.486686 12541 raft_consensus.cc:2468] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:34.487996 12356 leader_election.cc:304] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.489132 12602 raft_consensus.cc:2804] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.489792 12602 raft_consensus.cc:697] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:34.490628 12602 consensus_queue.cc:237] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.493579 12588 raft_consensus.cc:515] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.510177 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:34.510877 12392 raft_consensus.cc:3060] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.511073 12588 leader_election.cc:290] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.503275 12582 tablet_bootstrap.cc:654] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.506546 12581 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.507638 12583 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.512440 12581 ts_tablet_manager.cc:1403] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.126s	user 0.026s	sys 0.052s
I20260709 13:04:34.512467 12583 ts_tablet_manager.cc:1403] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.096s	user 0.039s	sys 0.041s
I20260709 13:04:34.513259 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
W20260709 13:04:34.514776 12431 leader_election.cc:343] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.507455 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.515964 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
W20260709 13:04:34.516674 12431 leader_election.cc:343] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:34.518332 12505 leader_election.cc:343] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.518607 12581 raft_consensus.cc:359] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.518831 12583 raft_consensus.cc:359] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.519994 12581 raft_consensus.cc:385] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.520296 12583 raft_consensus.cc:385] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.520368 12581 raft_consensus.cc:740] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.520766 12583 raft_consensus.cc:740] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.522099 12392 raft_consensus.cc:2468] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
W20260709 13:04:34.524295 12338 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:34.521690 12583 consensus_queue.cc:260] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.521704 12581 consensus_queue.cc:260] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.528954 12581 ts_tablet_manager.cc:1434] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:04:34.528414 12290 catalog_manager.cc:5697] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.530208 12581 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.527020 12583 ts_tablet_manager.cc:1434] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:34.534066 12583 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.538618 12581 tablet_bootstrap.cc:654] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.541117 12431 leader_election.cc:304] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:34.542004 12583 tablet_bootstrap.cc:654] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.544162 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:34.553908 12504 leader_election.cc:343] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.554620 12504 leader_election.cc:304] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5; no voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.556252 12589 raft_consensus.cc:2749] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.550827 12588 raft_consensus.cc:2804] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.569799 12588 raft_consensus.cc:697] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:34.575474 12588 consensus_queue.cc:237] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.578116 12582 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.578887 12582 ts_tablet_manager.cc:1403] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.012s
I20260709 13:04:34.579325 12581 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.579928 12581 ts_tablet_manager.cc:1403] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.023s
I20260709 13:04:34.582289 12582 raft_consensus.cc:359] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.582751 12581 raft_consensus.cc:359] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.583213 12582 raft_consensus.cc:385] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.583479 12581 raft_consensus.cc:385] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.583666 12582 raft_consensus.cc:740] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.583853 12583 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.584132 12581 raft_consensus.cc:740] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.584635 12583 ts_tablet_manager.cc:1403] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.013s
I20260709 13:04:34.585004 12581 consensus_queue.cc:260] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.587489 12581 ts_tablet_manager.cc:1434] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:34.588042 12583 raft_consensus.cc:359] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.588632 12581 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.588982 12583 raft_consensus.cc:385] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.589382 12583 raft_consensus.cc:740] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.590757 12583 consensus_queue.cc:260] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.593631 12583 ts_tablet_manager.cc:1434] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:34.593427 12290 catalog_manager.cc:5697] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 0 to 1, leader changed from <none> to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.595223 12583 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.595774 12581 tablet_bootstrap.cc:654] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.596935 12582 consensus_queue.cc:260] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.599838 12582 ts_tablet_manager.cc:1434] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:04:34.601181 12582 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.603559 12583 tablet_bootstrap.cc:654] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.608532 12582 tablet_bootstrap.cc:654] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.618295 12583 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.618933 12583 ts_tablet_manager.cc:1403] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.024s	user 0.002s	sys 0.013s
I20260709 13:04:34.620960 12582 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.621624 12582 ts_tablet_manager.cc:1403] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:04:34.622376 12583 raft_consensus.cc:359] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.623366 12583 raft_consensus.cc:385] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.623701 12583 raft_consensus.cc:740] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.623798 12581 tablet_bootstrap.cc:492] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.624536 12581 ts_tablet_manager.cc:1403] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 13:04:34.624809 12583 consensus_queue.cc:260] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.625209 12582 raft_consensus.cc:359] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.625984 12582 raft_consensus.cc:385] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.626302 12582 raft_consensus.cc:740] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.627246 12582 consensus_queue.cc:260] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.627518 12583 ts_tablet_manager.cc:1434] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 13:04:34.627481 12581 raft_consensus.cc:359] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.628502 12581 raft_consensus.cc:385] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.628823 12581 raft_consensus.cc:740] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.628949 12583 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.629705 12581 consensus_queue.cc:260] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.632449 12581 ts_tablet_manager.cc:1434] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:34.635102 12581 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.637017 12583 tablet_bootstrap.cc:654] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.637682 12582 ts_tablet_manager.cc:1434] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:04:34.642467 12581 tablet_bootstrap.cc:654] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.644459 12582 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.649623 12583 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.650369 12583 ts_tablet_manager.cc:1403] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:04:34.653257 12582 tablet_bootstrap.cc:654] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.654085 12583 raft_consensus.cc:359] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.655009 12583 raft_consensus.cc:385] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.655355 12583 raft_consensus.cc:740] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.656355 12583 consensus_queue.cc:260] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.659449 12583 ts_tablet_manager.cc:1434] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:34.661196 12583 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.662528 12582 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.662971 12581 tablet_bootstrap.cc:492] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.663117 12582 ts_tablet_manager.cc:1403] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:04:34.663542 12581 ts_tablet_manager.cc:1403] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:04:34.666457 12581 raft_consensus.cc:359] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.666456 12582 raft_consensus.cc:359] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.667325 12581 raft_consensus.cc:385] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.667372 12582 raft_consensus.cc:385] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.667824 12582 raft_consensus.cc:740] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.667779 12583 tablet_bootstrap.cc:654] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.667788 12581 raft_consensus.cc:740] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.668897 12582 consensus_queue.cc:260] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.669153 12581 consensus_queue.cc:260] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.671646 12581 ts_tablet_manager.cc:1434] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:34.672708 12581 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.675644 12602 raft_consensus.cc:493] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.676210 12582 ts_tablet_manager.cc:1434] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:04:34.676189 12602 raft_consensus.cc:515] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.677522 12582 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.678560 12602 leader_election.cc:290] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.681876 12581 tablet_bootstrap.cc:654] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.683027 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:34.684675 12355 leader_election.cc:343] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.685868 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.686636 12541 raft_consensus.cc:2468] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:34.688160 12356 leader_election.cc:304] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.688462 12581 tablet_bootstrap.cc:492] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.689327 12581 ts_tablet_manager.cc:1403] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:04:34.689502 12602 raft_consensus.cc:2804] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.690006 12602 raft_consensus.cc:493] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.690361 12602 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.690757 12589 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.691344 12589 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.691965 12582 tablet_bootstrap.cc:654] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.693454 12581 raft_consensus.cc:359] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.694473 12581 raft_consensus.cc:385] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.695025 12581 raft_consensus.cc:740] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.696144 12581 consensus_queue.cc:260] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.697619 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.698415 12392 raft_consensus.cc:2468] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:34.699927 12602 raft_consensus.cc:515] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.702127 12581 ts_tablet_manager.cc:1434] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:34.703871 12581 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:34.703856 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:34.704798 12466 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.699836 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:34.693609 12589 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.702442 12505 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
W20260709 13:04:34.710467 12504 leader_election.cc:343] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.713198 12581 tablet_bootstrap.cc:654] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.713685 12589 raft_consensus.cc:2804] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.714222 12589 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.714357 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:34.714691 12589 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.715191 12541 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.722337 12583 tablet_bootstrap.cc:492] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.722961 12583 ts_tablet_manager.cc:1403] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.001s
I20260709 13:04:34.726212 12583 raft_consensus.cc:359] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.726958 12583 raft_consensus.cc:385] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.727243 12583 raft_consensus.cc:740] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.727710 12589 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.730427 12541 raft_consensus.cc:2468] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:34.731031 12602 leader_election.cc:290] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.730935 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:34.735144 12392 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.735816 12356 leader_election.cc:304] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:34.731784 12583 consensus_queue.cc:260] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.736780 12602 raft_consensus.cc:2804] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.738070 12581 tablet_bootstrap.cc:492] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.733350 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:34.738194 12602 raft_consensus.cc:697] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:34.738803 12581 ts_tablet_manager.cc:1403] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.014s
I20260709 13:04:34.739135 12582 tablet_bootstrap.cc:492] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.739651 12582 ts_tablet_manager.cc:1403] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.062s	user 0.036s	sys 0.014s
I20260709 13:04:34.739440 12602 consensus_queue.cc:237] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.733783 12466 raft_consensus.cc:2468] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:34.742055 12581 raft_consensus.cc:359] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.742853 12581 raft_consensus.cc:385] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.742699 12582 raft_consensus.cc:359] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.743232 12581 raft_consensus.cc:740] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.743508 12582 raft_consensus.cc:385] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.743846 12582 raft_consensus.cc:740] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.744343 12581 consensus_queue.cc:260] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.744608 12582 consensus_queue.cc:260] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.745446 12392 raft_consensus.cc:2468] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:34.747074 12582 ts_tablet_manager.cc:1434] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:34.747269 12581 ts_tablet_manager.cc:1434] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:34.734078 12589 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.748404 12582 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.748404 12581 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
W20260709 13:04:34.739979 12504 leader_election.cc:343] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.754974 12505 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.755774 12583 ts_tablet_manager.cc:1434] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:04:34.756247 12622 raft_consensus.cc:2804] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.755456 12581 tablet_bootstrap.cc:654] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.757048 12583 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.759989 12582 tablet_bootstrap.cc:654] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.757050 12622 raft_consensus.cc:697] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:34.761162 12622 consensus_queue.cc:237] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.768203 12589 raft_consensus.cc:493] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.768723 12589 raft_consensus.cc:515] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.771047 12589 leader_election.cc:290] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.773088 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.774009 12392 raft_consensus.cc:2393] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0d2fe5f6fd0439592482c881fb7bca5 in current term 1: Already voted for candidate f136be7f233943ddbb244c5daa113417 in this term.
I20260709 13:04:34.777331 12290 catalog_manager.cc:5697] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.778575 12588 raft_consensus.cc:493] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.779479 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9ba9b18e24dd3b400e9eaf11be37d" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:34.780577 12609 raft_consensus.cc:493] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.781231 12504 leader_election.cc:304] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5; no voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417
I20260709 13:04:34.779476 12588 raft_consensus.cc:515] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.781215 12609 raft_consensus.cc:515] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.783893 12588 leader_election.cc:290] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.784896 12609 leader_election.cc:290] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065), 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435)
I20260709 13:04:34.785754 12589 raft_consensus.cc:3060] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.787288 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.788164 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
W20260709 13:04:34.789999 12431 leader_election.cc:343] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.790971 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.787662 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
W20260709 13:04:34.792043 12431 leader_election.cc:343] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.792677 12431 leader_election.cc:304] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5
W20260709 13:04:34.794912 12431 leader_election.cc:343] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.795466 12609 raft_consensus.cc:2749] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.797314 12589 raft_consensus.cc:2749] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.798841 12581 tablet_bootstrap.cc:492] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:34.799263 12583 tablet_bootstrap.cc:654] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.799517 12581 ts_tablet_manager.cc:1403] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.028s
I20260709 13:04:34.800624 12582 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.801295 12582 ts_tablet_manager.cc:1403] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.020s
I20260709 13:04:34.804039 12581 raft_consensus.cc:359] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.804936 12581 raft_consensus.cc:385] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.805224 12581 raft_consensus.cc:740] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.806149 12581 consensus_queue.cc:260] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.808405 12581 ts_tablet_manager.cc:1434] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
W20260709 13:04:34.817152 12431 leader_election.cc:343] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.817698 12431 leader_election.cc:304] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:34.819070 12609 raft_consensus.cc:2749] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.820477 12626 raft_consensus.cc:493] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.821586 12626 raft_consensus.cc:515] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.821983 12582 raft_consensus.cc:359] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.822928 12582 raft_consensus.cc:385] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.823366 12582 raft_consensus.cc:740] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.824386 12582 consensus_queue.cc:260] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.826678 12582 ts_tablet_manager.cc:1434] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:04:34.827651 12582 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:34.828435 12583 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.828998 12583 ts_tablet_manager.cc:1403] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.014s
I20260709 13:04:34.834354 12626 leader_election.cc:290] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.836161 12609 raft_consensus.cc:493] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.836750 12609 raft_consensus.cc:515] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.836951 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8282a433fc234c42aad9a6b1fde1a50c" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:34.837711 12466 raft_consensus.cc:2468] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:34.839084 12609 leader_election.cc:290] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.835986 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8282a433fc234c42aad9a6b1fde1a50c" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.839478 12504 leader_election.cc:304] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.840849 12622 raft_consensus.cc:2804] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.841249 12622 raft_consensus.cc:493] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.841578 12622 raft_consensus.cc:3060] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.841650 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.842121 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.842392 12541 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:34.842893 12391 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:34.844189 12431 leader_election.cc:304] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.839895 12392 raft_consensus.cc:2468] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:34.843847 12287 catalog_manager.cc:5697] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.845427 12609 raft_consensus.cc:2804] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.845933 12609 raft_consensus.cc:493] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.846747 12609 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.854559 12622 raft_consensus.cc:515] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.855796 12609 raft_consensus.cc:515] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.857384 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8282a433fc234c42aad9a6b1fde1a50c" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:34.857968 12392 raft_consensus.cc:3060] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.858004 12583 raft_consensus.cc:359] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.858767 12583 raft_consensus.cc:385] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.858978 12583 raft_consensus.cc:740] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.859576 12583 consensus_queue.cc:260] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.861884 12582 tablet_bootstrap.cc:654] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.863960 12583 ts_tablet_manager.cc:1434] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 13:04:34.864573 12392 raft_consensus.cc:2468] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:34.865239 12583 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:34.865916 12505 leader_election.cc:304] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:34.866765 12626 raft_consensus.cc:2804] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.867020 12609 leader_election.cc:290] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.867259 12626 raft_consensus.cc:697] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:34.867534 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:34.868532 12626 consensus_queue.cc:237] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.869223 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:34.869835 12541 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.868170 12391 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.869920 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8282a433fc234c42aad9a6b1fde1a50c" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:34.870764 12466 raft_consensus.cc:3060] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.879825 12466 raft_consensus.cc:2468] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:34.881526 12622 leader_election.cc:290] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.887359 12391 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
I20260709 13:04:34.887647 12583 tablet_bootstrap.cc:654] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.888995 12431 leader_election.cc:304] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.890050 12609 raft_consensus.cc:2804] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.890568 12609 raft_consensus.cc:697] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:34.891466 12609 consensus_queue.cc:237] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.893462 12588 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.894114 12588 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.896489 12588 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.898944 12390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.899356 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.900341 12390 raft_consensus.cc:2393] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f136be7f233943ddbb244c5daa113417 in current term 1: Already voted for candidate e0d2fe5f6fd0439592482c881fb7bca5 in this term.
I20260709 13:04:34.900813 12541 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
I20260709 13:04:34.904817 12431 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:34.905577 12609 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.906008 12582 tablet_bootstrap.cc:492] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:34.906589 12582 ts_tablet_manager.cc:1403] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.015s
I20260709 13:04:34.906144 12287 catalog_manager.cc:5697] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 0 to 1, leader changed from <none> to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.908712 12583 tablet_bootstrap.cc:492] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:34.909435 12583 ts_tablet_manager.cc:1403] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.010s
I20260709 13:04:34.910125 12582 raft_consensus.cc:359] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.915046 12609 raft_consensus.cc:2749] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.914904 12583 raft_consensus.cc:359] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.915767 12583 raft_consensus.cc:385] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.916051 12583 raft_consensus.cc:740] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.916760 12583 consensus_queue.cc:260] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.910883 12582 raft_consensus.cc:385] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.918648 12582 raft_consensus.cc:740] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.919234 12583 ts_tablet_manager.cc:1434] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:34.919461 12582 consensus_queue.cc:260] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.919445 12290 catalog_manager.cc:5697] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.921559 12582 ts_tablet_manager.cc:1434] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:34.952625 12626 raft_consensus.cc:493] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.953230 12626 raft_consensus.cc:515] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.955425 12626 leader_election.cc:290] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.956431 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:34.956662 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:34.957206 12391 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:34.957474 12466 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:34.958451 12609 consensus_queue.cc:1048] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.958506 12505 leader_election.cc:304] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:34.959663 12626 raft_consensus.cc:2804] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.959992 12626 raft_consensus.cc:493] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.960371 12626 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.967281 12626 raft_consensus.cc:515] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.969620 12626 leader_election.cc:290] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:34.970953 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:34.971136 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:34.971608 12392 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.971767 12466 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.972718 12588 consensus_queue.cc:1048] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.980216 12466 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:34.981561 12504 leader_election.cc:304] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.982496 12626 raft_consensus.cc:2804] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.983069 12626 raft_consensus.cc:697] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:34.980479 12392 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:34.983901 12626 consensus_queue.cc:237] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:34.988104 12602 raft_consensus.cc:493] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.988837 12602 raft_consensus.cc:515] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:34.991019 12602 leader_election.cc:290] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:34.991961 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:34.992228 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:34.992762 12466 raft_consensus.cc:2468] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:34.992974 12541 raft_consensus.cc:2468] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:34.993888 12355 leader_election.cc:304] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:34.994755 12602 raft_consensus.cc:2804] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.995092 12602 raft_consensus.cc:493] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.995375 12602 raft_consensus.cc:3060] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.998844 12287 catalog_manager.cc:5697] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.002447 12602 raft_consensus.cc:515] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.006139 12626 raft_consensus.cc:493] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.006850 12602 leader_election.cc:290] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:35.006928 12626 raft_consensus.cc:515] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.008908 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:35.009302 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f06730d1ea4198bd857096eacfb65b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.009651 12466 raft_consensus.cc:3060] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.009954 12541 raft_consensus.cc:3060] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.011209 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:35.011978 12392 raft_consensus.cc:2468] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:35.013248 12505 leader_election.cc:304] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:35.014199 12622 raft_consensus.cc:2804] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.014595 12622 raft_consensus.cc:493] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.014978 12622 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.016191 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:35.016993 12467 raft_consensus.cc:2468] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:35.018357 12626 leader_election.cc:290] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:35.018239 12541 raft_consensus.cc:2468] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:35.018203 12466 raft_consensus.cc:2468] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:35.020408 12356 leader_election.cc:304] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:35.021360 12602 raft_consensus.cc:2804] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.021763 12602 raft_consensus.cc:697] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:35.022043 12622 raft_consensus.cc:515] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.022480 12602 consensus_queue.cc:237] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.023847 12622 leader_election.cc:290] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:35.024943 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:35.025573 12392 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.025105 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:35.026479 12466 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.031035 12287 catalog_manager.cc:5697] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.031915 12466 raft_consensus.cc:2468] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:35.032639 12392 raft_consensus.cc:2468] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:35.032990 12504 leader_election.cc:304] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:35.034044 12622 raft_consensus.cc:2804] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.034721 12622 raft_consensus.cc:697] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:35.035539 12622 consensus_queue.cc:237] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.044525 12287 catalog_manager.cc:5697] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.045495 12466 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.053354 12602 consensus_queue.cc:1048] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.065112 12586 consensus_queue.cc:1048] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.105837 12541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "659b1001b708481eb6babdb52ee14932"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
mode: GRACEFUL
new_leader_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:59380
I20260709 13:04:35.106372 12541 raft_consensus.cc:606] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Received request to transfer leadership to TS 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:35.119279 12466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f457232dbf490fb66e384f63359610"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
mode: GRACEFUL
new_leader_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:43662
I20260709 13:04:35.119792 12466 raft_consensus.cc:606] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Received request to transfer leadership to TS 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:35.137209 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebccc43d996443238d52afdd0323755a"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
mode: GRACEFUL
new_leader_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:35.137708 12392 raft_consensus.cc:606] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Received request to transfer leadership to TS f136be7f233943ddbb244c5daa113417
I20260709 13:04:35.143188 12541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
mode: GRACEFUL
new_leader_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:59380
I20260709 13:04:35.143772 12541 raft_consensus.cc:606] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Received request to transfer leadership to TS f136be7f233943ddbb244c5daa113417
I20260709 13:04:35.151337 12541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
mode: GRACEFUL
new_leader_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:59380
I20260709 13:04:35.151922 12541 raft_consensus.cc:606] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Received request to transfer leadership to TS f136be7f233943ddbb244c5daa113417
I20260709 13:04:35.207656 12622 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.215194 12589 raft_consensus.cc:993] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: : Instructing follower f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.215777 12626 raft_consensus.cc:1081] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Signalling peer f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.217867 12467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:04:35.218926 12467 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.219472 12467 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.222349 12626 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.229306 12467 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.232631 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:35.235800 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.236485 12541 raft_consensus.cc:3055] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.236799 12541 raft_consensus.cc:740] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:35.237707 12541 consensus_queue.cc:260] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.238691 12541 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.240511 12467 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:35.243906 12586 consensus_queue.cc:1048] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.248095 12541 raft_consensus.cc:2468] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:35.249531 12431 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:35.250339 12588 raft_consensus.cc:2804] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.250895 12588 raft_consensus.cc:697] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:35.251653 12588 consensus_queue.cc:237] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.262297 12586 consensus_queue.cc:1048] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.261893 12290 catalog_manager.cc:5697] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 1 to 2, leader changed from e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195) to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.299901 12626 consensus_queue.cc:1048] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.312170 12589 consensus_queue.cc:1048] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.374632 12622 consensus_queue.cc:1048] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.377192 12622 consensus_queue.cc:1048] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.386432 12626 raft_consensus.cc:993] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: : Instructing follower 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:35.387754 12626 raft_consensus.cc:1081] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Signalling peer 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:35.390830 12391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "659b1001b708481eb6babdb52ee14932"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:52034
I20260709 13:04:35.391438 12391 raft_consensus.cc:493] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.391849 12391 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.399770 12391 raft_consensus.cc:515] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:35.402096 12391 leader_election.cc:290] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Requested vote from peers e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:35.402366 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.402783 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b1001b708481eb6babdb52ee14932" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:35.402980 12540 raft_consensus.cc:3055] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.403378 12467 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.403401 12540 raft_consensus.cc:740] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:35.404335 12540 consensus_queue.cc:260] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:35.405578 12540 raft_consensus.cc:3060] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.409296 12588 consensus_queue.cc:1048] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.410806 12467 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:35.412566 12540 raft_consensus.cc:2468] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:35.412787 12355 leader_election.cc:304] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:35.413661 12586 raft_consensus.cc:2804] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.414076 12586 raft_consensus.cc:697] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:35.414808 12586 consensus_queue.cc:237] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } }
I20260709 13:04:35.417798 12609 raft_consensus.cc:993] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: : Instructing follower 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:35.418515 12588 raft_consensus.cc:1081] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Signalling peer 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:35.420605 12392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f457232dbf490fb66e384f63359610"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:52026
I20260709 13:04:35.423107 12392 raft_consensus.cc:493] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.423568 12392 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.423944 12588 consensus_queue.cc:1048] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.431025 12392 raft_consensus.cc:515] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.436482 12392 leader_election.cc:290] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:35.438495 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.438601 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f457232dbf490fb66e384f63359610" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:35.439181 12540 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.439278 12467 raft_consensus.cc:3055] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.439779 12467 raft_consensus.cc:740] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:35.440575 12467 consensus_queue.cc:260] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.441788 12467 raft_consensus.cc:3060] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.447467 12540 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:35.446626 12288 catalog_manager.cc:5697] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 1 to 2, leader changed from e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195) to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.447871 12467 raft_consensus.cc:2468] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:35.448884 12356 leader_election.cc:304] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:35.450925 12586 raft_consensus.cc:2804] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.451423 12586 raft_consensus.cc:697] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:35.452248 12586 consensus_queue.cc:237] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.456637 12642 consensus_queue.cc:1048] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.458364 12589 consensus_queue.cc:1048] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.474524 12589 consensus_queue.cc:1048] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.478412 12288 catalog_manager.cc:5697] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 1 to 2, leader changed from f136be7f233943ddbb244c5daa113417 (127.0.107.194) to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.487076 12602 consensus_queue.cc:1048] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.490681 12626 raft_consensus.cc:993] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: : Instructing follower f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.491297 12626 raft_consensus.cc:1081] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Signalling peer f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.493623 12466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:04:35.494858 12466 raft_consensus.cc:493] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.495282 12466 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.504576 12466 raft_consensus.cc:515] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.507584 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:35.511418 12466 leader_election.cc:290] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:35.511991 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44692cdc9a94782913b2c1c403cf937" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.512693 12541 raft_consensus.cc:3055] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.513025 12541 raft_consensus.cc:740] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:35.513825 12541 consensus_queue.cc:260] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.514761 12541 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.522810 12541 raft_consensus.cc:2468] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:35.525121 12431 leader_election.cc:304] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:35.525910 12588 raft_consensus.cc:2804] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.526767 12588 raft_consensus.cc:697] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:35.527663 12588 consensus_queue.cc:237] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.535791 12288 catalog_manager.cc:5697] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 1 to 2, leader changed from e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195) to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.657059 12602 raft_consensus.cc:993] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: : Instructing follower f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.657529 12642 raft_consensus.cc:1081] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Signalling peer f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:35.659042 12466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebccc43d996443238d52afdd0323755a"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:43640
I20260709 13:04:35.659495 12466 raft_consensus.cc:493] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.659758 12466 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.664834 12466 raft_consensus.cc:515] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.666436 12466 leader_election.cc:290] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:35.667291 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:35.667531 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebccc43d996443238d52afdd0323755a" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:35.668062 12391 raft_consensus.cc:3055] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.668128 12541 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.668535 12391 raft_consensus.cc:740] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:35.669368 12391 consensus_queue.cc:260] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.670634 12391 raft_consensus.cc:3060] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.675297 12541 raft_consensus.cc:2468] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:35.676652 12431 leader_election.cc:304] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:35.677143 12391 raft_consensus.cc:2468] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:35.677361 12588 raft_consensus.cc:2804] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.677870 12588 raft_consensus.cc:697] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:35.678653 12588 consensus_queue.cc:237] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:35.685030 12288 catalog_manager.cc:5697] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 1 to 2, leader changed from 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193) to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.686991 12391 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.692842 12391 raft_consensus.cc:1275] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.694213 12588 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.701896 12541 raft_consensus.cc:1275] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.703750 12609 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.879182 12541 raft_consensus.cc:1275] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.880584 12642 consensus_queue.cc:1048] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.889050 12466 raft_consensus.cc:1275] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.890693 12602 consensus_queue.cc:1048] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.926254 12466 raft_consensus.cc:1275] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.927814 12602 consensus_queue.cc:1048] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.937183 12541 raft_consensus.cc:1275] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.939155 12642 consensus_queue.cc:1048] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.964694 12391 raft_consensus.cc:3060] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.969887 12391 raft_consensus.cc:1275] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.971232 12609 consensus_queue.cc:1048] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.979509 12541 raft_consensus.cc:1275] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.981583 12588 consensus_queue.cc:1048] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.213312 12541 raft_consensus.cc:1275] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.214663 12588 consensus_queue.cc:1048] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.222828 12391 raft_consensus.cc:1275] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.225160 12657 consensus_queue.cc:1048] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.180668 12288 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53880:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:38.183851 12288 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:38.239779 12380 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d914359c848c8bfa65ec73e5c6d0b (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:38.241026 12452 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d914359c848c8bfa65ec73e5c6d0b (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:38.241096 12380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d914359c848c8bfa65ec73e5c6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.242432 12452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d914359c848c8bfa65ec73e5c6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.245976 12531 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d914359c848c8bfa65ec73e5c6d0b (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:38.247834 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d914359c848c8bfa65ec73e5c6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.249187 12450 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb0334c49a64982bb8e7e8012f3d2bd (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:38.250631 12450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb0334c49a64982bb8e7e8012f3d2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.252481 12381 tablet_service.cc:1511] Processing CreateTablet for tablet c4dca27bf6224160ba27d407ea1d20ba (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:38.253315 12382 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb0334c49a64982bb8e7e8012f3d2bd (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:38.253985 12381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dca27bf6224160ba27d407ea1d20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.256474 12382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb0334c49a64982bb8e7e8012f3d2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.256843 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb0334c49a64982bb8e7e8012f3d2bd (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:38.258472 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb0334c49a64982bb8e7e8012f3d2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.259099 12529 tablet_service.cc:1511] Processing CreateTablet for tablet c4dca27bf6224160ba27d407ea1d20ba (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:38.260648 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dca27bf6224160ba27d407ea1d20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.261606 12454 tablet_service.cc:1511] Processing CreateTablet for tablet c4dca27bf6224160ba27d407ea1d20ba (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:38.263151 12454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dca27bf6224160ba27d407ea1d20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.267215 12451 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab642d504da4abb8b61a7228f068023 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:38.269027 12451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab642d504da4abb8b61a7228f068023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.273347 12449 tablet_service.cc:1511] Processing CreateTablet for tablet 6094a1680fae4dda92e51818bff11c62 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:38.274684 12449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6094a1680fae4dda92e51818bff11c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.277590 12453 tablet_service.cc:1511] Processing CreateTablet for tablet aa524d31b65740f2a7ffbefe4378e017 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:38.278896 12453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa524d31b65740f2a7ffbefe4378e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.281268 12456 tablet_service.cc:1511] Processing CreateTablet for tablet b2d4386e4347499b96d944de923000e9 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:38.282554 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d4386e4347499b96d944de923000e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.285305 12457 tablet_service.cc:1511] Processing CreateTablet for tablet eba31db3d899450aabc23cb49e47b745 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:38.286780 12457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba31db3d899450aabc23cb49e47b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.290895 12374 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab642d504da4abb8b61a7228f068023 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:38.292275 12374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab642d504da4abb8b61a7228f068023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.285305 12455 tablet_service.cc:1511] Processing CreateTablet for tablet dd0a01ec67624b9e88449d8d99be02ed (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:38.297803 12455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0a01ec67624b9e88449d8d99be02ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.299546 12375 tablet_service.cc:1511] Processing CreateTablet for tablet 6094a1680fae4dda92e51818bff11c62 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:38.300912 12375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6094a1680fae4dda92e51818bff11c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.301311 12525 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab642d504da4abb8b61a7228f068023 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:38.302814 12525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab642d504da4abb8b61a7228f068023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.306859 12524 tablet_service.cc:1511] Processing CreateTablet for tablet 6094a1680fae4dda92e51818bff11c62 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:38.313560 12524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6094a1680fae4dda92e51818bff11c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.309602 12523 tablet_service.cc:1511] Processing CreateTablet for tablet aa524d31b65740f2a7ffbefe4378e017 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:38.315083 12379 tablet_service.cc:1511] Processing CreateTablet for tablet b2d4386e4347499b96d944de923000e9 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:38.309880 12376 tablet_service.cc:1511] Processing CreateTablet for tablet aa524d31b65740f2a7ffbefe4378e017 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:38.316359 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa524d31b65740f2a7ffbefe4378e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.316591 12379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d4386e4347499b96d944de923000e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.323120 12378 tablet_service.cc:1511] Processing CreateTablet for tablet eba31db3d899450aabc23cb49e47b745 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:38.326249 12530 tablet_service.cc:1511] Processing CreateTablet for tablet b2d4386e4347499b96d944de923000e9 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:38.329180 12378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba31db3d899450aabc23cb49e47b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.331358 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d4386e4347499b96d944de923000e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.336807 12376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa524d31b65740f2a7ffbefe4378e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.375809 12526 tablet_service.cc:1511] Processing CreateTablet for tablet eba31db3d899450aabc23cb49e47b745 (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:38.376421 12377 tablet_service.cc:1511] Processing CreateTablet for tablet dd0a01ec67624b9e88449d8d99be02ed (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:38.376904 12527 tablet_service.cc:1511] Processing CreateTablet for tablet dd0a01ec67624b9e88449d8d99be02ed (DEFAULT_TABLE table=soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:38.377414 12526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba31db3d899450aabc23cb49e47b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.378237 12527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0a01ec67624b9e88449d8d99be02ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.378176 12377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0a01ec67624b9e88449d8d99be02ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.409425 12678 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:38.423121 12677 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.456416 12678 tablet_bootstrap.cc:654] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.470455 12679 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.472704 12677 tablet_bootstrap.cc:654] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.479295 12679 tablet_bootstrap.cc:654] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.486552 12678 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.487232 12678 ts_tablet_manager.cc:1403] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.010s
I20260709 13:04:38.490931 12678 raft_consensus.cc:359] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.491879 12678 raft_consensus.cc:385] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.492237 12678 raft_consensus.cc:740] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.493338 12678 consensus_queue.cc:260] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.495954 12678 ts_tablet_manager.cc:1434] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:38.497182 12678 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:38.504297 12678 tablet_bootstrap.cc:654] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.514278 12677 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.514935 12677 ts_tablet_manager.cc:1403] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.092s	user 0.023s	sys 0.023s
I20260709 13:04:38.518019 12677 raft_consensus.cc:359] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.518703 12677 raft_consensus.cc:385] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.518988 12677 raft_consensus.cc:740] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.519284 12678 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.519299 12679 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:38.520033 12679 ts_tablet_manager.cc:1403] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.004s
I20260709 13:04:38.520038 12678 ts_tablet_manager.cc:1403] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:04:38.519829 12677 consensus_queue.cc:260] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.522306 12677 ts_tablet_manager.cc:1434] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:38.523862 12678 raft_consensus.cc:359] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.523902 12677 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.524770 12678 raft_consensus.cc:385] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.525286 12678 raft_consensus.cc:740] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.526288 12678 consensus_queue.cc:260] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.526855 12679 raft_consensus.cc:359] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.527810 12679 raft_consensus.cc:385] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.528148 12679 raft_consensus.cc:740] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.529124 12678 ts_tablet_manager.cc:1434] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:38.530366 12678 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:38.529737 12679 consensus_queue.cc:260] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.533388 12677 tablet_bootstrap.cc:654] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.533584 12679 ts_tablet_manager.cc:1434] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:04:38.538566 12678 tablet_bootstrap.cc:654] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.539222 12679 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.550294 12679 tablet_bootstrap.cc:654] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.551380 12678 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.552016 12678 ts_tablet_manager.cc:1403] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.014s
I20260709 13:04:38.555326 12678 raft_consensus.cc:359] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.556495 12678 raft_consensus.cc:385] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.556846 12678 raft_consensus.cc:740] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.557672 12678 consensus_queue.cc:260] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.560297 12678 ts_tablet_manager.cc:1434] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:38.561578 12678 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:38.562151 12642 raft_consensus.cc:493] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.562973 12642 raft_consensus.cc:515] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.567148 12642 leader_election.cc:290] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.567276 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:38.569602 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:38.569941 12356 leader_election.cc:343] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.571316 12679 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
W20260709 13:04:38.571403 12355 leader_election.cc:343] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.572000 12679 ts_tablet_manager.cc:1403] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:04:38.571956 12355 leader_election.cc:304] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b; no voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417
I20260709 13:04:38.573232 12642 raft_consensus.cc:2749] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.575430 12679 raft_consensus.cc:359] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.576284 12679 raft_consensus.cc:385] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.576592 12678 tablet_bootstrap.cc:654] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.576627 12679 raft_consensus.cc:740] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.577845 12679 consensus_queue.cc:260] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.578405 12677 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.579192 12677 ts_tablet_manager.cc:1403] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.027s
I20260709 13:04:38.580662 12679 ts_tablet_manager.cc:1434] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:04:38.581866 12679 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.583122 12677 raft_consensus.cc:359] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.584131 12677 raft_consensus.cc:385] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.584528 12677 raft_consensus.cc:740] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.585485 12677 consensus_queue.cc:260] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.588366 12677 ts_tablet_manager.cc:1434] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:38.589375 12679 tablet_bootstrap.cc:654] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.589721 12677 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.598810 12677 tablet_bootstrap.cc:654] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:38.607254 12338 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:38.617493 12677 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.618440 12677 ts_tablet_manager.cc:1403] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 13:04:38.622290 12677 raft_consensus.cc:359] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.623441 12677 raft_consensus.cc:385] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.623970 12677 raft_consensus.cc:740] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.625048 12677 consensus_queue.cc:260] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.627912 12677 ts_tablet_manager.cc:1434] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:38.629232 12677 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.636842 12677 tablet_bootstrap.cc:654] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.649945 12677 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.650712 12677 ts_tablet_manager.cc:1403] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:04:38.654186 12666 raft_consensus.cc:493] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.654850 12666 raft_consensus.cc:515] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.655308 12677 raft_consensus.cc:359] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.656805 12677 raft_consensus.cc:385] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.657195 12677 raft_consensus.cc:740] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.658358 12677 consensus_queue.cc:260] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.660266 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:38.661382 12677 ts_tablet_manager.cc:1434] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
W20260709 13:04:38.662142 12505 leader_election.cc:343] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.662922 12677 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.658380 12666 leader_election.cc:290] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:38.665520 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:38.666337 12466 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:38.667230 12678 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.667860 12678 ts_tablet_manager.cc:1403] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.107s	user 0.034s	sys 0.058s
I20260709 13:04:38.667659 12504 leader_election.cc:304] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:38.669163 12666 raft_consensus.cc:2804] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.669503 12666 raft_consensus.cc:493] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.669791 12666 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.670238 12677 tablet_bootstrap.cc:654] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.671139 12678 raft_consensus.cc:359] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.671953 12678 raft_consensus.cc:385] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.672266 12678 raft_consensus.cc:740] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.673203 12678 consensus_queue.cc:260] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.680853 12679 tablet_bootstrap.cc:492] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:38.681454 12679 ts_tablet_manager.cc:1403] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.041s
I20260709 13:04:38.682425 12677 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.683038 12677 ts_tablet_manager.cc:1403] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 13:04:38.685487 12679 raft_consensus.cc:359] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.686555 12679 raft_consensus.cc:385] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.686417 12677 raft_consensus.cc:359] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.687155 12679 raft_consensus.cc:740] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.687448 12677 raft_consensus.cc:385] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.687912 12677 raft_consensus.cc:740] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.688469 12679 consensus_queue.cc:260] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.688820 12677 consensus_queue.cc:260] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.689182 12666 raft_consensus.cc:515] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.691844 12677 ts_tablet_manager.cc:1434] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:38.691992 12679 ts_tablet_manager.cc:1434] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:38.693298 12677 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.693475 12679 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.705976 12679 tablet_bootstrap.cc:654] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.706060 12677 tablet_bootstrap.cc:654] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.708374 12690 raft_consensus.cc:493] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.709025 12690 raft_consensus.cc:515] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.713164 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:38.716991 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:38.718176 12541 raft_consensus.cc:2468] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:38.719744 12677 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.720279 12690 leader_election.cc:290] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.720602 12677 ts_tablet_manager.cc:1403] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.009s
W20260709 13:04:38.721519 12431 leader_election.cc:343] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.722579 12431 leader_election.cc:304] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:38.724145 12690 raft_consensus.cc:2804] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.724613 12690 raft_consensus.cc:493] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.724985 12690 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.728406 12677 raft_consensus.cc:359] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.729344 12677 raft_consensus.cc:385] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.729678 12677 raft_consensus.cc:740] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.730566 12677 consensus_queue.cc:260] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.733263 12677 ts_tablet_manager.cc:1434] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:38.742120 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:38.742925 12391 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.757066 12677 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.763496 12391 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:38.774335 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:38.774730 12505 leader_election.cc:304] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:38.775215 12466 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.781513 12677 tablet_bootstrap.cc:654] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.788303 12466 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:38.756073 12690 raft_consensus.cc:515] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.788602 12678 ts_tablet_manager.cc:1434] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.120s	user 0.061s	sys 0.060s
I20260709 13:04:38.790928 12690 leader_election.cc:290] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.791699 12678 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:38.788483 12693 raft_consensus.cc:2804] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.792860 12693 raft_consensus.cc:697] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:38.793712 12693 consensus_queue.cc:237] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.792495 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
W20260709 13:04:38.797214 12431 leader_election.cc:343] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.800101 12678 tablet_bootstrap.cc:654] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.801061 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:38.801362 12679 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:38.801750 12541 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.771530 12666 leader_election.cc:290] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:38.802238 12679 ts_tablet_manager.cc:1403] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.109s	user 0.028s	sys 0.030s
I20260709 13:04:38.805979 12679 raft_consensus.cc:359] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.806751 12679 raft_consensus.cc:385] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.807057 12679 raft_consensus.cc:740] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.807833 12679 consensus_queue.cc:260] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.809612 12541 raft_consensus.cc:2468] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
I20260709 13:04:38.810979 12431 leader_election.cc:304] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:38.811196 12678 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.812067 12678 ts_tablet_manager.cc:1403] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:04:38.811359 12679 ts_tablet_manager.cc:1434] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:38.812394 12690 raft_consensus.cc:2804] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.813052 12690 raft_consensus.cc:697] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:38.814144 12679 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.813980 12690 consensus_queue.cc:237] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.815753 12677 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.815409 12678 raft_consensus.cc:359] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.816465 12678 raft_consensus.cc:385] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.771958 12698 raft_consensus.cc:493] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.772112 12694 raft_consensus.cc:493] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.817729 12698 raft_consensus.cc:515] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.817850 12694 raft_consensus.cc:515] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.816813 12678 raft_consensus.cc:740] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.820458 12698 leader_election.cc:290] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:38.820218 12677 ts_tablet_manager.cc:1403] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.002s
I20260709 13:04:38.823388 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:38.823977 12679 tablet_bootstrap.cc:654] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.824419 12678 consensus_queue.cc:260] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.825802 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:38.826964 12505 leader_election.cc:343] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:38.827752 12504 leader_election.cc:343] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.828217 12504 leader_election.cc:304] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5; no voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417
I20260709 13:04:38.829900 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:38.830165 12698 raft_consensus.cc:2749] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.832674 12678 ts_tablet_manager.cc:1434] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:04:38.834070 12678 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
W20260709 13:04:38.837697 12505 leader_election.cc:343] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.838858 12694 leader_election.cc:290] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:38.840274 12677 raft_consensus.cc:359] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.841405 12677 raft_consensus.cc:385] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.841787 12677 raft_consensus.cc:740] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.846596 12677 consensus_queue.cc:260] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.846994 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
W20260709 13:04:38.848688 12504 leader_election.cc:343] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.848970 12679 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:38.849169 12504 leader_election.cc:304] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5; no voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417
I20260709 13:04:38.849828 12679 ts_tablet_manager.cc:1403] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.019s
I20260709 13:04:38.850548 12694 raft_consensus.cc:2749] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.850274 12286 catalog_manager.cc:5697] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.853309 12679 raft_consensus.cc:359] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.854193 12679 raft_consensus.cc:385] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.854521 12678 tablet_bootstrap.cc:654] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.854538 12679 raft_consensus.cc:740] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.849361 12677 ts_tablet_manager.cc:1434] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.007s
I20260709 13:04:38.855544 12679 consensus_queue.cc:260] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.861450 12285 catalog_manager.cc:5697] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 0 to 1, leader changed from <none> to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.862488 12677 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.863636 12679 ts_tablet_manager.cc:1434] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:04:38.864832 12679 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:38.869609 12690 raft_consensus.cc:493] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.870268 12690 raft_consensus.cc:515] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.872640 12690 leader_election.cc:290] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.874889 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:38.870723 12677 tablet_bootstrap.cc:654] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:38.876785 12431 leader_election.cc:343] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.877519 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
W20260709 13:04:38.879871 12431 leader_election.cc:343] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.880406 12431 leader_election.cc:304] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:38.882766 12690 raft_consensus.cc:2749] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.886340 12642 raft_consensus.cc:493] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.887110 12679 tablet_bootstrap.cc:654] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.886919 12642 raft_consensus.cc:515] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.891860 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:38.892658 12541 raft_consensus.cc:2468] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:38.893779 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:38.896852 12677 tablet_bootstrap.cc:492] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
W20260709 13:04:38.896106 12355 leader_election.cc:343] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.897619 12677 ts_tablet_manager.cc:1403] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.002s
I20260709 13:04:38.897850 12356 leader_election.cc:304] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: f136be7f233943ddbb244c5daa113417
I20260709 13:04:38.899446 12642 leader_election.cc:290] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.900203 12642 raft_consensus.cc:493] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.900892 12642 raft_consensus.cc:515] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.901842 12677 raft_consensus.cc:359] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.902719 12677 raft_consensus.cc:385] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.903028 12677 raft_consensus.cc:740] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.905229 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dca27bf6224160ba27d407ea1d20ba" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:38.906098 12467 raft_consensus.cc:2468] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:38.907464 12710 raft_consensus.cc:2804] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.909080 12710 raft_consensus.cc:493] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.909466 12710 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.914340 12678 tablet_bootstrap.cc:492] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:38.907706 12355 leader_election.cc:304] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:38.908478 12677 consensus_queue.cc:260] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.919987 12677 ts_tablet_manager.cc:1434] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:38.921358 12677 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: Bootstrap starting.
I20260709 13:04:38.923110 12642 leader_election.cc:290] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.923990 12642 raft_consensus.cc:2804] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.925571 12642 raft_consensus.cc:493] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.928519 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dca27bf6224160ba27d407ea1d20ba" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:38.929878 12710 raft_consensus.cc:515] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
W20260709 13:04:38.931016 12356 leader_election.cc:343] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.932488 12710 leader_election.cc:290] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.928603 12677 tablet_bootstrap.cc:654] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.933442 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:38.934221 12467 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.945902 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:38.946723 12541 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.929279 12678 ts_tablet_manager.cc:1403] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.008s
I20260709 13:04:38.959661 12642 raft_consensus.cc:3060] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.960815 12467 raft_consensus.cc:2468] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:38.961493 12677 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: No bootstrap required, opened a new log
I20260709 13:04:38.962117 12677 ts_tablet_manager.cc:1403] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.014s
I20260709 13:04:38.965476 12677 raft_consensus.cc:359] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.966209 12677 raft_consensus.cc:385] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.966480 12677 raft_consensus.cc:740] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.955998 12541 raft_consensus.cc:2468] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:38.969324 12356 leader_election.cc:304] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:38.973311 12710 raft_consensus.cc:2804] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.974295 12642 raft_consensus.cc:515] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.975096 12690 raft_consensus.cc:493] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.975694 12690 raft_consensus.cc:515] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.976783 12642 leader_election.cc:290] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.978112 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dca27bf6224160ba27d407ea1d20ba" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:38.978737 12690 leader_election.cc:290] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:38.978896 12467 raft_consensus.cc:3060] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.975950 12677 consensus_queue.cc:260] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.981534 12679 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:38.982472 12679 ts_tablet_manager.cc:1403] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.118s	user 0.046s	sys 0.045s
I20260709 13:04:38.983829 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
W20260709 13:04:38.985431 12431 leader_election.cc:343] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.971339 12678 raft_consensus.cc:359] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.986222 12678 raft_consensus.cc:385] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.987759 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:38.987344 12467 raft_consensus.cc:2468] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:38.988013 12678 raft_consensus.cc:740] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.981596 12677 ts_tablet_manager.cc:1434] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:04:38.988562 12391 raft_consensus.cc:2468] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:38.989382 12355 leader_election.cc:304] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:38.989920 12431 leader_election.cc:304] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:38.987344 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dca27bf6224160ba27d407ea1d20ba" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:38.991313 12690 raft_consensus.cc:2804] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.991779 12690 raft_consensus.cc:493] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.992225 12690 raft_consensus.cc:3060] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.992718 12679 raft_consensus.cc:359] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.993412 12679 raft_consensus.cc:385] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.993695 12679 raft_consensus.cc:740] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.994426 12679 consensus_queue.cc:260] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.996641 12710 raft_consensus.cc:697] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:38.997376 12716 raft_consensus.cc:2804] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.998027 12716 raft_consensus.cc:697] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:38.997830 12710 consensus_queue.cc:237] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.998904 12716 consensus_queue.cc:237] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:38.989364 12678 consensus_queue.cc:260] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.002187 12541 raft_consensus.cc:3060] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.006198 12690 raft_consensus.cc:515] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.007256 12679 ts_tablet_manager.cc:1434] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:04:39.008572 12679 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:39.011600 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:39.011821 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.012712 12391 raft_consensus.cc:3060] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.013027 12541 raft_consensus.cc:2468] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
W20260709 13:04:39.014822 12431 leader_election.cc:343] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.014575 12286 catalog_manager.cc:5697] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.008564 12690 leader_election.cc:290] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.025069 12678 ts_tablet_manager.cc:1434] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.004s
I20260709 13:04:39.028782 12678 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:39.030493 12391 raft_consensus.cc:2468] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
I20260709 13:04:39.026463 12679 tablet_bootstrap.cc:654] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.027015 12694 raft_consensus.cc:493] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.032420 12694 raft_consensus.cc:515] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.033936 12431 leader_election.cc:304] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:39.035332 12690 raft_consensus.cc:2804] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.035866 12690 raft_consensus.cc:697] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:39.036677 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.036873 12690 consensus_queue.cc:237] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.037546 12467 raft_consensus.cc:2468] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:39.036005 12694 leader_election.cc:290] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:39.039427 12504 leader_election.cc:304] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.040467 12694 raft_consensus.cc:2804] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.040925 12694 raft_consensus.cc:493] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.041311 12694 raft_consensus.cc:3060] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.041635 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
W20260709 13:04:39.045305 12505 leader_election.cc:343] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.045173 12678 tablet_bootstrap.cc:654] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.041414 12286 catalog_manager.cc:5697] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.056123 12285 catalog_manager.cc:5697] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 0 to 1, leader changed from <none> to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.060418 12694 raft_consensus.cc:515] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.069243 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
W20260709 13:04:39.070770 12505 leader_election.cc:343] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.073036 12694 leader_election.cc:290] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:39.074293 12679 tablet_bootstrap.cc:492] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:39.074311 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.075066 12679 ts_tablet_manager.cc:1403] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.011s
I20260709 13:04:39.075201 12467 raft_consensus.cc:3060] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.076026 12678 tablet_bootstrap.cc:492] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:39.077384 12678 ts_tablet_manager.cc:1403] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.012s
I20260709 13:04:39.078886 12679 raft_consensus.cc:359] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.079682 12679 raft_consensus.cc:385] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.080017 12679 raft_consensus.cc:740] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.079855 12678 raft_consensus.cc:359] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.080683 12678 raft_consensus.cc:385] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.080996 12678 raft_consensus.cc:740] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.080955 12679 consensus_queue.cc:260] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.081888 12678 consensus_queue.cc:260] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.083534 12679 ts_tablet_manager.cc:1434] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:39.084671 12679 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:39.085902 12678 ts_tablet_manager.cc:1434] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:39.088617 12678 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:39.086674 12467 raft_consensus.cc:2468] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:39.091404 12679 tablet_bootstrap.cc:654] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.092446 12504 leader_election.cc:304] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:39.093776 12694 raft_consensus.cc:2804] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.094331 12694 raft_consensus.cc:697] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:39.095324 12694 consensus_queue.cc:237] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.096131 12678 tablet_bootstrap.cc:654] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.103229 12679 tablet_bootstrap.cc:492] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:39.103781 12679 ts_tablet_manager.cc:1403] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:04:39.106952 12679 raft_consensus.cc:359] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.108181 12679 raft_consensus.cc:385] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.108523 12679 raft_consensus.cc:740] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.109315 12679 consensus_queue.cc:260] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.111420 12679 ts_tablet_manager.cc:1434] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.111454 12678 tablet_bootstrap.cc:492] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:39.112167 12678 ts_tablet_manager.cc:1403] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:04:39.112695 12679 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: Bootstrap starting.
I20260709 13:04:39.115046 12678 raft_consensus.cc:359] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.115757 12678 raft_consensus.cc:385] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.116021 12678 raft_consensus.cc:740] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.116724 12678 consensus_queue.cc:260] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.118353 12679 tablet_bootstrap.cc:654] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.118793 12678 ts_tablet_manager.cc:1434] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:39.119812 12678 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: Bootstrap starting.
I20260709 13:04:39.119966 12285 catalog_manager.cc:5697] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.121448 12716 raft_consensus.cc:493] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.121970 12716 raft_consensus.cc:515] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.124294 12716 leader_election.cc:290] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.127753 12678 tablet_bootstrap.cc:654] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.127712 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:39.130806 12541 raft_consensus.cc:2393] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6238ce107b1e4c74b68b3de891221b4b in current term 1: Already voted for candidate f136be7f233943ddbb244c5daa113417 in this term.
I20260709 13:04:39.133581 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.135600 12678 tablet_bootstrap.cc:492] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: No bootstrap required, opened a new log
I20260709 13:04:39.135449 12355 leader_election.cc:304] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b; no voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.136161 12678 ts_tablet_manager.cc:1403] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 13:04:39.137606 12679 tablet_bootstrap.cc:492] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: No bootstrap required, opened a new log
I20260709 13:04:39.138186 12679 ts_tablet_manager.cc:1403] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 13:04:39.139155 12678 raft_consensus.cc:359] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.139889 12678 raft_consensus.cc:385] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.140144 12678 raft_consensus.cc:740] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.140482 12716 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.141022 12679 raft_consensus.cc:359] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.140959 12678 consensus_queue.cc:260] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.141851 12679 raft_consensus.cc:385] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.142153 12679 raft_consensus.cc:740] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.142825 12679 consensus_queue.cc:260] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.143603 12678 ts_tablet_manager.cc:1434] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.143692 12717 raft_consensus.cc:493] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.144752 12679 ts_tablet_manager.cc:1434] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:39.144323 12717 raft_consensus.cc:515] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.147861 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:39.148506 12541 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:39.149448 12716 raft_consensus.cc:2749] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.149756 12356 leader_election.cc:304] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.150704 12710 raft_consensus.cc:2804] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.151095 12710 raft_consensus.cc:493] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.151435 12710 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.151549 12717 leader_election.cc:290] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.152906 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.153584 12466 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:39.158182 12710 raft_consensus.cc:515] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.160607 12710 leader_election.cc:290] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.160925 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.161240 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.161592 12466 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.161769 12541 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.167268 12541 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:39.168497 12356 leader_election.cc:304] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.168973 12466 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 1.
I20260709 13:04:39.169219 12710 raft_consensus.cc:2804] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.169787 12710 raft_consensus.cc:697] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.170580 12710 consensus_queue.cc:237] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.179381 12694 raft_consensus.cc:493] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.178889 12285 catalog_manager.cc:5697] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.179857 12694 raft_consensus.cc:515] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.182535 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:39.182675 12694 leader_election.cc:290] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:39.183238 12391 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:39.184746 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.184980 12505 leader_election.cc:304] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.185384 12466 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 0.
I20260709 13:04:39.185940 12694 raft_consensus.cc:2804] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.186334 12694 raft_consensus.cc:493] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.186592 12694 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.192224 12694 raft_consensus.cc:515] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.194103 12694 leader_election.cc:290] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:39.194924 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:39.195176 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.195762 12466 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.195883 12391 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.201141 12466 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:39.202064 12391 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 1.
I20260709 13:04:39.202468 12504 leader_election.cc:304] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.203289 12694 raft_consensus.cc:2804] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.203861 12694 raft_consensus.cc:697] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:39.204774 12694 consensus_queue.cc:237] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.213742 12285 catalog_manager.cc:5697] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.224134 12697 consensus_queue.cc:1048] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.225129 12694 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.243088 12698 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.295243 12716 raft_consensus.cc:493] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.297254 12716 raft_consensus.cc:515] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.297484 12657 consensus_queue.cc:1048] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.302702 12716 leader_election.cc:290] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.305959 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:39.314849 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0a01ec67624b9e88449d8d99be02ed" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.316334 12466 raft_consensus.cc:2393] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6238ce107b1e4c74b68b3de891221b4b in current term 1: Already voted for candidate e0d2fe5f6fd0439592482c881fb7bca5 in this term.
I20260709 13:04:39.319406 12355 leader_election.cc:304] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b; no voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.321583 12710 raft_consensus.cc:3060] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.354357 12710 raft_consensus.cc:2749] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.388360 12710 consensus_queue.cc:1048] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.401805 12642 consensus_queue.cc:1048] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.419854 12657 raft_consensus.cc:493] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.420941 12657 raft_consensus.cc:515] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.425942 12657 leader_election.cc:290] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.428294 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:39.429374 12642 raft_consensus.cc:493] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.430203 12642 raft_consensus.cc:515] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.430241 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:39.431308 12392 raft_consensus.cc:2468] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:39.430656 12539 raft_consensus.cc:2468] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 0.
I20260709 13:04:39.432904 12431 leader_election.cc:304] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.432987 12642 leader_election.cc:290] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.433873 12657 raft_consensus.cc:2804] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.433990 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.434365 12657 raft_consensus.cc:493] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.434867 12657 raft_consensus.cc:3060] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.437938 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" is_pre_election: true
I20260709 13:04:39.438809 12539 raft_consensus.cc:2468] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 0.
I20260709 13:04:39.440361 12356 leader_election.cc:304] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.441076 12642 raft_consensus.cc:2804] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.441538 12642 raft_consensus.cc:493] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.441910 12642 raft_consensus.cc:3060] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.443863 12657 raft_consensus.cc:515] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.445070 12467 raft_consensus.cc:2393] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6238ce107b1e4c74b68b3de891221b4b in current term 1: Already voted for candidate f136be7f233943ddbb244c5daa113417 in this term.
I20260709 13:04:39.445842 12657 leader_election.cc:290] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.447278 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.447520 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:39.448140 12540 raft_consensus.cc:3060] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.452648 12642 raft_consensus.cc:515] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.454294 12392 raft_consensus.cc:2393] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f136be7f233943ddbb244c5daa113417 in current term 1: Already voted for candidate 6238ce107b1e4c74b68b3de891221b4b in this term.
I20260709 13:04:39.455484 12642 leader_election.cc:290] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.456473 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.456606 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba31db3d899450aabc23cb49e47b745" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.457325 12467 raft_consensus.cc:2393] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6238ce107b1e4c74b68b3de891221b4b in current term 1: Already voted for candidate f136be7f233943ddbb244c5daa113417 in this term.
I20260709 13:04:39.458743 12355 leader_election.cc:304] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b; no voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.459573 12642 raft_consensus.cc:2749] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.459889 12540 raft_consensus.cc:2468] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 1.
I20260709 13:04:39.461163 12431 leader_election.cc:304] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:39.462014 12657 raft_consensus.cc:2804] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.462502 12657 raft_consensus.cc:697] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:39.463465 12657 consensus_queue.cc:237] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.472744 12286 catalog_manager.cc:5697] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 0 to 1, leader changed from <none> to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.491446 12657 consensus_queue.cc:1048] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.496074 12642 consensus_queue.cc:1048] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.507212 12540 raft_consensus.cc:3060] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.514357 12700 consensus_queue.cc:1048] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.515286 12710 consensus_queue.cc:1048] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.521467 12700 consensus_queue.cc:1048] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.526808 12690 consensus_queue.cc:1048] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.527215 12700 raft_consensus.cc:493] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.527980 12700 raft_consensus.cc:515] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.533672 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6238ce107b1e4c74b68b3de891221b4b" is_pre_election: true
I20260709 13:04:39.545750 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6094a1680fae4dda92e51818bff11c62" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f136be7f233943ddbb244c5daa113417" is_pre_election: true
I20260709 13:04:39.548229 12504 leader_election.cc:304] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5; no voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.550326 12700 leader_election.cc:290] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:39.554385 12699 raft_consensus.cc:2749] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.602108 12467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
mode: GRACEFUL
new_leader_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:43662
I20260709 13:04:39.602803 12467 raft_consensus.cc:606] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Received request to transfer leadership to TS 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:39.609481 12540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
mode: GRACEFUL
new_leader_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:59380
I20260709 13:04:39.610113 12540 raft_consensus.cc:606] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Received request to transfer leadership to TS 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:39.619004 12710 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.622325 12539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
mode: GRACEFUL
new_leader_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:59380
I20260709 13:04:39.623023 12539 raft_consensus.cc:606] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Received request to transfer leadership to TS 6238ce107b1e4c74b68b3de891221b4b
I20260709 13:04:39.635753 12642 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.638238 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
mode: GRACEFUL
new_leader_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:39.639034 12392 raft_consensus.cc:606] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Received request to transfer leadership to TS f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.648904 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2d4386e4347499b96d944de923000e9"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
mode: GRACEFUL
new_leader_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:39.649652 12392 raft_consensus.cc:606] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Received request to transfer leadership to TS f136be7f233943ddbb244c5daa113417
I20260709 13:04:39.664098 12699 consensus_queue.cc:1048] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.665474 12716 raft_consensus.cc:993] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: : Instructing follower f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:39.666059 12710 raft_consensus.cc:1081] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Signalling peer f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:39.670362 12466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2d4386e4347499b96d944de923000e9"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:43640
I20260709 13:04:39.670918 12466 raft_consensus.cc:493] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.671301 12466 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.681183 12466 raft_consensus.cc:515] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.682228 12666 raft_consensus.cc:993] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: : Instructing follower 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.682755 12666 raft_consensus.cc:1081] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Signalling peer 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.683156 12466 leader_election.cc:290] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.687938 12700 consensus_queue.cc:1048] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.689116 12390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:52034
I20260709 13:04:39.689827 12390 raft_consensus.cc:493] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.690294 12390 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.693241 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.693989 12540 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.695991 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:39.697198 12392 raft_consensus.cc:3055] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.697644 12392 raft_consensus.cc:740] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.698832 12392 consensus_queue.cc:260] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.700783 12392 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.704025 12540 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:39.705787 12431 leader_election.cc:304] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.709728 12697 raft_consensus.cc:2804] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.710263 12697 raft_consensus.cc:697] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:39.711301 12657 raft_consensus.cc:993] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: : Instructing follower 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.711601 12390 raft_consensus.cc:515] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.711886 12657 raft_consensus.cc:1081] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Signalling peer 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.711484 12697 consensus_queue.cc:237] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.715106 12391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:52026
I20260709 13:04:39.715761 12391 raft_consensus.cc:493] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.716188 12391 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.719046 12392 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:39.724143 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.724845 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb0334c49a64982bb8e7e8012f3d2bd" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.724123 12390 leader_election.cc:290] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.725605 12539 raft_consensus.cc:3055] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.725993 12539 raft_consensus.cc:740] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:39.725034 12467 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.727320 12539 consensus_queue.cc:260] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.728511 12539 raft_consensus.cc:3060] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.731930 12391 raft_consensus.cc:515] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.734982 12467 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.735440 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.735749 12539 raft_consensus.cc:2468] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.735826 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d914359c848c8bfa65ec73e5c6d0b" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.736634 12540 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.736107 12466 raft_consensus.cc:3055] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.737087 12356 leader_election.cc:304] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.737676 12466 raft_consensus.cc:740] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:39.738180 12716 raft_consensus.cc:2804] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.738396 12391 leader_election.cc:290] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.738742 12716 raft_consensus.cc:697] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.739459 12466 consensus_queue.cc:260] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.739758 12716 consensus_queue.cc:237] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.740768 12466 raft_consensus.cc:3060] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.742799 12284 catalog_manager.cc:5697] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 1 to 2, leader changed from 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193) to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.746284 12540 raft_consensus.cc:2468] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.748337 12356 leader_election.cc:304] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, e0d2fe5f6fd0439592482c881fb7bca5; no voters: 
I20260709 13:04:39.749374 12466 raft_consensus.cc:2468] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.749539 12710 raft_consensus.cc:2804] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.750165 12710 raft_consensus.cc:697] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.751029 12710 consensus_queue.cc:237] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.758267 12284 catalog_manager.cc:5697] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 1 to 2, leader changed from e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195) to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.772765 12284 catalog_manager.cc:5697] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 1 to 2, leader changed from f136be7f233943ddbb244c5daa113417 (127.0.107.194) to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.774537 12700 raft_consensus.cc:993] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: : Instructing follower 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.775216 12698 raft_consensus.cc:1081] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Signalling peer 6238ce107b1e4c74b68b3de891221b4b to start an election
I20260709 13:04:39.776721 12391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
 from {username='slave'} at 127.0.0.1:52034
I20260709 13:04:39.777132 12391 raft_consensus.cc:493] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.777390 12391 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.782845 12391 raft_consensus.cc:515] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.784422 12391 leader_election.cc:290] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Requested vote from peers f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.785302 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:39.785537 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "6238ce107b1e4c74b68b3de891221b4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.785907 12466 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.786104 12540 raft_consensus.cc:3055] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.786443 12540 raft_consensus.cc:740] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:39.787201 12540 consensus_queue.cc:260] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.788281 12540 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.790719 12466 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.791888 12355 leader_election.cc:304] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6238ce107b1e4c74b68b3de891221b4b, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.792636 12710 raft_consensus.cc:2804] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.793020 12710 raft_consensus.cc:697] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Leader. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.793895 12540 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6238ce107b1e4c74b68b3de891221b4b in term 2.
I20260709 13:04:39.793900 12710 consensus_queue.cc:237] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.801514 12284 catalog_manager.cc:5697] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b reported cstate change: term changed from 1 to 2, leader changed from e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195) to 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6238ce107b1e4c74b68b3de891221b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.810580 12710 raft_consensus.cc:993] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: : Instructing follower f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:39.811269 12642 raft_consensus.cc:1081] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Signalling peer f136be7f233943ddbb244c5daa113417 to start an election
I20260709 13:04:39.813464 12467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
 from {username='slave'} at 127.0.0.1:43640
I20260709 13:04:39.814149 12467 raft_consensus.cc:493] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.814605 12467 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.821446 12467 raft_consensus.cc:515] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.823099 12467 leader_election.cc:290] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195:38065)
I20260709 13:04:39.824043 12391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:39.824333 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa524d31b65740f2a7ffbefe4378e017" candidate_uuid: "f136be7f233943ddbb244c5daa113417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
I20260709 13:04:39.824774 12391 raft_consensus.cc:3055] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.824895 12540 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.825150 12391 raft_consensus.cc:740] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:39.826123 12391 consensus_queue.cc:260] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.827390 12391 raft_consensus.cc:3060] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.832806 12540 raft_consensus.cc:2468] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:39.834386 12431 leader_election.cc:304] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:39.834525 12391 raft_consensus.cc:2468] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f136be7f233943ddbb244c5daa113417 in term 2.
I20260709 13:04:39.835515 12697 raft_consensus.cc:2804] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.836069 12697 raft_consensus.cc:697] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Leader. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:39.837078 12697 consensus_queue.cc:237] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:39.845317 12284 catalog_manager.cc:5697] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 reported cstate change: term changed from 1 to 2, leader changed from 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193) to f136be7f233943ddbb244c5daa113417 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f136be7f233943ddbb244c5daa113417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.015825 12697 consensus_queue.cc:1048] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.029017 12697 consensus_queue.cc:1048] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.134974 12539 raft_consensus.cc:1275] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.136428 12657 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.145762 12391 raft_consensus.cc:1275] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.147120 12690 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.189286 12467 raft_consensus.cc:1275] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.190964 12642 consensus_queue.cc:1048] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.200204 12540 raft_consensus.cc:1275] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.203168 12710 consensus_queue.cc:1048] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:40.237046 12467 raft_consensus.cc:1275] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.238549 12710 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.247442 12540 raft_consensus.cc:1275] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.249357 12754 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.276356 12540 raft_consensus.cc:1275] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.277992 12710 consensus_queue.cc:1048] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:40.286950 12467 raft_consensus.cc:1275] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer 6238ce107b1e4c74b68b3de891221b4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.289054 12710 consensus_queue.cc:1048] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.390683 12391 raft_consensus.cc:1275] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.391961 12690 consensus_queue.cc:1048] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.400076 12540 raft_consensus.cc:1275] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Refusing update from remote peer f136be7f233943ddbb244c5daa113417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.403070 12657 consensus_queue.cc:1048] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:42.676433 12284 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53880:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:42.701980 12284 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53880:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 13:04:42.833375 12772 log.cc:927] Time spent T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:42.905174   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:04:42.912204 12431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38435, user_credentials={real_user=slave}} blocked reactor thread for 49703.3us
W20260709 13:04:42.991304 12355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33265, user_credentials={real_user=slave}} blocked reactor thread for 51556.3us
W20260709 13:04:43.028079 12798 log.cc:927] Time spent T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:04:43.000036 12811 tablet.cc:1724] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.047222 12806 tablet.cc:1724] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:43.045970 12796 log.cc:927] Time spent T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:04:43.079144 12791 log.cc:927] Time spent T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Append to log took a long time: real 0.144s	user 0.001s	sys 0.003s
I20260709 13:04:43.036860 12809 tablet.cc:1724] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.101426 12821 tablet.cc:1724] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:43.104419 12355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33265, user_credentials={real_user=slave}} blocked reactor thread for 86214.6us
I20260709 13:04:43.049185 12813 tablet.cc:1724] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.097697 12814 tablet.cc:1724] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.139086 12820 tablet.cc:1724] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.154428 12823 tablet.cc:1724] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.159018 12809 tablet.cc:1724] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.079244 12818 tablet.cc:1724] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.177067 12811 tablet.cc:1724] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.217738 12823 tablet.cc:1724] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.199564 12806 tablet.cc:1724] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.225252 12825 tablet.cc:1724] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.234766 12830 tablet.cc:1724] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.253772 12825 tablet.cc:1724] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.262228 12818 tablet.cc:1724] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.265894 12828 tablet.cc:1724] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.267452 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
mode: GRACEFUL
new_leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:48916
I20260709 13:04:43.268194 12392 raft_consensus.cc:606] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Received request to transfer leadership to TS e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:43.272789 12820 tablet.cc:1724] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.251816 12813 tablet.cc:1724] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.277252 12821 tablet.cc:1724] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.278901 12814 tablet.cc:1724] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.285988 12809 tablet.cc:1724] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.276247 12806 tablet.cc:1724] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.352749 12809 tablet.cc:1724] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.356845 12806 tablet.cc:1724] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.374845 12466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2d4386e4347499b96d944de923000e9"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
mode: GRACEFUL
new_leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:40422
I20260709 13:04:43.375586 12466 raft_consensus.cc:606] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Received request to transfer leadership to TS e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:43.378120 12813 tablet.cc:1724] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.381129   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:04:43.381883   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.397491 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686"
dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
mode: GRACEFUL
new_leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:48916
I20260709 13:04:43.398077 12392 raft_consensus.cc:606] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Received request to transfer leadership to TS e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:43.402264 12466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e"
dest_uuid: "f136be7f233943ddbb244c5daa113417"
mode: GRACEFUL
new_leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:40422
I20260709 13:04:43.402916 12466 raft_consensus.cc:606] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Received request to transfer leadership to TS e0d2fe5f6fd0439592482c881fb7bca5
I20260709 13:04:43.402400 12284 catalog_manager.cc:6242] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: soft_deleted_table [id=b19bd37f677a4d38b5f727c5e596c94e] alter complete (version 1)
I20260709 13:04:43.405362   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:43.406086   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:43.592200 12802 raft_consensus.cc:993] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: : Instructing follower e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.592892 12793 raft_consensus.cc:1081] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Signalling peer e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.594521 12538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:59368
I20260709 13:04:43.595062 12538 raft_consensus.cc:493] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.595345 12538 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.600961 12538 raft_consensus.cc:515] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.602612 12538 leader_election.cc:290] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:43.603343 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:43.603611 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4f277c23d54d11b7d393c145245d1e" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:43.603950 12392 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.604161 12466 raft_consensus.cc:3055] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.604588 12466 raft_consensus.cc:740] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:43.605243 12466 consensus_queue.cc:260] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.606073 12466 raft_consensus.cc:3060] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.610467 12466 raft_consensus.cc:2468] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.611261 12392 raft_consensus.cc:2468] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.611539 12504 leader_election.cc:304] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:43.612555 12833 raft_consensus.cc:2804] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.613019 12833 raft_consensus.cc:697] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:43.613760 12833 consensus_queue.cc:237] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.621311 12286 catalog_manager.cc:5697] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 2 to 3, leader changed from f136be7f233943ddbb244c5daa113417 (127.0.107.194) to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.638619 12802 raft_consensus.cc:993] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: : Instructing follower e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.638797 12758 raft_consensus.cc:993] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: : Instructing follower e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.639046 12793 raft_consensus.cc:1081] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Signalling peer e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.639503 12757 raft_consensus.cc:1081] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Signalling peer e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.640812 12538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2d4386e4347499b96d944de923000e9"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:59368
I20260709 13:04:43.641052 12536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:59364
I20260709 13:04:43.641355 12538 raft_consensus.cc:493] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.641577 12536 raft_consensus.cc:493] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.641724 12538 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.641942 12536 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.647281 12538 raft_consensus.cc:515] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.649051 12538 leader_election.cc:290] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:43.649602 12536 raft_consensus.cc:515] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.650014 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:43.650522 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d4386e4347499b96d944de923000e9" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:43.650637 12466 raft_consensus.cc:3055] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.651374 12466 raft_consensus.cc:740] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f136be7f233943ddbb244c5daa113417, State: Running, Role: LEADER
I20260709 13:04:43.651922 12536 leader_election.cc:290] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:43.652832 12388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:43.653445 12388 raft_consensus.cc:3055] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.653905 12388 raft_consensus.cc:740] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:43.654497 12465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab642d504da4abb8b61a7228f068023" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:43.654881 12466 consensus_queue.cc:260] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.654701 12388 consensus_queue.cc:260] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.655121 12465 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.655819 12466 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.655997 12388 raft_consensus.cc:3060] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.651403 12392 raft_consensus.cc:3060] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.663403 12388 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.663744 12466 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.663436 12465 raft_consensus.cc:2468] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.664928 12504 leader_election.cc:304] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:43.665680 12833 raft_consensus.cc:2804] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.665865 12504 leader_election.cc:304] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:43.666163 12833 raft_consensus.cc:697] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:43.667100 12698 raft_consensus.cc:2804] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.666980 12833 consensus_queue.cc:237] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.667501 12392 raft_consensus.cc:2468] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 3.
I20260709 13:04:43.668258 12698 raft_consensus.cc:697] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:43.668419 12389 raft_consensus.cc:1240] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Rejecting Update request from peer f136be7f233943ddbb244c5daa113417 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:43.669483 12698 consensus_queue.cc:237] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.679023 12286 catalog_manager.cc:5697] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 2 to 3, leader changed from 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193) to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.694921 12286 catalog_manager.cc:5697] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 2 to 3, leader changed from f136be7f233943ddbb244c5daa113417 (127.0.107.194) to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.702392 12758 raft_consensus.cc:993] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: : Instructing follower e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.703428 12757 raft_consensus.cc:1081] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Signalling peer e0d2fe5f6fd0439592482c881fb7bca5 to start an election
I20260709 13:04:43.705132 12536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686"
dest_uuid: "e0d2fe5f6fd0439592482c881fb7bca5"
 from {username='slave'} at 127.0.0.1:59364
I20260709 13:04:43.705633 12536 raft_consensus.cc:493] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.705921 12536 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.711179 12536 raft_consensus.cc:515] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.713053 12536 leader_election.cc:290] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 2 election: Requested vote from peers 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435), f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265)
I20260709 13:04:43.713910 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6238ce107b1e4c74b68b3de891221b4b"
I20260709 13:04:43.714289 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b74d76ad0d4e35a7c3b7a4b0167686" candidate_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f136be7f233943ddbb244c5daa113417"
I20260709 13:04:43.714694 12392 raft_consensus.cc:3055] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.714846 12466 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.715049 12392 raft_consensus.cc:740] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6238ce107b1e4c74b68b3de891221b4b, State: Running, Role: LEADER
I20260709 13:04:43.715860 12392 consensus_queue.cc:260] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.716982 12392 raft_consensus.cc:3060] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.721988 12466 raft_consensus.cc:2468] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 2.
I20260709 13:04:43.723435 12504 leader_election.cc:304] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d2fe5f6fd0439592482c881fb7bca5, f136be7f233943ddbb244c5daa113417; no voters: 
I20260709 13:04:43.724042 12392 raft_consensus.cc:2468] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d2fe5f6fd0439592482c881fb7bca5 in term 2.
I20260709 13:04:43.724474 12698 raft_consensus.cc:2804] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.725075 12698 raft_consensus.cc:697] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 LEADER]: Becoming Leader. State: Replica: e0d2fe5f6fd0439592482c881fb7bca5, State: Running, Role: LEADER
I20260709 13:04:43.726018 12698 consensus_queue.cc:237] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } }
I20260709 13:04:43.735562 12286 catalog_manager.cc:5697] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 reported cstate change: term changed from 1 to 2, leader changed from 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193) to e0d2fe5f6fd0439592482c881fb7bca5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d2fe5f6fd0439592482c881fb7bca5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38065 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.076054 12392 raft_consensus.cc:1275] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.077289 12698 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.085153 12466 raft_consensus.cc:1275] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.086782 12833 consensus_queue.cc:1048] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.093400 12465 raft_consensus.cc:1275] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.098806 12698 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.109891 12392 raft_consensus.cc:1275] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.111275 12698 consensus_queue.cc:1048] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.112272 12466 raft_consensus.cc:1275] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.113845 12698 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.126456 12392 raft_consensus.cc:1275] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.129122 12839 consensus_queue.cc:1048] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.214424 12466 raft_consensus.cc:1275] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:44.215893 12839 consensus_queue.cc:1048] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f136be7f233943ddbb244c5daa113417" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.225311 12389 raft_consensus.cc:1275] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Refusing update from remote peer e0d2fe5f6fd0439592482c881fb7bca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:44.226938 12698 consensus_queue.cc:1048] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6238ce107b1e4c74b68b3de891221b4b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.473829   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:44.480547   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:04:44.480938   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.487526   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:04:44.488026   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.529407   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:45.532929 12505 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:04:45.536276 12505 consensus_peers.cc:597] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.555876 12505 consensus_peers.cc:597] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.570052   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.571133   431 tablet_replica.cc:333] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.572351   431 raft_consensus.cc:2243] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.573346   431 raft_consensus.cc:2272] T dd0a01ec67624b9e88449d8d99be02ed P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.576094   431 tablet_replica.cc:333] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.576999   431 raft_consensus.cc:2243] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.577498   431 raft_consensus.cc:2272] T eba31db3d899450aabc23cb49e47b745 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.579640   431 tablet_replica.cc:333] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.580289   431 raft_consensus.cc:2243] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.580777   431 raft_consensus.cc:2272] T 6094a1680fae4dda92e51818bff11c62 P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.582717   431 tablet_replica.cc:333] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.583257   431 raft_consensus.cc:2243] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.583772   431 raft_consensus.cc:2272] T 1ab642d504da4abb8b61a7228f068023 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.586804   431 tablet_replica.cc:333] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.587399   431 raft_consensus.cc:2243] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.588193   431 raft_consensus.cc:2272] T 1eb0334c49a64982bb8e7e8012f3d2bd P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.590687   431 tablet_replica.cc:333] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.591341   431 raft_consensus.cc:2243] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.591813   431 raft_consensus.cc:2272] T b2d4386e4347499b96d944de923000e9 P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.593993   431 tablet_replica.cc:333] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.594728   431 raft_consensus.cc:2243] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.595619   431 raft_consensus.cc:2272] T c4dca27bf6224160ba27d407ea1d20ba P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.598058   431 tablet_replica.cc:333] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.598651   431 raft_consensus.cc:2243] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.599483   431 raft_consensus.cc:2272] T e4f06730d1ea4198bd857096eacfb65b P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.601696   431 tablet_replica.cc:333] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.602274   431 raft_consensus.cc:2243] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.603125   431 raft_consensus.cc:2272] T 659b1001b708481eb6babdb52ee14932 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.605863   431 tablet_replica.cc:333] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.606458   431 raft_consensus.cc:2243] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.606923   431 raft_consensus.cc:2272] T 8282a433fc234c42aad9a6b1fde1a50c P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.609644   431 tablet_replica.cc:333] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.610298   431 raft_consensus.cc:2243] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.611661   431 raft_consensus.cc:2272] T 6b8d914359c848c8bfa65ec73e5c6d0b P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.614615   431 tablet_replica.cc:333] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.615449   431 raft_consensus.cc:2243] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.615932   431 raft_consensus.cc:2272] T 13b74d76ad0d4e35a7c3b7a4b0167686 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.618290   431 tablet_replica.cc:333] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.618906   431 raft_consensus.cc:2243] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.619629   431 raft_consensus.cc:2272] T e44692cdc9a94782913b2c1c403cf937 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.621966   431 tablet_replica.cc:333] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.622560   431 raft_consensus.cc:2243] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.623041   431 raft_consensus.cc:2272] T aa524d31b65740f2a7ffbefe4378e017 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.625425   431 tablet_replica.cc:333] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.626035   431 raft_consensus.cc:2243] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.626521   431 raft_consensus.cc:2272] T 10b9ba9b18e24dd3b400e9eaf11be37d P 6238ce107b1e4c74b68b3de891221b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.629195   431 tablet_replica.cc:333] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.629927   431 raft_consensus.cc:2243] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.630833   431 raft_consensus.cc:2272] T 67f457232dbf490fb66e384f63359610 P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.633452   431 tablet_replica.cc:333] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.634053   431 raft_consensus.cc:2243] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.634588   431 raft_consensus.cc:2272] T 5c4f277c23d54d11b7d393c145245d1e P 6238ce107b1e4c74b68b3de891221b4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.636898   431 tablet_replica.cc:333] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b: stopping tablet replica
I20260709 13:04:45.637557   431 raft_consensus.cc:2243] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.638104   431 raft_consensus.cc:2272] T ebccc43d996443238d52afdd0323755a P 6238ce107b1e4c74b68b3de891221b4b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:45.654007 12505 consensus_peers.cc:597] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.681962 12505 consensus_peers.cc:597] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.686506   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:45.693238 12505 consensus_peers.cc:597] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.729387   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:45.736937 12431 consensus_peers.cc:597] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.764933   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.765887   431 tablet_replica.cc:333] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.766944   431 raft_consensus.cc:2243] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.767939   431 raft_consensus.cc:2272] T eba31db3d899450aabc23cb49e47b745 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.770565   431 tablet_replica.cc:333] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.771363   431 raft_consensus.cc:2243] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.771881   431 raft_consensus.cc:2272] T 1eb0334c49a64982bb8e7e8012f3d2bd P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.774278   431 tablet_replica.cc:333] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.775022   431 raft_consensus.cc:2243] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.775880   431 raft_consensus.cc:2272] T 6094a1680fae4dda92e51818bff11c62 P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.778196   431 tablet_replica.cc:333] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.778851   431 raft_consensus.cc:2243] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.779274   431 raft_consensus.cc:2272] T 1ab642d504da4abb8b61a7228f068023 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.781493   431 tablet_replica.cc:333] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.782076   431 raft_consensus.cc:2243] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.782534   431 raft_consensus.cc:2272] T 6b8d914359c848c8bfa65ec73e5c6d0b P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.784801   431 tablet_replica.cc:333] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.785332   431 raft_consensus.cc:2243] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.785735   431 raft_consensus.cc:2272] T 13b74d76ad0d4e35a7c3b7a4b0167686 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.787683   431 tablet_replica.cc:333] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.788200   431 raft_consensus.cc:2243] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.788650   431 raft_consensus.cc:2272] T 8282a433fc234c42aad9a6b1fde1a50c P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.790596   431 tablet_replica.cc:333] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.791098   431 raft_consensus.cc:2243] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.791523   431 raft_consensus.cc:2272] T 659b1001b708481eb6babdb52ee14932 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.793740   431 tablet_replica.cc:333] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.794271   431 raft_consensus.cc:2243] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.795100   431 raft_consensus.cc:2272] T ebccc43d996443238d52afdd0323755a P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.797271   431 tablet_replica.cc:333] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.797844   431 raft_consensus.cc:2243] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.798262   431 raft_consensus.cc:2272] T 5c4f277c23d54d11b7d393c145245d1e P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.800237   431 tablet_replica.cc:333] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.800801   431 raft_consensus.cc:2243] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.801257   431 raft_consensus.cc:2272] T 67f457232dbf490fb66e384f63359610 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.804152   431 tablet_replica.cc:333] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.804962   431 raft_consensus.cc:2243] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.805632   431 raft_consensus.cc:2272] T c4dca27bf6224160ba27d407ea1d20ba P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.808667   431 tablet_replica.cc:333] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
W20260709 13:04:45.809067 12431 consensus_peers.cc:597] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 -> Peer 6238ce107b1e4c74b68b3de891221b4b (127.0.107.193:38435): Couldn't send request to peer 6238ce107b1e4c74b68b3de891221b4b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.809347   431 raft_consensus.cc:2243] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.810007   431 raft_consensus.cc:2272] T b2d4386e4347499b96d944de923000e9 P f136be7f233943ddbb244c5daa113417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.812467   431 tablet_replica.cc:333] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.813050   431 raft_consensus.cc:2243] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.813476   431 raft_consensus.cc:2272] T e4f06730d1ea4198bd857096eacfb65b P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.815590   431 tablet_replica.cc:333] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.816147   431 raft_consensus.cc:2243] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.816624   431 raft_consensus.cc:2272] T dd0a01ec67624b9e88449d8d99be02ed P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.818768   431 tablet_replica.cc:333] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.819348   431 raft_consensus.cc:2243] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.820397   431 raft_consensus.cc:2272] T e44692cdc9a94782913b2c1c403cf937 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.822602   431 tablet_replica.cc:333] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.823206   431 raft_consensus.cc:2243] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.824224   431 raft_consensus.cc:2272] T aa524d31b65740f2a7ffbefe4378e017 P f136be7f233943ddbb244c5daa113417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.826503   431 tablet_replica.cc:333] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417: stopping tablet replica
I20260709 13:04:45.827039   431 raft_consensus.cc:2243] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.827863   431 raft_consensus.cc:2272] T 10b9ba9b18e24dd3b400e9eaf11be37d P f136be7f233943ddbb244c5daa113417 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:45.867169 12504 consensus_peers.cc:597] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Couldn't send request to peer f136be7f233943ddbb244c5daa113417. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.870911   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:45.908861   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:45.911715 12504 consensus_peers.cc:597] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Couldn't send request to peer f136be7f233943ddbb244c5daa113417. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.946722   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.947710   431 tablet_replica.cc:333] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.948653   431 raft_consensus.cc:2243] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.949378   431 raft_consensus.cc:2272] T 6094a1680fae4dda92e51818bff11c62 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.951845   431 tablet_replica.cc:333] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.952780   431 raft_consensus.cc:2243] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.953437   431 raft_consensus.cc:2272] T 1eb0334c49a64982bb8e7e8012f3d2bd P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.956008   431 tablet_replica.cc:333] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.956777   431 raft_consensus.cc:2243] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:45.957342 12504 consensus_peers.cc:597] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 -> Peer f136be7f233943ddbb244c5daa113417 (127.0.107.194:33265): Couldn't send request to peer f136be7f233943ddbb244c5daa113417. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.957615   431 raft_consensus.cc:2272] T dd0a01ec67624b9e88449d8d99be02ed P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.959877   431 tablet_replica.cc:333] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.960551   431 raft_consensus.cc:2243] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.960985   431 raft_consensus.cc:2272] T eba31db3d899450aabc23cb49e47b745 P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.962913   431 tablet_replica.cc:333] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.963456   431 raft_consensus.cc:2243] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.963882   431 raft_consensus.cc:2272] T 659b1001b708481eb6babdb52ee14932 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.965909   431 tablet_replica.cc:333] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.966436   431 raft_consensus.cc:2243] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.967146   431 raft_consensus.cc:2272] T 1ab642d504da4abb8b61a7228f068023 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.969054   431 tablet_replica.cc:333] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.969586   431 raft_consensus.cc:2243] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.970258   431 raft_consensus.cc:2272] T b2d4386e4347499b96d944de923000e9 P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.972201   431 tablet_replica.cc:333] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.972760   431 raft_consensus.cc:2243] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.973173   431 raft_consensus.cc:2272] T c4dca27bf6224160ba27d407ea1d20ba P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.974941   431 tablet_replica.cc:333] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.975450   431 raft_consensus.cc:2243] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.975880   431 raft_consensus.cc:2272] T e4f06730d1ea4198bd857096eacfb65b P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.977916   431 tablet_replica.cc:333] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.978447   431 raft_consensus.cc:2243] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.978869   431 raft_consensus.cc:2272] T aa524d31b65740f2a7ffbefe4378e017 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.980752   431 tablet_replica.cc:333] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.981287   431 raft_consensus.cc:2243] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.981678   431 raft_consensus.cc:2272] T 10b9ba9b18e24dd3b400e9eaf11be37d P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.983659   431 tablet_replica.cc:333] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.984200   431 raft_consensus.cc:2243] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.984659   431 raft_consensus.cc:2272] T e44692cdc9a94782913b2c1c403cf937 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.986768   431 tablet_replica.cc:333] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.987306   431 raft_consensus.cc:2243] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.988075   431 raft_consensus.cc:2272] T 13b74d76ad0d4e35a7c3b7a4b0167686 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.990247   431 tablet_replica.cc:333] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.990828   431 raft_consensus.cc:2243] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.991255   431 raft_consensus.cc:2272] T 6b8d914359c848c8bfa65ec73e5c6d0b P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.993206   431 tablet_replica.cc:333] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.993716   431 raft_consensus.cc:2243] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.994477   431 raft_consensus.cc:2272] T 5c4f277c23d54d11b7d393c145245d1e P e0d2fe5f6fd0439592482c881fb7bca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.996431   431 tablet_replica.cc:333] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.996915   431 raft_consensus.cc:2243] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.997330   431 raft_consensus.cc:2272] T 67f457232dbf490fb66e384f63359610 P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.999214   431 tablet_replica.cc:333] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:45.999826   431 raft_consensus.cc:2243] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.000253   431 raft_consensus.cc:2272] T ebccc43d996443238d52afdd0323755a P e0d2fe5f6fd0439592482c881fb7bca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.002302   431 tablet_replica.cc:333] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5: stopping tablet replica
I20260709 13:04:46.002782   431 raft_consensus.cc:2243] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.003568   431 raft_consensus.cc:2272] T 8282a433fc234c42aad9a6b1fde1a50c P e0d2fe5f6fd0439592482c881fb7bca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.045337   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:46.076582   431 master.cc:562] Master@127.0.107.254:38963 shutting down...
I20260709 13:04:46.097075   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.097622   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.097916   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P bab9a74134ce4b18a16445772f190dbd: stopping tablet replica
I20260709 13:04:46.119923   431 master.cc:584] Master@127.0.107.254:38963 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12795 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:04:46.175364   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35753
I20260709 13:04:46.176623   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.182989 12858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.183748 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.185814   431 server_base.cc:1061] running on GCE node
W20260709 13:04:46.186177 12861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.187202   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.187458   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.187641   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602286187623 us; error 0 us; skew 500 ppm
I20260709 13:04:46.188354   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.198159   431 webserver.cc:533] Webserver started at http://127.0.107.254:45553/ using document root <none> and password file <none>
I20260709 13:04:46.198838   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.199057   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.199363   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.200770   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/master-0-root/instance:
uuid: "5a18d2d0beb14a8c8b89ad87c77715aa"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.205823   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:04:46.209161 12866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.209878   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:46.210144   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/master-0-root
uuid: "5a18d2d0beb14a8c8b89ad87c77715aa"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.210397   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.222393   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.223635   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.266443   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35753
I20260709 13:04:46.266582 12917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35753 every 8 connection(s)
I20260709 13:04:46.270759 12918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.283072 12918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: Bootstrap starting.
I20260709 13:04:46.288230 12918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.292927 12918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: No bootstrap required, opened a new log
I20260709 13:04:46.295189 12918 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER }
I20260709 13:04:46.295595 12918 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.295840 12918 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a18d2d0beb14a8c8b89ad87c77715aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.296446 12918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER }
I20260709 13:04:46.296886 12918 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:46.297077 12918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:46.297288 12918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.302381 12918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER }
I20260709 13:04:46.302929 12918 leader_election.cc:304] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a18d2d0beb14a8c8b89ad87c77715aa; no voters: 
I20260709 13:04:46.304174 12918 leader_election.cc:290] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:46.304548 12921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.306025 12921 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 1 LEADER]: Becoming Leader. State: Replica: 5a18d2d0beb14a8c8b89ad87c77715aa, State: Running, Role: LEADER
I20260709 13:04:46.306692 12921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER }
I20260709 13:04:46.307366 12918 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:46.311301 12923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a18d2d0beb14a8c8b89ad87c77715aa. Latest consensus state: current_term: 1 leader_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER } }
I20260709 13:04:46.312244 12923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.311262 12922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a18d2d0beb14a8c8b89ad87c77715aa" member_type: VOTER } }
I20260709 13:04:46.313027 12922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.317512 12927 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:46.323458 12927 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:46.324440   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:46.332638 12927 catalog_manager.cc:1383] Generated new cluster ID: e7ece72b78fa4a7b9501f99eeee588b0
I20260709 13:04:46.332958 12927 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:46.368180 12927 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:46.369544 12927 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:46.384006 12927 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: Generated new TSK 0
I20260709 13:04:46.384788 12927 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:46.391264   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.398083 12939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.398547 12940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.402426 12942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.402629   431 server_base.cc:1061] running on GCE node
I20260709 13:04:46.403682   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.403885   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.404007   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602286403996 us; error 0 us; skew 500 ppm
I20260709 13:04:46.404526   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.406993   431 webserver.cc:533] Webserver started at http://127.0.107.193:46841/ using document root <none> and password file <none>
I20260709 13:04:46.407424   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.407572   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.407778   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.408934   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-0-root/instance:
uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.413450   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:46.417178 12947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.418095   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:46.418392   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-0-root
uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.418679   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.433779   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.434999   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.436666   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:46.439240   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:46.439465   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.439908   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:46.440167   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.485628   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33691
I20260709 13:04:46.485757 13009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33691 every 8 connection(s)
I20260709 13:04:46.491196   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.499233 13014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.501688 13015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.505005 13017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.506496   431 server_base.cc:1061] running on GCE node
I20260709 13:04:46.506842 13010 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35753
I20260709 13:04:46.507290 13010 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:46.507619   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.507884   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.508041 13010 heartbeater.cc:507] Master 127.0.107.254:35753 requested a full tablet report, sending...
I20260709 13:04:46.508049   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602286508031 us; error 0 us; skew 500 ppm
I20260709 13:04:46.508981   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.510512 12883 ts_manager.cc:194] Registered new tserver with Master: e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691)
I20260709 13:04:46.511754   431 webserver.cc:533] Webserver started at http://127.0.107.194:40593/ using document root <none> and password file <none>
I20260709 13:04:46.512408   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.512598   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.512590 12883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41076
I20260709 13:04:46.513089   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.514448   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-1-root/instance:
uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.519080   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:46.523160 13022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.524520   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:04:46.524847   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-1-root
uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.525137   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.544278   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.545588   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.547089   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:46.549490   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:46.549721   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.549993   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:46.550154   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.593892   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39565
I20260709 13:04:46.594018 13084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39565 every 8 connection(s)
I20260709 13:04:46.599314   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.606997 13088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.607558 13089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.609598   431 server_base.cc:1061] running on GCE node
W20260709 13:04:46.610575 13091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.611683   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.611989   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.612203   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602286612185 us; error 0 us; skew 500 ppm
I20260709 13:04:46.612850   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.612792 13085 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35753
I20260709 13:04:46.613471 13085 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:46.614409 13085 heartbeater.cc:507] Master 127.0.107.254:35753 requested a full tablet report, sending...
I20260709 13:04:46.616036   431 webserver.cc:533] Webserver started at http://127.0.107.195:41885/ using document root <none> and password file <none>
I20260709 13:04:46.616694   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.616897   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.616902 12883 ts_manager.cc:194] Registered new tserver with Master: f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:46.617242   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.618637 12883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41078
I20260709 13:04:46.618690   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-2-root/instance:
uuid: "c9234ca90d6f47ec9da746900014f94e"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.624177   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:46.628672 13096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.629659   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:46.630007   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-2-root
uuid: "c9234ca90d6f47ec9da746900014f94e"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-021n"
I20260709 13:04:46.630296   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska_0rGn/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601936857634-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.656569   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.657878   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.659447   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:46.661775   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:46.661953   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.662192   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:46.662339   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.705819   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41979
I20260709 13:04:46.705938 13158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41979 every 8 connection(s)
I20260709 13:04:46.722332 13159 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35753
I20260709 13:04:46.722798 13159 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:46.723546 13159 heartbeater.cc:507] Master 127.0.107.254:35753 requested a full tablet report, sending...
I20260709 13:04:46.725687 12883 ts_manager.cc:194] Registered new tserver with Master: c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:46.726114   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016791766s
I20260709 13:04:46.727435 12883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41092
I20260709 13:04:46.753679 12883 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41104:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:46.756632 12883 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:46.844777 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3ea38d9225417ab87c10e48c5193ef (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:46.846446 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3ea38d9225417ab87c10e48c5193ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.846688 13047 tablet_service.cc:1511] Processing CreateTablet for tablet f811aa4c44b145308d5fa68235631281 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:46.848171 13047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f811aa4c44b145308d5fa68235631281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.851755 13048 tablet_service.cc:1511] Processing CreateTablet for tablet 89b173ad655e438291e88fc6a7920bbc (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:46.853361 13048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b173ad655e438291e88fc6a7920bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.854981 12975 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3ea38d9225417ab87c10e48c5193ef (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:46.856016 13049 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee261e2164d4d3884057e39a644d70b (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:46.857430 13049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee261e2164d4d3884057e39a644d70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.858639 12973 tablet_service.cc:1511] Processing CreateTablet for tablet 89b173ad655e438291e88fc6a7920bbc (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:46.861052 12972 tablet_service.cc:1511] Processing CreateTablet for tablet f811aa4c44b145308d5fa68235631281 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:46.863269 12971 tablet_service.cc:1511] Processing CreateTablet for tablet 83e39c10c6de461eb4a55cc7e17f4f4e (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:46.865468 12970 tablet_service.cc:1511] Processing CreateTablet for tablet 66a132b6257f470795d0fec8310b9cc8 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:46.867439 13046 tablet_service.cc:1511] Processing CreateTablet for tablet 83e39c10c6de461eb4a55cc7e17f4f4e (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:46.867733 13042 tablet_service.cc:1511] Processing CreateTablet for tablet 408806ab563f45b9b95c3fade2a5457a (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:46.868921 13046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e39c10c6de461eb4a55cc7e17f4f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.870447 13043 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:46.872555 13044 tablet_service.cc:1511] Processing CreateTablet for tablet df2275545f3a4c9e8123f50fdf8174d9 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:46.874514 13045 tablet_service.cc:1511] Processing CreateTablet for tablet 66a132b6257f470795d0fec8310b9cc8 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:46.857358 12974 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee261e2164d4d3884057e39a644d70b (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:46.878103 12975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3ea38d9225417ab87c10e48c5193ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.879245 13043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.881363 12970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a132b6257f470795d0fec8310b9cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.884780 12973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b173ad655e438291e88fc6a7920bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.885327 13122 tablet_service.cc:1511] Processing CreateTablet for tablet 89b173ad655e438291e88fc6a7920bbc (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:46.887073 12972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f811aa4c44b145308d5fa68235631281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.887246 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3ea38d9225417ab87c10e48c5193ef (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:46.889472 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 66a132b6257f470795d0fec8310b9cc8 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:46.889760 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee261e2164d4d3884057e39a644d70b (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:46.892012 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b173ad655e438291e88fc6a7920bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.887852 13121 tablet_service.cc:1511] Processing CreateTablet for tablet f811aa4c44b145308d5fa68235631281 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:46.893668 13117 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:46.894294 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f811aa4c44b145308d5fa68235631281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.895028 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3ea38d9225417ab87c10e48c5193ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.895697 13044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2275545f3a4c9e8123f50fdf8174d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.895485 12969 tablet_service.cc:1511] Processing CreateTablet for tablet df2275545f3a4c9e8123f50fdf8174d9 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:46.898214 13116 tablet_service.cc:1511] Processing CreateTablet for tablet 408806ab563f45b9b95c3fade2a5457a (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:46.899828 13042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408806ab563f45b9b95c3fade2a5457a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.901203 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 83e39c10c6de461eb4a55cc7e17f4f4e (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:46.903260 12968 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:46.904731 13118 tablet_service.cc:1511] Processing CreateTablet for tablet df2275545f3a4c9e8123f50fdf8174d9 (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:46.906418 12967 tablet_service.cc:1511] Processing CreateTablet for tablet 408806ab563f45b9b95c3fade2a5457a (DEFAULT_TABLE table=test-workload [id=e4ae73b92bab46c89d1b1251198a23bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:46.907898 12968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.908890 12967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408806ab563f45b9b95c3fade2a5457a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.912427 12969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2275545f3a4c9e8123f50fdf8174d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.899883 13116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408806ab563f45b9b95c3fade2a5457a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.916497 13045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a132b6257f470795d0fec8310b9cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.918738 12974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee261e2164d4d3884057e39a644d70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.922200 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2275545f3a4c9e8123f50fdf8174d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.924625 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee261e2164d4d3884057e39a644d70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.928752 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e39c10c6de461eb4a55cc7e17f4f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.932679 13117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2ab5535d94eb5aa2ad572b3ed3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.922427 12971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e39c10c6de461eb4a55cc7e17f4f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.936699 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a132b6257f470795d0fec8310b9cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.000699 13174 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.031401 13174 tablet_bootstrap.cc:654] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.033030 13175 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.036882 13176 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.072717 13175 tablet_bootstrap.cc:654] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.078649 13174 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.079139 13174 ts_tablet_manager.cc:1403] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.022s
I20260709 13:04:47.081954 13174 raft_consensus.cc:359] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.082648 13174 raft_consensus.cc:385] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.082968 13174 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.083730 13174 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.084342 13175 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.084355 13176 tablet_bootstrap.cc:654] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.084900 13175 ts_tablet_manager.cc:1403] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.006s
I20260709 13:04:47.087739 13085 heartbeater.cc:499] Master 127.0.107.254:35753 was elected leader, sending a full tablet report...
I20260709 13:04:47.088142 13174 ts_tablet_manager.cc:1434] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:04:47.088128 13175 raft_consensus.cc:359] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.088936 13175 raft_consensus.cc:385] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.089231 13175 raft_consensus.cc:740] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.089504 13174 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.090240 13175 consensus_queue.cc:260] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.093529 13159 heartbeater.cc:499] Master 127.0.107.254:35753 was elected leader, sending a full tablet report...
I20260709 13:04:47.095350 13176 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.095860 13176 ts_tablet_manager.cc:1403] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.009s
I20260709 13:04:47.095888 13174 tablet_bootstrap.cc:654] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.099076 13176 raft_consensus.cc:359] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.099929 13176 raft_consensus.cc:385] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.100235 13176 raft_consensus.cc:740] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.100970 13176 consensus_queue.cc:260] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.102270 13175 ts_tablet_manager.cc:1434] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:04:47.103504 13175 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.111397 13175 tablet_bootstrap.cc:654] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.115177 13174 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.115872 13174 ts_tablet_manager.cc:1403] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.013s
I20260709 13:04:47.119472 13174 raft_consensus.cc:359] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.120594 13174 raft_consensus.cc:385] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.120924 13174 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.121977 13174 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.124950 13174 ts_tablet_manager.cc:1434] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:04:47.126165 13174 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.136891 13174 tablet_bootstrap.cc:654] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.153030 13010 heartbeater.cc:499] Master 127.0.107.254:35753 was elected leader, sending a full tablet report...
I20260709 13:04:47.154352 13176 ts_tablet_manager.cc:1434] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.058s	user 0.018s	sys 0.037s
I20260709 13:04:47.155675 13176 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.156527 13175 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.156963 13174 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.157140 13175 ts_tablet_manager.cc:1403] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.025s
I20260709 13:04:47.157642 13174 ts_tablet_manager.cc:1403] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 13:04:47.160667 13175 raft_consensus.cc:359] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.160961 13174 raft_consensus.cc:359] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.161576 13175 raft_consensus.cc:385] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.162041 13174 raft_consensus.cc:385] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.162081 13175 raft_consensus.cc:740] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.162585 13176 tablet_bootstrap.cc:654] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.162683 13174 raft_consensus.cc:740] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.163344 13175 consensus_queue.cc:260] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.163975 13174 consensus_queue.cc:260] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.166638 13174 ts_tablet_manager.cc:1434] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:47.167695 13174 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.174319 13174 tablet_bootstrap.cc:654] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.177783 13175 ts_tablet_manager.cc:1434] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:04:47.179227 13175 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.187155 13175 tablet_bootstrap.cc:654] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.193186 13176 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.193704 13176 ts_tablet_manager.cc:1403] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.015s
I20260709 13:04:47.193846 13174 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.194447 13174 ts_tablet_manager.cc:1403] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:04:47.195655 13175 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.196111 13175 ts_tablet_manager.cc:1403] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 13:04:47.196789 13176 raft_consensus.cc:359] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.197597 13176 raft_consensus.cc:385] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.197340 13174 raft_consensus.cc:359] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.197741 13181 raft_consensus.cc:493] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.197906 13176 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.198257 13174 raft_consensus.cc:385] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.198637 13174 raft_consensus.cc:740] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.198577 13181 raft_consensus.cc:515] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.198911 13175 raft_consensus.cc:359] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.199167 13176 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.199791 13175 raft_consensus.cc:385] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.200341 13175 raft_consensus.cc:740] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.201151 13175 consensus_queue.cc:260] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.201588 13176 ts_tablet_manager.cc:1434] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:04:47.199630 13174 consensus_queue.cc:260] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.202885 13176 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.204506 13174 ts_tablet_manager.cc:1434] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:04:47.205570 13174 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.207922 13183 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.208511 13183 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.209998 13176 tablet_bootstrap.cc:654] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.212718 13174 tablet_bootstrap.cc:654] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.214253 13183 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.218905 13179 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.219538 13179 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.229697 13179 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.251863 13181 leader_election.cc:290] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.261032 13181 raft_consensus.cc:493] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.261783 13181 raft_consensus.cc:515] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.268277 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
W20260709 13:04:47.270556 12951 leader_election.cc:343] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.282373 13181 leader_election.cc:290] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.286458 13179 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.287096 13179 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.289317 13179 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.294833 13183 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.295601 13183 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.299270 13183 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.300974 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
W20260709 13:04:47.303788 12951 leader_election.cc:343] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.306941 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.308696 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.309051 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.310540 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.311290 13059 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
W20260709 13:04:47.312772 13099 leader_election.cc:343] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:47.313472 13099 leader_election.cc:343] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:47.318471 12931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:47.321542 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
W20260709 13:04:47.322041 12948 leader_election.cc:343] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.321542 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.322582 12948 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.323397 13183 raft_consensus.cc:2749] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.323809 12948 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:47.324769 13183 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.325245 13183 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.325659 13183 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.325248 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.323845 13134 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
W20260709 13:04:47.323457 13026 leader_election.cc:343] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.328720 13026 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
W20260709 13:04:47.330238 13097 leader_election.cc:343] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.330857 13097 leader_election.cc:304] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.334028 13181 raft_consensus.cc:2749] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.334347 13183 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.337579 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.325732 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.338261 13060 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.339244 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.340739 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.340708 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
W20260709 13:04:47.343302 12951 leader_election.cc:343] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.342089 13183 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
W20260709 13:04:47.345448 13097 leader_election.cc:343] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.346457 13097 leader_election.cc:304] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.346915 13060 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:47.347726 13181 raft_consensus.cc:2749] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.348178 12948 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:47.348645 13179 raft_consensus.cc:2804] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.349054 13179 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.349371 13179 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.349431 13183 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:47.344921 13025 leader_election.cc:343] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.351326 13183 raft_consensus.cc:697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
W20260709 13:04:47.355540 13025 leader_election.cc:343] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.355589 13183 consensus_queue.cc:237] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.356129 13025 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.361102 13179 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.363714 13179 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.365254 13179 raft_consensus.cc:2749] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.365396 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.361693 13174 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.367722 13134 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.368352 13174 ts_tablet_manager.cc:1403] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.163s	user 0.066s	sys 0.074s
I20260709 13:04:47.371629 13174 raft_consensus.cc:359] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.366976 13175 ts_tablet_manager.cc:1434] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.171s	user 0.026s	sys 0.024s
I20260709 13:04:47.372603 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.373978 13175 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
W20260709 13:04:47.374392 13025 leader_election.cc:343] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.375710 13134 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:47.366555 13176 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.376725 13176 ts_tablet_manager.cc:1403] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.174s	user 0.040s	sys 0.080s
I20260709 13:04:47.376797 12880 catalog_manager.cc:5697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.379065 13174 raft_consensus.cc:385] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.379412 13174 raft_consensus.cc:740] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.380244 13174 consensus_queue.cc:260] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.380405 13176 raft_consensus.cc:359] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.381392 13176 raft_consensus.cc:385] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.381760 13176 raft_consensus.cc:740] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.382643 13176 consensus_queue.cc:260] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.383116 13174 ts_tablet_manager.cc:1434] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:47.384361 13174 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.384268 13026 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.385689 13179 raft_consensus.cc:2804] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.387037 13175 tablet_bootstrap.cc:654] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.388049 13176 ts_tablet_manager.cc:1434] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:04:47.389261 13176 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.391081 13174 tablet_bootstrap.cc:654] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.396096 13176 tablet_bootstrap.cc:654] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.402148 13179 raft_consensus.cc:697] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:47.403654 13179 consensus_queue.cc:237] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.410953 13175 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.411651 13175 ts_tablet_manager.cc:1403] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.005s
I20260709 13:04:47.416220 13174 tablet_bootstrap.cc:492] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.417039 13174 ts_tablet_manager.cc:1403] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.007s
I20260709 13:04:47.415580 13175 raft_consensus.cc:359] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.419919 13175 raft_consensus.cc:385] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.420275 13175 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.420866 13174 raft_consensus.cc:359] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.421727 13174 raft_consensus.cc:385] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.422122 13174 raft_consensus.cc:740] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.421535 13175 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.423032 13174 consensus_queue.cc:260] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.424367 13176 tablet_bootstrap.cc:492] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.424476 13175 ts_tablet_manager.cc:1434] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:04:47.425365 13176 ts_tablet_manager.cc:1403] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
I20260709 13:04:47.425879 13174 ts_tablet_manager.cc:1434] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:47.426004 13175 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.427054 13174 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.428911 13176 raft_consensus.cc:359] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.429716 13176 raft_consensus.cc:385] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.430066 13176 raft_consensus.cc:740] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.430240 12880 catalog_manager.cc:5697] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.431200 13176 consensus_queue.cc:260] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.433712 13176 ts_tablet_manager.cc:1434] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:47.434173 13174 tablet_bootstrap.cc:654] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.435068 13176 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.440172 13189 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.441077 13189 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.442270 13176 tablet_bootstrap.cc:654] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.444597 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
W20260709 13:04:47.446494 13099 leader_election.cc:343] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.447814 13189 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.450191 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.451216 13060 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:47.453125 13097 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.456207 13189 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.456907 13189 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.457360 13189 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.476800 13174 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.477466 13174 ts_tablet_manager.cc:1403] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.028s
I20260709 13:04:47.480866 13174 raft_consensus.cc:359] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.481595 13174 raft_consensus.cc:385] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.481860 13174 raft_consensus.cc:740] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.482568 13174 consensus_queue.cc:260] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.483314 13189 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.485203 13174 ts_tablet_manager.cc:1434] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:47.486498 13174 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.486461 13179 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.487056 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.487193 13179 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
W20260709 13:04:47.489002 13099 leader_election.cc:343] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.489645 13179 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.491794 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
W20260709 13:04:47.493623 13026 leader_election.cc:343] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.494625 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
W20260709 13:04:47.496526 13025 leader_election.cc:343] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.497185 13174 tablet_bootstrap.cc:654] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.497048 13025 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.498262 13175 tablet_bootstrap.cc:654] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.498514 13179 raft_consensus.cc:2749] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.503620 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.503815 13189 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.504299 13060 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.505234 13174 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.505559 13176 tablet_bootstrap.cc:492] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.506073 13174 ts_tablet_manager.cc:1403] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.007s
I20260709 13:04:47.506134 13176 ts_tablet_manager.cc:1403] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.040s
I20260709 13:04:47.506497 13175 tablet_bootstrap.cc:492] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.507256 13175 ts_tablet_manager.cc:1403] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.081s	user 0.004s	sys 0.009s
I20260709 13:04:47.509816 13174 raft_consensus.cc:359] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.510316 13176 raft_consensus.cc:359] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.510854 13174 raft_consensus.cc:385] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.511191 13176 raft_consensus.cc:385] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.510636 13175 raft_consensus.cc:359] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.511912 13174 raft_consensus.cc:740] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.512056 13176 raft_consensus.cc:740] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.512394 13175 raft_consensus.cc:385] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.512825 13175 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.513187 13060 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:47.513083 13176 consensus_queue.cc:260] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.513083 13174 consensus_queue.cc:260] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.513801 13175 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.515004 13097 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.516369 13189 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.516942 13189 raft_consensus.cc:697] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:47.517825 13189 consensus_queue.cc:237] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.523247 13176 ts_tablet_manager.cc:1434] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:04:47.524611 13176 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.525312 13174 ts_tablet_manager.cc:1434] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:04:47.531785 13176 tablet_bootstrap.cc:654] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.533865 13174 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:47.538383 12882 catalog_manager.cc:5697] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 0 to 1, leader changed from <none> to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.539597 13176 tablet_bootstrap.cc:492] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.540185 13176 ts_tablet_manager.cc:1403] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:04:47.540544 13174 tablet_bootstrap.cc:654] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.542634 13175 ts_tablet_manager.cc:1434] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:04:47.543429 13176 raft_consensus.cc:359] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.543897 13175 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.544235 13176 raft_consensus.cc:385] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.544842 13176 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.548090 13176 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.551046 13175 tablet_bootstrap.cc:654] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.553937 13176 ts_tablet_manager.cc:1434] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:47.554692 13174 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:47.555225 13176 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.555296 13174 ts_tablet_manager.cc:1403] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:04:47.558624 13174 raft_consensus.cc:359] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.559551 13174 raft_consensus.cc:385] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.559919 13174 raft_consensus.cc:740] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.560873 13174 consensus_queue.cc:260] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.563144 13176 tablet_bootstrap.cc:654] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.569439 13174 ts_tablet_manager.cc:1434] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:04:47.573318 13175 tablet_bootstrap.cc:492] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.573897 13175 ts_tablet_manager.cc:1403] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.013s
I20260709 13:04:47.574779 13176 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.575418 13176 ts_tablet_manager.cc:1403] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.012s
I20260709 13:04:47.576470 13175 raft_consensus.cc:359] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.577164 13175 raft_consensus.cc:385] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.577521 13175 raft_consensus.cc:740] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.578420 13175 consensus_queue.cc:260] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.578774 13176 raft_consensus.cc:359] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.579516 13176 raft_consensus.cc:385] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.579787 13176 raft_consensus.cc:740] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.580689 13175 ts_tablet_manager.cc:1434] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:04:47.580801 13176 consensus_queue.cc:260] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.582118 13175 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.585381 13176 ts_tablet_manager.cc:1434] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:47.586546 13176 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.589320 13175 tablet_bootstrap.cc:654] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.595978 13179 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.596207 13176 tablet_bootstrap.cc:654] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.596642 13179 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.599768 13179 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.600247 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.600732 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.602290 13175 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
W20260709 13:04:47.602522 13026 leader_election.cc:343] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.603065 13175 ts_tablet_manager.cc:1403] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
W20260709 13:04:47.603224 13025 leader_election.cc:343] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.603744 13176 tablet_bootstrap.cc:492] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.604384 13176 ts_tablet_manager.cc:1403] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:04:47.604060 13025 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.605293 13179 raft_consensus.cc:2749] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.606941 13175 raft_consensus.cc:359] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.607085 13176 raft_consensus.cc:359] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.607729 13175 raft_consensus.cc:385] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.607815 13176 raft_consensus.cc:385] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.608039 13175 raft_consensus.cc:740] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.608153 13176 raft_consensus.cc:740] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.608908 13175 consensus_queue.cc:260] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.609020 13176 consensus_queue.cc:260] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.611160 13175 ts_tablet_manager.cc:1434] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:47.612512 13175 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.613713 13176 ts_tablet_manager.cc:1434] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:47.614811 13176 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:47.619752 13175 tablet_bootstrap.cc:654] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.620411 13176 tablet_bootstrap.cc:654] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.627647 13183 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.628274 13183 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.630565 13183 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.631493 13176 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:47.631750 13175 tablet_bootstrap.cc:492] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.632087 13176 ts_tablet_manager.cc:1403] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:04:47.632299 13175 ts_tablet_manager.cc:1403] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:04:47.632272 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.633898 13060 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:47.635008 13176 raft_consensus.cc:359] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.635180 12948 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.635578 13176 raft_consensus.cc:385] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.636118 13176 raft_consensus.cc:740] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.635516 13175 raft_consensus.cc:359] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.636195 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.636555 13175 raft_consensus.cc:385] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.636909 13175 raft_consensus.cc:740] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.636765 13176 consensus_queue.cc:260] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.637665 13175 consensus_queue.cc:260] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.638458 13183 raft_consensus.cc:2804] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:47.638213 12951 leader_election.cc:343] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.639741 13175 ts_tablet_manager.cc:1434] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:47.638872 13183 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.640189 13183 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.640914 13175 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:47.638895 13176 ts_tablet_manager.cc:1434] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:04:47.648126 13175 tablet_bootstrap.cc:654] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.648904 13179 raft_consensus.cc:493] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.649459 13179 raft_consensus.cc:515] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.651512 13179 leader_election.cc:290] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.652184 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.652921 12985 raft_consensus.cc:2468] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:47.653985 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.655203 13189 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.655678 13134 raft_consensus.cc:2468] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:47.655762 13189 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.654682 13025 leader_election.cc:304] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.657644 13179 raft_consensus.cc:2804] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.658105 13179 raft_consensus.cc:493] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.658473 13179 raft_consensus.cc:3060] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.659135 13199 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.659518 13199 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.660425 13175 tablet_bootstrap.cc:492] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:47.660996 13175 ts_tablet_manager.cc:1403] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:04:47.661348 13199 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.662099 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.662767 13060 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:47.663107 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.663748 13134 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:47.663967 12948 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.664166 13175 raft_consensus.cc:359] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.665069 13175 raft_consensus.cc:385] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.657936 13189 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.665629 13175 raft_consensus.cc:740] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.665536 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.666180 13199 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.666602 13199 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.666510 13175 consensus_queue.cc:260] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.667001 13199 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.667695 13181 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.668129 13181 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.668531 13175 ts_tablet_manager.cc:1434] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:47.670179 13181 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.671154 13179 raft_consensus.cc:515] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.665163 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.672863 13060 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:47.673816 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.674458 12984 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:47.674962 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.675572 13060 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:47.675608 13099 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:47.674656 13097 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.676612 13189 raft_consensus.cc:2804] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.676990 13189 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.677304 13189 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.678088 13181 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.678510 13181 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.678967 13181 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.679802 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.680481 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.681079 12984 raft_consensus.cc:3060] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.684463 13134 raft_consensus.cc:3060] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.684585 13179 leader_election.cc:290] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.684239 13189 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.688328 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.688998 12983 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.684509 13183 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.690985 13183 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.691911 13134 raft_consensus.cc:2468] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:47.684239 13199 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.688086 13181 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.692063 13179 raft_consensus.cc:493] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.692866 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.692818 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.693507 12985 raft_consensus.cc:2393] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:47.694020 13026 leader_election.cc:304] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.697361 13181 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.697896 13203 raft_consensus.cc:2804] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.696691 13199 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.698450 13203 raft_consensus.cc:697] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:47.699397 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.699275 13203 consensus_queue.cc:237] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.700169 12982 raft_consensus.cc:2393] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:47.700686 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.696645 13133 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.700094 12984 raft_consensus.cc:2468] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:47.702052 13134 raft_consensus.cc:2393] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e863e18bda0c4e6bb1cc6418867a0a90 in current term 1: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:47.695712 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.702955 13059 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.695878 13183 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.704104 13179 raft_consensus.cc:515] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.705876 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.707195 13189 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.703896 13183 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.708989 13133 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:47.709322 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.709945 13058 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.700986 13060 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.710057 12951 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:47.711062 13199 raft_consensus.cc:2804] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.711007 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.711865 13057 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:47.713683 13059 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:47.713517 12948 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.724114 12983 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:47.724583 13097 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.725458 13181 raft_consensus.cc:2749] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.725689 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.714730 13189 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.727535 13183 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.727658 13189 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.728965 13133 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:47.730666 13189 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.729583 13183 raft_consensus.cc:2804] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.731616 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.731992 13183 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.732519 13059 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:47.733044 13183 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.732244 12881 catalog_manager.cc:5697] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.733772 13097 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.734808 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.735577 13134 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:47.727026 13179 leader_election.cc:290] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979), e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691)
I20260709 13:04:47.737849 13058 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:47.738488 13026 leader_election.cc:304] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.742226 13183 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.742719 13199 raft_consensus.cc:697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:47.741981 13189 raft_consensus.cc:2804] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.743451 13189 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.743602 13097 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.743892 13189 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.743690 13199 consensus_queue.cc:237] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.744397 13179 raft_consensus.cc:2804] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.744812 13179 raft_consensus.cc:493] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.745141 13179 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.746318 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.746903 13058 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.748436 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.749312 12984 raft_consensus.cc:2393] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:47.749446 13181 raft_consensus.cc:2804] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.748378 12948 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:47.738659 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.741040 13060 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:47.752180 12983 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:47.750765 13181 raft_consensus.cc:697] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:47.750757 13226 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.754815 13226 raft_consensus.cc:697] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:47.753918 13189 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.757372 13181 consensus_queue.cc:237] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.759407 13179 raft_consensus.cc:515] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.761616 13189 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.755661 13226 consensus_queue.cc:237] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.762544 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.762655 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.763118 13134 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.763535 12983 raft_consensus.cc:2393] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:47.764568 13058 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:47.767962 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.769994 13179 leader_election.cc:290] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979), e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691)
I20260709 13:04:47.769224 13060 raft_consensus.cc:2393] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:47.771925 13183 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.772517 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.773002 12983 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.774320 12948 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.776580 13183 raft_consensus.cc:2804] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.771991 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:47.777292 13183 raft_consensus.cc:697] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:47.777580 13133 raft_consensus.cc:2393] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e863e18bda0c4e6bb1cc6418867a0a90 in current term 1: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:47.777534 12881 catalog_manager.cc:5697] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 0 to 1, leader changed from <none> to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.778281 13183 consensus_queue.cc:237] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.776594 13134 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:47.779973 13026 leader_election.cc:304] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:47.780623 13097 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.780798 13179 raft_consensus.cc:2804] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.781333 13179 raft_consensus.cc:697] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:47.782136 13179 consensus_queue.cc:237] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:47.783406 12882 catalog_manager.cc:5697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.786823 13226 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.786710 12983 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:47.787351 13226 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.789553 13226 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:47.790760 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:47.787118 13181 raft_consensus.cc:2749] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.799824 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.800933 13060 raft_consensus.cc:2393] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e863e18bda0c4e6bb1cc6418867a0a90 in current term 1: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:47.802491 12948 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:47.804031 13226 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.812067 12983 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.814432 13134 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.822285 13179 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.821686 12881 catalog_manager.cc:5697] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.823155 13181 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.823702 13181 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.826823 12882 catalog_manager.cc:5697] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.827765 13181 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.829173 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:47.829077 12882 catalog_manager.cc:5697] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.831676 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:47.832911 13183 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.834157 13060 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:47.835647 13097 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.838860 13181 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:47.834156 13226 raft_consensus.cc:2749] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.841053 13181 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:47.841574 13181 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.849668 13181 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.851797 13181 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:47.853236 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:47.857056 13203 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.858173 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:47.858867 13060 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.867221 13060 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 2.
I20260709 13:04:47.868609 13097 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:47.869915 13181 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.870469 13181 raft_consensus.cc:697] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:47.871354 13181 consensus_queue.cc:237] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.875025 13134 raft_consensus.cc:1240] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Rejecting Update request from peer e863e18bda0c4e6bb1cc6418867a0a90 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.875854 13060 raft_consensus.cc:1240] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Rejecting Update request from peer e863e18bda0c4e6bb1cc6418867a0a90 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.877898 13226 consensus_queue.cc:1059] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.878861 13183 raft_consensus.cc:3055] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.879276 13183 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:47.878952 13199 consensus_queue.cc:1059] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.880009 13199 consensus_queue.cc:1243] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer c9234ca90d6f47ec9da746900014f94e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:04:47.880767 13183 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:47.881783 13183 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.885650 12881 catalog_manager.cc:5697] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.959988 13181 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.971024 13189 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.029109 13060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:46626
I20260709 13:04:48.029639 13060 raft_consensus.cc:606] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:48.044215 13133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:41942
I20260709 13:04:48.044826 13133 raft_consensus.cc:606] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:48.050683 13060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:46626
I20260709 13:04:48.051227 13060 raft_consensus.cc:606] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:48.057617 13133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f811aa4c44b145308d5fa68235631281"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:41942
I20260709 13:04:48.058203 13133 raft_consensus.cc:606] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:48.072239 12983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:48.072794 12983 raft_consensus.cc:606] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:48.077982 13133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:41942
I20260709 13:04:48.078497 13133 raft_consensus.cc:606] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:48.086689 12983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:48.087199 12983 raft_consensus.cc:606] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:48.092159 12983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:48.092700 12983 raft_consensus.cc:606] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:48.095088 13203 consensus_queue.cc:1048] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.106563 13248 consensus_queue.cc:1048] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.143784 13183 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.150894 13199 raft_consensus.cc:993] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:04:48.151415 13226 raft_consensus.cc:1081] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:04:48.153282 13134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:41926
I20260709 13:04:48.154662 13134 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.155102 13134 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.157724 13227 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.162722 13226 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.163092 13134 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.169456 13134 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:48.169474 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:48.170774 12983 raft_consensus.cc:3055] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.171088 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:48.171136 12983 raft_consensus.cc:740] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.171891 13060 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.172449 12983 consensus_queue.cc:260] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.173323 13199 raft_consensus.cc:993] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.173846 13199 raft_consensus.cc:1081] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.174206 12983 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.179031 13058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46606
I20260709 13:04:48.181802 13058 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.182236 13058 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.183830 13227 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.185676 12983 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 2.
I20260709 13:04:48.186837 13060 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 2.
I20260709 13:04:48.187098 13099 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:48.188061 13189 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.188568 13189 raft_consensus.cc:697] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:48.189483 13189 consensus_queue.cc:237] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.191468 13058 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.197606 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:48.198182 13058 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.198256 12983 raft_consensus.cc:3055] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.198992 12983 raft_consensus.cc:740] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.199666 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.200450 13134 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.200074 12983 consensus_queue.cc:260] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.201546 12983 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.201697 13248 consensus_queue.cc:1048] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.208510 13134 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.209131 13189 consensus_queue.cc:1048] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.208983 12983 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.210083 13026 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.211828 13248 raft_consensus.cc:2804] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.212360 13248 raft_consensus.cc:697] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:48.213220 13248 consensus_queue.cc:237] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.218463 13203 consensus_queue.cc:1048] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.227677 13229 raft_consensus.cc:993] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.226462 12879 catalog_manager.cc:5697] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.228250 13229 raft_consensus.cc:1081] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.230654 13060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46620
I20260709 13:04:48.233114 13060 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.233577 13060 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.235248 13229 consensus_queue.cc:1048] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.235821 13203 raft_consensus.cc:993] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.236418 13255 raft_consensus.cc:1081] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.238197 12983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40124
I20260709 13:04:48.238868 12983 raft_consensus.cc:493] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.239266 12983 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.243292 13060 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.245992 12983 raft_consensus.cc:515] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:48.246968 12984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:48.247171 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.247838 13133 raft_consensus.cc:3055] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.248131 13133 raft_consensus.cc:740] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:48.248716 12983 leader_election.cc:290] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Requested vote from peers c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:48.247583 12984 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.249387 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:48.248944 13133 consensus_queue.cc:260] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.249315 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.250198 13058 raft_consensus.cc:3055] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.250645 13134 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.250767 13058 raft_consensus.cc:740] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:48.251929 13058 consensus_queue.cc:260] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:48.253278 13058 raft_consensus.cc:3060] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.255752 12881 catalog_manager.cc:5697] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.257095 12984 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.258525 13134 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.261090 13025 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.261090 12951 leader_election.cc:304] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:48.262360 13200 raft_consensus.cc:2804] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.262979 13200 raft_consensus.cc:697] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:48.263078 13227 raft_consensus.cc:2804] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.263700 13227 raft_consensus.cc:697] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.263993 13200 consensus_queue.cc:237] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.264506 13227 consensus_queue.cc:237] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:48.266010 13058 raft_consensus.cc:2468] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.266876 13060 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.250598 13133 raft_consensus.cc:3060] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.277254 13133 raft_consensus.cc:2468] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.282322 12879 catalog_manager.cc:5697] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from c9234ca90d6f47ec9da746900014f94e (127.0.107.195) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.289290 13227 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.290516 12881 catalog_manager.cc:5697] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 1 to 2, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.302407 13199 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.312862 13226 raft_consensus.cc:993] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.313305 13199 raft_consensus.cc:1081] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:48.314778 13060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46606
I20260709 13:04:48.315366 13060 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.315765 13060 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.322458 13060 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.325657 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:48.326313 12983 raft_consensus.cc:3055] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.326786 12983 raft_consensus.cc:740] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.327646 12983 consensus_queue.cc:260] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.328555 13060 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.328773 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.329491 13133 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.330173 13255 raft_consensus.cc:993] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.328858 12983 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.330793 13255 raft_consensus.cc:1081] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.332859 12984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40124
I20260709 13:04:48.333478 12984 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.333868 12984 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.338719 12983 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.340183 13025 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.340972 13133 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:48.341117 13200 raft_consensus.cc:2804] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.341405 12984 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.341822 13200 raft_consensus.cc:697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:48.342648 13200 consensus_queue.cc:237] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.344414 12984 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.345432 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:48.345541 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.346177 13060 raft_consensus.cc:3055] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.346366 13133 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.346484 13060 raft_consensus.cc:740] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:48.347388 13060 consensus_queue.cc:260] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.348414 13060 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.353533 12881 catalog_manager.cc:5697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.355373 13133 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.355850 13060 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.357679 12948 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.359087 13199 raft_consensus.cc:2804] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.359572 13199 raft_consensus.cc:697] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.360729 13199 consensus_queue.cc:237] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.362180 13060 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.363786 13229 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.369242 12881 catalog_manager.cc:5697] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 1 to 2, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.375631 12984 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.379092 13181 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.386059 13189 raft_consensus.cc:993] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.386569 13181 raft_consensus.cc:1081] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.388041 12984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f811aa4c44b145308d5fa68235631281"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40114
I20260709 13:04:48.388656 12984 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.389048 12984 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.394975 12984 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.396839 12984 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.398254 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:48.398614 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.398891 13060 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.399241 13133 raft_consensus.cc:3055] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.399562 13133 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:48.400383 13133 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.401428 13133 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.404476 13060 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 3.
I20260709 13:04:48.405651 12948 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.406299 13199 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.406534 13133 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 3.
I20260709 13:04:48.406665 13199 raft_consensus.cc:697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.407437 13199 consensus_queue.cc:237] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.414064 12882 catalog_manager.cc:5697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 2 to 3, leader changed from c9234ca90d6f47ec9da746900014f94e (127.0.107.195) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.436717 13229 raft_consensus.cc:993] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.437166 13181 raft_consensus.cc:1081] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:48.438649 12984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40114
I20260709 13:04:48.439141 12984 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.439430 12984 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.444449 12984 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.445979 12984 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:48.446913 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:48.447001 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:48.447499 13060 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.447577 13133 raft_consensus.cc:3055] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.447980 13133 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:48.448673 13133 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.449632 13133 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.453114 13060 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.454332 12948 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:48.455132 13199 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.455055 13133 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:48.455895 13199 raft_consensus.cc:697] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:48.456796 13199 consensus_queue.cc:237] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:48.463469 12882 catalog_manager.cc:5697] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 1 to 2, leader changed from c9234ca90d6f47ec9da746900014f94e (127.0.107.195) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.590996 13060 raft_consensus.cc:1275] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.592365 13181 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.600615 12984 raft_consensus.cc:1275] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.602103 13229 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.614945 13133 raft_consensus.cc:1275] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.616479 13200 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.625582 12984 raft_consensus.cc:1275] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.627372 13203 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.765861 12984 raft_consensus.cc:1275] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.767253 13203 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.775195 13133 raft_consensus.cc:1275] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.776908 13248 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.795851 13133 raft_consensus.cc:1275] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.797669 13199 consensus_queue.cc:1048] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.805720 13060 raft_consensus.cc:1275] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.807044 13262 consensus_queue.cc:1048] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.815052 13060 raft_consensus.cc:1275] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.816356 13262 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.832089 13133 raft_consensus.cc:1275] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.834816 13262 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.835538 12984 raft_consensus.cc:1275] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.837805 13248 consensus_queue.cc:1048] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.849792 13134 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:48.850505 13133 raft_consensus.cc:1275] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.853144 13226 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:48.853600 13248 consensus_queue.cc:1048] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:04:48.866768 13060 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:48.868121 13263 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:48.980000 13060 raft_consensus.cc:1275] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.981357 13263 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.208228 13266 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.208890 13266 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.211292 13266 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.577303 13267 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.579174 13267 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.583289 13267 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.588704 13268 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.602974 13267 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.604126 13267 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.606515 13266 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.607157 13267 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.607800 13266 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.611332 13266 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.589705 13268 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.616192 13268 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.679747 13266 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.680868 13266 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.684173 13266 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.687247 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.688149 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.697333 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.705983 13276 raft_consensus.cc:493] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.707206 13276 raft_consensus.cc:515] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.719772 13273 raft_consensus.cc:493] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.721935 13273 raft_consensus.cc:515] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.745996 13283 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.746978 13283 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.750283 13283 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.750332 13270 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9234ca90d6f47ec9da746900014f94e)
I20260709 13:04:50.751024 13283 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.751392 13270 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.751734 13283 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.754022 13275 raft_consensus.cc:493] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.757534 13275 raft_consensus.cc:515] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.758627 13270 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.752744 13266 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9234ca90d6f47ec9da746900014f94e)
I20260709 13:04:50.760521 12981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.761299 12985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.762364 13266 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.762816 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.766607 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.767699 13059 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:50.768537 13273 leader_election.cc:290] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.769692 12948 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:50.768720 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.771979 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.775004 13273 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.775720 13273 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9234ca90d6f47ec9da746900014f94e)
I20260709 13:04:50.776221 13273 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.760006 13275 leader_election.cc:290] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.788602 13275 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f26aaafed2dc4853a7d606d8611f3b6e)
I20260709 13:04:50.788966 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.789341 13275 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.790145 13130 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:50.790828 13282 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.791563 13282 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.794641 13282 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.800475 13132 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:50.803778 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.804663 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.805925 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.806782 13130 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 3.
I20260709 13:04:50.812569 13276 leader_election.cc:290] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.813176 13275 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.814472 13283 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.818295 13026 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.819738 13266 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.819955 13270 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.821931 13278 raft_consensus.cc:493] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.822294 13270 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.822713 13270 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.822937 13278 raft_consensus.cc:515] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } } peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } }
I20260709 13:04:50.825877 13278 leader_election.cc:290] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:50.826179 13026 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.827893 13268 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:50.827950 13273 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.829581 13268 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.830904 13268 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.831434 12980 raft_consensus.cc:2393] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 3: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:50.834209 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.835248 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:50.838124 13026 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.839293 13269 raft_consensus.cc:2804] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.839416 13273 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.839792 13269 raft_consensus.cc:493] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e863e18bda0c4e6bb1cc6418867a0a90)
I20260709 13:04:50.840227 13269 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.841883 13059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.842660 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.842271 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.853952 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.856997 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.857194 13269 raft_consensus.cc:515] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.860661 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.861475 13270 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.863466 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.864566 13025 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.865788 13267 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.865960 13269 leader_election.cc:290] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.866587 13270 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.867192 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:50.869033 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:50.869273 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:50.869706 13132 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.870661 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.872483 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.874115 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:50.875154 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.876099 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.878187 13132 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 3.
I20260709 13:04:50.879220 13267 raft_consensus.cc:2749] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.881102 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3ea38d9225417ab87c10e48c5193ef" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:50.881273 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.881529 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a132b6257f470795d0fec8310b9cc8" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.882561 13026 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.883756 12980 raft_consensus.cc:1240] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Rejecting Update request from peer c9234ca90d6f47ec9da746900014f94e for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:50.884529 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b173ad655e438291e88fc6a7920bbc" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:50.885233 13267 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.885841 13267 raft_consensus.cc:697] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:50.885385 13131 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.885480 13268 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.887269 13267 consensus_queue.cc:237] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.886062 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.888774 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2275545f3a4c9e8123f50fdf8174d9" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.889585 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:50.889936 13134 raft_consensus.cc:1240] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Rejecting Update request from peer e863e18bda0c4e6bb1cc6418867a0a90 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:50.889192 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:50.891287 12951 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.893725 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:50.893983 12951 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.895045 13268 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 4 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:50.894893 13273 raft_consensus.cc:2749] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.895583 13280 raft_consensus.cc:2749] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.897598 12951 leader_election.cc:304] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.898924 13280 raft_consensus.cc:2749] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.898126 12879 catalog_manager.cc:5697] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 2 to 3, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.899430 12951 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.899930 13099 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.900906 13280 raft_consensus.cc:2749] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.901120 12951 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.901620 13285 raft_consensus.cc:2749] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:50.902408 13273 raft_consensus.cc:2749] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.902930 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:50.903141 13266 consensus_queue.cc:1059] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:50.901453 13099 leader_election.cc:304] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.904633 13266 raft_consensus.cc:3055] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.904592 13026 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.905143 13285 raft_consensus.cc:2749] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.905288 13266 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:50.906704 13099 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.906701 13266 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.907743 13285 raft_consensus.cc:2749] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.908260 13268 raft_consensus.cc:2749] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:50.908615 13266 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.909297 13099 leader_election.cc:304] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.910132 13285 raft_consensus.cc:2749] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.911506 13099 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.912479 13285 raft_consensus.cc:2749] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.912395 13131 raft_consensus.cc:2468] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 3.
I20260709 13:04:50.913643 13130 raft_consensus.cc:1240] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Rejecting Update request from peer e863e18bda0c4e6bb1cc6418867a0a90 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:50.914013 13099 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.914925 13285 raft_consensus.cc:2749] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.915377 13099 leader_election.cc:304] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:50.916342 13285 raft_consensus.cc:2749] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.917006 13026 leader_election.cc:304] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:50.917158 13285 consensus_queue.cc:1059] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:50.918251 13268 raft_consensus.cc:2804] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.918828 13268 raft_consensus.cc:697] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:50.919203 13271 raft_consensus.cc:3055] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.919785 13271 raft_consensus.cc:740] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:50.919857 13268 consensus_queue.cc:237] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.921010 13271 consensus_queue.cc:260] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.922652 13271 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.925580 13273 consensus_queue.cc:1059] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:50.927043 13273 raft_consensus.cc:3055] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.927430 13273 raft_consensus.cc:740] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:50.928665 13273 consensus_queue.cc:260] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:50.930274 13273 raft_consensus.cc:3060] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.951227 12879 catalog_manager.cc:5697] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 2 to 3, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:51.073181 13058 raft_consensus.cc:1240] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Rejecting Update request from peer e863e18bda0c4e6bb1cc6418867a0a90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:51.074402 13266 consensus_queue.cc:1059] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:51.075135 13273 raft_consensus.cc:3055] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:51.075403 13273 raft_consensus.cc:740] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:51.076079 13273 consensus_queue.cc:260] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:51.077071 13273 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.375875 12980 raft_consensus.cc:1275] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:51.377200 13268 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:51.386811 13131 raft_consensus.cc:1275] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:51.388880 13267 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:51.411767 13131 raft_consensus.cc:1275] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:51.413393 13267 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:51.424788 12980 raft_consensus.cc:1275] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:51.426426 13270 consensus_queue.cc:1048] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:51.690764 13155 debug-util.cc:398] Leaking SignalData structure 0x7b08002109c0 after lost signal to thread 434
W20260709 13:04:51.691967 13155 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6b20 after lost signal to thread 12917
W20260709 13:04:51.693094 13155 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe8c0 after lost signal to thread 13009
W20260709 13:04:51.694074 13155 debug-util.cc:398] Leaking SignalData structure 0x7b0800330fa0 after lost signal to thread 13084
W20260709 13:04:51.695048 13155 debug-util.cc:398] Leaking SignalData structure 0x7b08002714e0 after lost signal to thread 13158
I20260709 13:04:52.229085 13300 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.229640 13300 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.231379 13300 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:52.232434 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:52.232666 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:52.233052 12980 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 3.
I20260709 13:04:52.234266 13099 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:52.235117 13300 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.235432 13300 raft_consensus.cc:493] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.235718 13300 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.241478 13300 raft_consensus.cc:515] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.243332 13300 leader_election.cc:290] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:52.244941 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:52.244999 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408806ab563f45b9b95c3fade2a5457a" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:52.246796 12980 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.253177 12980 raft_consensus.cc:2468] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 4.
I20260709 13:04:52.254299 13099 leader_election.cc:304] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:52.255162 13300 raft_consensus.cc:2804] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:52.256223 13300 raft_consensus.cc:697] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 4 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:52.257010 13300 consensus_queue.cc:237] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.268256 12881 catalog_manager.cc:5697] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.551119 13273 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.551879 13273 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.553850 13273 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:52.554672 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:52.555419 13058 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 4.
I20260709 13:04:52.555534 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:52.556280 13131 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 3.
I20260709 13:04:52.556608 12948 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:52.557557 13273 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:52.557861 13273 raft_consensus.cc:493] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.558147 13273 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.563632 13273 raft_consensus.cc:515] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.565611 13273 leader_election.cc:290] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 5 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:52.566624 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:52.567358 13058 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.567761 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f811aa4c44b145308d5fa68235631281" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:52.568631 13131 raft_consensus.cc:3060] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.576066 13131 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 5.
I20260709 13:04:52.577046 12951 leader_election.cc:304] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:52.577250 13058 raft_consensus.cc:2468] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 5.
I20260709 13:04:52.578013 13273 raft_consensus.cc:2804] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:52.580098 13273 raft_consensus.cc:697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 5 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:52.581110 13273 consensus_queue.cc:237] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:52.590826 12881 catalog_manager.cc:5697] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.637770 12980 raft_consensus.cc:1275] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:52.639285 13300 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:52.662714 13058 raft_consensus.cc:3060] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.675621 13058 raft_consensus.cc:1275] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:52.677093 13301 consensus_queue.cc:1048] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:52.858405 12881 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50364:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:52.862079 12881 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:52.925758 12971 tablet_service.cc:1511] Processing CreateTablet for tablet 84114706e61c423aa854eabdc19b0194 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:52.926964 13042 tablet_service.cc:1511] Processing CreateTablet for tablet 84114706e61c423aa854eabdc19b0194 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:52.927920 12971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84114706e61c423aa854eabdc19b0194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.928817 13042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84114706e61c423aa854eabdc19b0194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.930655 12967 tablet_service.cc:1511] Processing CreateTablet for tablet 16715487ee694869a9a42acfa6a00093 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:52.934229 12968 tablet_service.cc:1511] Processing CreateTablet for tablet 80363cb1708f44099a07554e64889035 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:52.936736 13043 tablet_service.cc:1511] Processing CreateTablet for tablet 16715487ee694869a9a42acfa6a00093 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:52.938210 13043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16715487ee694869a9a42acfa6a00093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.940196 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 9701f6d987074eca883851591385fca9 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:52.941720 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9701f6d987074eca883851591385fca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.941427 13045 tablet_service.cc:1511] Processing CreateTablet for tablet 80363cb1708f44099a07554e64889035 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:52.942854 13045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80363cb1708f44099a07554e64889035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.945127 13044 tablet_service.cc:1511] Processing CreateTablet for tablet 9fed803358c848c6a1777e015b7e13dd (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:52.946616 13044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fed803358c848c6a1777e015b7e13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.950932 13046 tablet_service.cc:1511] Processing CreateTablet for tablet 533c8beeb5b14b818c59a3e9b94f9894 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:52.952600 13046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533c8beeb5b14b818c59a3e9b94f9894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.954107 12974 tablet_service.cc:1511] Processing CreateTablet for tablet 9701f6d987074eca883851591385fca9 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:52.958856 13049 tablet_service.cc:1511] Processing CreateTablet for tablet d91983ab064b4cf7bed2a6ec40a12df2 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:52.959679 13047 tablet_service.cc:1511] Processing CreateTablet for tablet 6f784b95ca434e21a7dc49e2aa74b992 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:52.961652 13048 tablet_service.cc:1511] Processing CreateTablet for tablet b8485ac7973d44fca1eaf8787767944f (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:52.963336 12968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80363cb1708f44099a07554e64889035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.964955 12967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16715487ee694869a9a42acfa6a00093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.968911 12974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9701f6d987074eca883851591385fca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.973389 13049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91983ab064b4cf7bed2a6ec40a12df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.976189 13048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8485ac7973d44fca1eaf8787767944f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.975914 13117 tablet_service.cc:1511] Processing CreateTablet for tablet 84114706e61c423aa854eabdc19b0194 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:52.977857 13117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84114706e61c423aa854eabdc19b0194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.979338 12973 tablet_service.cc:1511] Processing CreateTablet for tablet 9fed803358c848c6a1777e015b7e13dd (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:52.980829 12973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fed803358c848c6a1777e015b7e13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.983747 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 16715487ee694869a9a42acfa6a00093 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:52.983960 12969 tablet_service.cc:1511] Processing CreateTablet for tablet 533c8beeb5b14b818c59a3e9b94f9894 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:52.985491 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16715487ee694869a9a42acfa6a00093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.988185 12975 tablet_service.cc:1511] Processing CreateTablet for tablet d91983ab064b4cf7bed2a6ec40a12df2 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:52.991938 12970 tablet_service.cc:1511] Processing CreateTablet for tablet b8485ac7973d44fca1eaf8787767944f (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:52.985605 12969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533c8beeb5b14b818c59a3e9b94f9894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.996035 12970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8485ac7973d44fca1eaf8787767944f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.998371 12975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91983ab064b4cf7bed2a6ec40a12df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.998903 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 80363cb1708f44099a07554e64889035 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:53.000607 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80363cb1708f44099a07554e64889035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.013202 13116 tablet_service.cc:1511] Processing CreateTablet for tablet 9701f6d987074eca883851591385fca9 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:53.014492 13047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f784b95ca434e21a7dc49e2aa74b992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.014719 13116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9701f6d987074eca883851591385fca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.029887 12972 tablet_service.cc:1511] Processing CreateTablet for tablet 6f784b95ca434e21a7dc49e2aa74b992 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:53.031298 12972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f784b95ca434e21a7dc49e2aa74b992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.038650 13121 tablet_service.cc:1511] Processing CreateTablet for tablet 9fed803358c848c6a1777e015b7e13dd (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:53.040095 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fed803358c848c6a1777e015b7e13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.046375 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 533c8beeb5b14b818c59a3e9b94f9894 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:53.047871 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533c8beeb5b14b818c59a3e9b94f9894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.064392 13131 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 5 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:53.067417 13123 tablet_service.cc:1511] Processing CreateTablet for tablet d91983ab064b4cf7bed2a6ec40a12df2 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:53.068231 13122 tablet_service.cc:1511] Processing CreateTablet for tablet b8485ac7973d44fca1eaf8787767944f (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:53.072186 13058 raft_consensus.cc:1275] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 5 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:53.068819 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91983ab064b4cf7bed2a6ec40a12df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.069394 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 6f784b95ca434e21a7dc49e2aa74b992 (DEFAULT_TABLE table=soft_deleted_table [id=834712af486e4068b79d9182972b6130]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:53.077492 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f784b95ca434e21a7dc49e2aa74b992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.080188 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8485ac7973d44fca1eaf8787767944f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.081482 13307 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:53.093601 13320 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.109472 13322 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.117853 13273 consensus_queue.cc:1048] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:53.119552 13322 tablet_bootstrap.cc:654] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.129276 13320 tablet_bootstrap.cc:654] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.250577 13324 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.265410 13324 tablet_bootstrap.cc:654] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.281847 13322 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.282503 13322 ts_tablet_manager.cc:1403] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.008s
I20260709 13:04:53.307535 13322 raft_consensus.cc:359] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.308228 13322 raft_consensus.cc:385] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.308579 13322 raft_consensus.cc:740] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.309329 13322 consensus_queue.cc:260] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.326401 13320 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.327028 13320 ts_tablet_manager.cc:1403] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.018s
I20260709 13:04:53.330302 13320 raft_consensus.cc:359] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.332386 13320 raft_consensus.cc:385] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.333016 13320 raft_consensus.cc:740] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.332242 13322 ts_tablet_manager.cc:1434] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:04:53.333998 13320 consensus_queue.cc:260] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.343916 13322 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.354858 13322 tablet_bootstrap.cc:654] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.357801 13320 ts_tablet_manager.cc:1434] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:04:53.368366 13324 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.369048 13324 ts_tablet_manager.cc:1403] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.011s
I20260709 13:04:53.376549 13320 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.379197 13324 raft_consensus.cc:359] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.380160 13324 raft_consensus.cc:385] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.380506 13324 raft_consensus.cc:740] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.385679 13320 tablet_bootstrap.cc:654] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.381479 13324 consensus_queue.cc:260] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.389905 13324 ts_tablet_manager.cc:1434] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:04:53.391114 13324 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.398474 13324 tablet_bootstrap.cc:654] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.410676 13324 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.413405 13324 ts_tablet_manager.cc:1403] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:04:53.415793 13322 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.416563 13322 ts_tablet_manager.cc:1403] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.002s
I20260709 13:04:53.417621 13324 raft_consensus.cc:359] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.418406 13324 raft_consensus.cc:385] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.418706 13324 raft_consensus.cc:740] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.419514 13324 consensus_queue.cc:260] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.420567 13322 raft_consensus.cc:359] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.421510 13322 raft_consensus.cc:385] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.421881 13322 raft_consensus.cc:740] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.422930 13324 ts_tablet_manager.cc:1434] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:53.422758 13322 consensus_queue.cc:260] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.427313 13320 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.427891 13320 ts_tablet_manager.cc:1403] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.052s	user 0.030s	sys 0.014s
I20260709 13:04:53.424347 13324 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.431115 13320 raft_consensus.cc:359] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.431880 13320 raft_consensus.cc:385] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.432191 13320 raft_consensus.cc:740] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.433097 13320 consensus_queue.cc:260] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.436595 13324 tablet_bootstrap.cc:654] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.438788 13322 ts_tablet_manager.cc:1434] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:04:53.443029 13320 ts_tablet_manager.cc:1434] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:04:53.448060 13320 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.454727 13320 tablet_bootstrap.cc:654] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.456593 13322 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.460726 13329 raft_consensus.cc:493] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.461700 13329 raft_consensus.cc:515] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.464280 13329 leader_election.cc:290] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.465324 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.465636 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
W20260709 13:04:53.467296 13099 leader_election.cc:343] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:53.468216 13097 leader_election.cc:343] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.468745 13097 leader_election.cc:304] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.470084 13329 raft_consensus.cc:2749] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.473479 13320 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.474047 13320 ts_tablet_manager.cc:1403] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 13:04:53.477408 13320 raft_consensus.cc:359] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.478180 13320 raft_consensus.cc:385] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.478499 13320 raft_consensus.cc:740] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.479382 13322 tablet_bootstrap.cc:654] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.479413 13320 consensus_queue.cc:260] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.481262 13324 tablet_bootstrap.cc:492] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.482185 13324 ts_tablet_manager.cc:1403] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.024s
I20260709 13:04:53.486032 13324 raft_consensus.cc:359] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.486917 13324 raft_consensus.cc:385] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.487277 13324 raft_consensus.cc:740] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.488190 13324 consensus_queue.cc:260] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.491277 13320 ts_tablet_manager.cc:1434] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 13:04:53.494028 13324 ts_tablet_manager.cc:1434] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:53.495366 13324 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.499724 13320 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.502418 13324 tablet_bootstrap.cc:654] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.503641 13322 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.504209 13322 ts_tablet_manager.cc:1403] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.019s
I20260709 13:04:53.507489 13322 raft_consensus.cc:359] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.507927 13320 tablet_bootstrap.cc:654] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.508214 13322 raft_consensus.cc:385] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.508548 13322 raft_consensus.cc:740] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.509434 13322 consensus_queue.cc:260] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.514665 13324 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.515362 13324 ts_tablet_manager.cc:1403] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:04:53.518383 13324 raft_consensus.cc:359] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.519240 13324 raft_consensus.cc:385] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.519579 13324 raft_consensus.cc:740] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.520470 13324 consensus_queue.cc:260] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.523116 13322 ts_tablet_manager.cc:1434] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:53.523152 13324 ts_tablet_manager.cc:1434] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:53.525125 13324 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.531854 13320 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.532430 13320 ts_tablet_manager.cc:1403] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.014s
I20260709 13:04:53.532851 13323 raft_consensus.cc:493] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.533378 13323 raft_consensus.cc:515] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.534981 13324 tablet_bootstrap.cc:654] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.535538 13323 leader_election.cc:290] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.532439 13322 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.536614 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.537282 12982 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:53.538988 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.539678 13131 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:53.541054 13025 leader_election.cc:304] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:53.541877 13323 raft_consensus.cc:2804] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.542227 13323 raft_consensus.cc:493] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.542551 13323 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.543567 13320 raft_consensus.cc:359] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.544363 13320 raft_consensus.cc:385] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.544644 13320 raft_consensus.cc:740] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.545502 13320 consensus_queue.cc:260] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.547784 13324 tablet_bootstrap.cc:492] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.548379 13320 ts_tablet_manager.cc:1434] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:53.548421 13324 ts_tablet_manager.cc:1403] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260709 13:04:53.549580 13320 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.552286 13324 raft_consensus.cc:359] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.553092 13324 raft_consensus.cc:385] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.553422 13324 raft_consensus.cc:740] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.554131 13324 consensus_queue.cc:260] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.556826 13324 ts_tablet_manager.cc:1434] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:53.558017 13324 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.560271 13320 tablet_bootstrap.cc:654] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.563268 13323 raft_consensus.cc:515] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.566298 13323 leader_election.cc:290] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.571210 13324 tablet_bootstrap.cc:654] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.572759 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.573447 12982 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.575031 13322 tablet_bootstrap.cc:654] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.580687 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:53.581430 13131 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.581692 13324 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.582254 13324 ts_tablet_manager.cc:1403] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.010s
I20260709 13:04:53.584547 13324 raft_consensus.cc:359] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.585242 13324 raft_consensus.cc:385] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.585541 13324 raft_consensus.cc:740] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.586272 13324 consensus_queue.cc:260] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.588629 13321 raft_consensus.cc:493] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.588816 13324 ts_tablet_manager.cc:1434] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:04:53.589205 13321 raft_consensus.cc:515] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.589998 13324 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.591472 13321 leader_election.cc:290] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.591892 12982 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:53.593956 13131 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:53.595906 13320 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.596519 13320 ts_tablet_manager.cc:1403] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.004s
I20260709 13:04:53.596784 13025 leader_election.cc:304] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:53.597554 13324 tablet_bootstrap.cc:654] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.599979 13320 raft_consensus.cc:359] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.600813 13320 raft_consensus.cc:385] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.601197 13320 raft_consensus.cc:740] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.601971 13320 consensus_queue.cc:260] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.603909 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fed803358c848c6a1777e015b7e13dd" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.604365 13320 ts_tablet_manager.cc:1434] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:53.604627 13131 raft_consensus.cc:2468] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:53.605434 13320 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.605881 13026 leader_election.cc:304] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:53.606742 13321 raft_consensus.cc:2804] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.607093 13321 raft_consensus.cc:493] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.607420 13321 raft_consensus.cc:3060] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.600697 13267 raft_consensus.cc:2804] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.609509 13324 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.610077 13324 ts_tablet_manager.cc:1403] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:04:53.612959 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fed803358c848c6a1777e015b7e13dd" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.613669 12982 raft_consensus.cc:2468] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:53.613998 13267 raft_consensus.cc:697] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:53.613299 13324 raft_consensus.cc:359] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.614817 13324 raft_consensus.cc:385] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.615157 13324 raft_consensus.cc:740] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.614940 13267 consensus_queue.cc:237] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.615921 13324 consensus_queue.cc:260] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.617635 13320 tablet_bootstrap.cc:654] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.618938 13324 ts_tablet_manager.cc:1434] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:53.620074 13324 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
I20260709 13:04:53.619014 13321 raft_consensus.cc:515] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.626426 13324 tablet_bootstrap.cc:654] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.628028 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fed803358c848c6a1777e015b7e13dd" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.628669 12982 raft_consensus.cc:3060] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.634087 13324 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.634624 13324 ts_tablet_manager.cc:1403] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:04:53.637904 13329 raft_consensus.cc:493] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.638263 13320 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.638456 13329 raft_consensus.cc:515] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.638974 13320 ts_tablet_manager.cc:1403] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.005s
I20260709 13:04:53.639671 12879 catalog_manager.cc:5697] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.638384 13322 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.641132 13322 ts_tablet_manager.cc:1403] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.009s
I20260709 13:04:53.642046 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.642180 13320 raft_consensus.cc:359] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.642952 13320 raft_consensus.cc:385] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.643262 13320 raft_consensus.cc:740] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.640290 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fed803358c848c6a1777e015b7e13dd" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
W20260709 13:04:53.643985 13099 leader_election.cc:343] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.644132 13131 raft_consensus.cc:3060] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.644657 13322 raft_consensus.cc:359] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.645499 13322 raft_consensus.cc:385] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.645835 13322 raft_consensus.cc:740] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.646549 13321 leader_election.cc:290] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.647428 13322 consensus_queue.cc:260] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.640750 13329 leader_election.cc:290] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.649294 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:53.650044 13058 raft_consensus.cc:2468] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:53.637312 13324 raft_consensus.cc:359] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.651598 13097 leader_election.cc:304] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:53.652179 13324 raft_consensus.cc:385] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.652827 13324 raft_consensus.cc:740] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.644055 13320 consensus_queue.cc:260] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.653003 13329 raft_consensus.cc:2804] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.653468 13329 raft_consensus.cc:493] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.653793 13329 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.653682 13324 consensus_queue.cc:260] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.658216 13324 ts_tablet_manager.cc:1434] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:04:53.659173 13324 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: Bootstrap starting.
W20260709 13:04:53.664184 12931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:53.663828 13329 raft_consensus.cc:515] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.666069 13335 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.666651 13335 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.667898 13320 ts_tablet_manager.cc:1434] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:04:53.670408 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.674084 13320 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
W20260709 13:04:53.675006 13099 leader_election.cc:343] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.675884 13324 tablet_bootstrap.cc:654] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.678304 13267 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.678894 13267 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.652055 13131 raft_consensus.cc:2468] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:53.681787 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.682986 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:53.683519 13026 leader_election.cc:304] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:53.683656 13058 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
W20260709 13:04:53.683661 13025 leader_election.cc:343] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.680850 13335 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.685313 13097 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:53.682936 13320 tablet_bootstrap.cc:654] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.687135 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.687754 13131 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 0.
I20260709 13:04:53.688716 13335 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.689105 13335 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.689513 13335 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.681696 13267 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.689198 13026 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:53.690557 13267 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.690905 13267 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.691218 13267 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.685302 13321 raft_consensus.cc:2804] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.692737 13321 raft_consensus.cc:697] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:53.693905 13324 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: No bootstrap required, opened a new log
I20260709 13:04:53.694413 13324 ts_tablet_manager.cc:1403] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.001s
I20260709 13:04:53.698997 13336 raft_consensus.cc:493] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.699231 13320 tablet_bootstrap.cc:492] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.699492 13336 raft_consensus.cc:515] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.700692 12982 raft_consensus.cc:2468] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:53.699903 13320 ts_tablet_manager.cc:1403] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:04:53.703485 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.697306 13324 raft_consensus.cc:359] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.704202 13131 raft_consensus.cc:2468] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:53.704061 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:53.704528 13324 raft_consensus.cc:385] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.705473 13324 raft_consensus.cc:740] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.705775 12951 leader_election.cc:304] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:53.705564 13320 raft_consensus.cc:359] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.702224 13336 leader_election.cc:290] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.706398 13320 raft_consensus.cc:385] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.706745 13320 raft_consensus.cc:740] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.693822 13321 consensus_queue.cc:237] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.707325 13336 raft_consensus.cc:2804] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.706199 13324 consensus_queue.cc:260] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.707871 13336 raft_consensus.cc:493] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.707511 13320 consensus_queue.cc:260] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.708518 13336 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.710039 13322 ts_tablet_manager.cc:1434] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:04:53.710654 13324 ts_tablet_manager.cc:1434] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
W20260709 13:04:53.706949 12948 leader_election.cc:343] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.711128 13322 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.712693 13320 ts_tablet_manager.cc:1434] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:53.715930 13329 leader_election.cc:290] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.716197 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:53.716955 13058 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.718804 13320 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.699880 13335 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.722424 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.722815 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.723098 12982 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.724465 13099 leader_election.cc:343] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.726363 13320 tablet_bootstrap.cc:654] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.730659 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:53.731643 13335 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.739675 13322 tablet_bootstrap.cc:654] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.698335 13267 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.745998 13057 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 1: Already voted for candidate f26aaafed2dc4853a7d606d8611f3b6e in this term.
I20260709 13:04:53.747061 13267 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.749225 13097 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.750980 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:53.751777 13131 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 1: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:53.751677 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.753477 13335 raft_consensus.cc:2749] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:04:53.753831 13025 leader_election.cc:343] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.754313 13025 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:53.755437 13321 raft_consensus.cc:2749] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.757869 12982 raft_consensus.cc:2468] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:53.759487 13058 raft_consensus.cc:2468] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:53.761690 13307 raft_consensus.cc:493] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.762454 13307 raft_consensus.cc:515] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.762699 13097 leader_election.cc:304] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:53.763970 13335 raft_consensus.cc:2804] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.764569 13335 raft_consensus.cc:697] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:53.765264 13336 raft_consensus.cc:515] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.765581 13335 consensus_queue.cc:237] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.767407 13336 leader_election.cc:290] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.769524 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:53.769594 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:53.770474 13131 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.771270 12948 leader_election.cc:343] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.773030 13307 leader_election.cc:290] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.775404 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.775381 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:53.776546 13130 raft_consensus.cc:2468] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
W20260709 13:04:53.779281 12948 leader_election.cc:343] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.785531 12951 leader_election.cc:304] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.786404 13307 raft_consensus.cc:2804] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.786762 13307 raft_consensus.cc:493] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.787060 13307 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.791718 13320 tablet_bootstrap.cc:492] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.792400 13320 ts_tablet_manager.cc:1403] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.004s
I20260709 13:04:53.794667 13307 raft_consensus.cc:515] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.794348 12879 catalog_manager.cc:5697] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.795804 13320 raft_consensus.cc:359] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.796679 13320 raft_consensus.cc:385] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.796972 13320 raft_consensus.cc:740] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.797802 13320 consensus_queue.cc:260] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.798339 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
W20260709 13:04:53.799963 12948 leader_election.cc:343] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.800130 13320 ts_tablet_manager.cc:1434] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:53.801247 13320 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: Bootstrap starting.
I20260709 13:04:53.788748 13131 raft_consensus.cc:2468] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:53.808406 12951 leader_election.cc:304] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.808748 13307 leader_election.cc:290] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.809273 13273 raft_consensus.cc:493] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.810135 13273 raft_consensus.cc:515] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.810657 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:53.811313 13130 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.812294 13273 leader_election.cc:290] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:53.813041 13273 raft_consensus.cc:2804] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.813494 13273 raft_consensus.cc:697] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:53.814443 13273 consensus_queue.cc:237] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.817984 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
W20260709 13:04:53.819870 12948 leader_election.cc:343] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.819977 13130 raft_consensus.cc:2468] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:53.821197 12951 leader_election.cc:304] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.821846 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:53.822531 13131 raft_consensus.cc:2468] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:53.823040 13336 raft_consensus.cc:2804] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.823796 12951 leader_election.cc:304] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.825248 13307 raft_consensus.cc:2804] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.825608 13307 raft_consensus.cc:493] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.825960 13307 raft_consensus.cc:3060] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.826550 13320 tablet_bootstrap.cc:654] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.831668 13336 raft_consensus.cc:697] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:53.832883 13336 consensus_queue.cc:237] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.831005 12881 catalog_manager.cc:5697] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 0 to 1, leader changed from <none> to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.834710 13320 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: No bootstrap required, opened a new log
I20260709 13:04:53.835265 13320 ts_tablet_manager.cc:1403] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 13:04:53.837658 13320 raft_consensus.cc:359] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.838244 13320 raft_consensus.cc:385] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.838513 13320 raft_consensus.cc:740] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.838874 13307 raft_consensus.cc:515] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.839150 13320 consensus_queue.cc:260] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.844208 13335 raft_consensus.cc:493] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.844870 13335 raft_consensus.cc:515] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.846788 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:53.847597 13307 leader_election.cc:290] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
W20260709 13:04:53.848395 12948 leader_election.cc:343] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.851184 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:53.851857 12982 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:53.852689 13320 ts_tablet_manager.cc:1434] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:04:53.853163 13099 leader_election.cc:304] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:53.854130 13329 raft_consensus.cc:2804] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.854506 13329 raft_consensus.cc:493] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.854836 13329 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.855268 13322 tablet_bootstrap.cc:492] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.855967 13322 ts_tablet_manager.cc:1403] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.015s
I20260709 13:04:53.859663 13322 raft_consensus.cc:359] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.860678 13322 raft_consensus.cc:385] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.861176 13322 raft_consensus.cc:740] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.862265 13322 consensus_queue.cc:260] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.862787 13329 raft_consensus.cc:515] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.870091 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:53.870880 13130 raft_consensus.cc:3060] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.871824 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:53.872677 12982 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.874596 13329 leader_election.cc:290] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.866725 13058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:53.876690 13058 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 0.
I20260709 13:04:53.866823 13335 leader_election.cc:290] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:53.880533 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:53.881165 13057 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.881560 13130 raft_consensus.cc:2468] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:53.882900 12951 leader_election.cc:304] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:53.884028 13307 raft_consensus.cc:2804] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.884528 13307 raft_consensus.cc:697] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:53.885432 13307 consensus_queue.cc:237] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.865871 13322 ts_tablet_manager.cc:1434] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:53.892016 13322 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.894110 12982 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:53.895336 13057 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:53.895646 13099 leader_election.cc:304] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:53.899369 13322 tablet_bootstrap.cc:654] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.902526 13335 raft_consensus.cc:2804] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.903044 13335 raft_consensus.cc:697] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:53.903852 13335 consensus_queue.cc:237] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.909299 12882 catalog_manager.cc:5697] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.911091 12882 catalog_manager.cc:5697] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.914613 13322 tablet_bootstrap.cc:492] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.914520 12881 catalog_manager.cc:5697] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 0 to 1, leader changed from <none> to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.915225 13322 ts_tablet_manager.cc:1403] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 13:04:53.918584 13322 raft_consensus.cc:359] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.919296 13322 raft_consensus.cc:385] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.919576 13322 raft_consensus.cc:740] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.920537 13322 consensus_queue.cc:260] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.926751 13322 ts_tablet_manager.cc:1434] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:53.927816 13322 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.934649 13322 tablet_bootstrap.cc:654] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.938654 12881 catalog_manager.cc:5697] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.942369 13322 tablet_bootstrap.cc:492] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.942965 13322 ts_tablet_manager.cc:1403] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:04:53.947719 13322 raft_consensus.cc:359] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.948495 13322 raft_consensus.cc:385] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.949313 13322 raft_consensus.cc:740] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.950079 13322 consensus_queue.cc:260] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.952425 13322 ts_tablet_manager.cc:1434] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:04:53.953768 13322 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.961383 13322 tablet_bootstrap.cc:654] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.970690 13322 tablet_bootstrap.cc:492] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.971194 13322 ts_tablet_manager.cc:1403] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:04:53.973893 13322 raft_consensus.cc:359] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.974586 13322 raft_consensus.cc:385] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.974833 13322 raft_consensus.cc:740] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.975467 13322 consensus_queue.cc:260] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.977703 13322 ts_tablet_manager.cc:1434] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:53.979079 13322 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: Bootstrap starting.
I20260709 13:04:53.985697 13322 tablet_bootstrap.cc:654] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.990845 13322 tablet_bootstrap.cc:492] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: No bootstrap required, opened a new log
I20260709 13:04:53.991353 13322 ts_tablet_manager.cc:1403] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:04:53.993880 13322 raft_consensus.cc:359] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.994534 13322 raft_consensus.cc:385] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.994801 13322 raft_consensus.cc:740] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.995398 13322 consensus_queue.cc:260] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:53.997704 13322 ts_tablet_manager.cc:1434] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:54.001430 13267 consensus_queue.cc:1048] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.020231 13351 raft_consensus.cc:493] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.020962 13351 raft_consensus.cc:515] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.023402 13351 leader_election.cc:290] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.024452 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:54.024554 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:54.025540 13131 raft_consensus.cc:2393] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:54.025867 13351 consensus_queue.cc:1048] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.027742 13025 leader_election.cc:304] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:54.028857 13267 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.037779 13267 raft_consensus.cc:2749] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.044800 13336 raft_consensus.cc:493] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.045567 13336 raft_consensus.cc:515] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.047786 13336 leader_election.cc:290] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.048774 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:54.049398 13057 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:54.050427 12948 leader_election.cc:304] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:54.051061 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:54.051292 13336 raft_consensus.cc:2804] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.051667 13336 raft_consensus.cc:493] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.051749 13131 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 0.
I20260709 13:04:54.052053 13336 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.056537 13267 raft_consensus.cc:493] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.057194 13267 raft_consensus.cc:515] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.059098 13336 raft_consensus.cc:515] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.059580 13267 leader_election.cc:290] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.060964 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:54.061034 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84114706e61c423aa854eabdc19b0194" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:54.062529 13131 raft_consensus.cc:2393] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:54.063449 13026 leader_election.cc:304] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:54.064512 13267 raft_consensus.cc:3060] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.065951 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:54.065955 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:54.066730 13057 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.066764 13131 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.071841 13267 raft_consensus.cc:2749] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.063786 13336 leader_election.cc:290] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.074021 13131 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:54.075276 12951 leader_election.cc:304] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:54.076145 13336 raft_consensus.cc:2804] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.076781 13336 raft_consensus.cc:697] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:54.077119 13057 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 1.
I20260709 13:04:54.077764 13336 consensus_queue.cc:237] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.087589 12879 catalog_manager.cc:5697] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.126387 13267 consensus_queue.cc:1048] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.145198 13321 consensus_queue.cc:1048] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.150104 13321 raft_consensus.cc:493] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.150652 13321 raft_consensus.cc:515] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.152757 13321 leader_election.cc:290] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.153452 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:54.154366 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:54.155143 13130 raft_consensus.cc:2393] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 1: Already voted for candidate e863e18bda0c4e6bb1cc6418867a0a90 in this term.
I20260709 13:04:54.156373 13026 leader_election.cc:304] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:54.157531 13321 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.165741 13321 raft_consensus.cc:2749] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.205315 13307 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.205868 13307 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:54.208022 13307 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:54.208998 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:54.210026 13057 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e863e18bda0c4e6bb1cc6418867a0a90 in current term 1: Already voted for candidate f26aaafed2dc4853a7d606d8611f3b6e in this term.
I20260709 13:04:54.210212 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:54.211164 13131 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e863e18bda0c4e6bb1cc6418867a0a90 in current term 1: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:54.212450 12951 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90; no voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:54.213444 13307 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.218529 13307 raft_consensus.cc:2749] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.225798 13307 consensus_queue.cc:1048] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.244297 13336 consensus_queue.cc:1048] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.308271 13336 consensus_queue.cc:1048] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.319761 13336 consensus_queue.cc:1048] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.335579 13335 consensus_queue.cc:1048] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.348490 13329 consensus_queue.cc:1048] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.352129 13336 consensus_queue.cc:1048] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.353570 13307 consensus_queue.cc:1048] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.362049 13329 consensus_queue.cc:1048] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.374734 13329 consensus_queue.cc:1048] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.577575 13336 consensus_queue.cc:1048] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.588608 13307 consensus_queue.cc:1048] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:54.666970 12931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:55.669528 12931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.986964 13351 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.987550 13351 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:55.988413 13393 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.989022 13393 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:55.990585 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:55.991006 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e" is_pre_election: true
I20260709 13:04:55.991511 12983 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:55.991735 13130 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 1.
I20260709 13:04:55.992236 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" is_pre_election: true
I20260709 13:04:55.989770 13351 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:55.993129 12982 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 1.
I20260709 13:04:55.993193 13025 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:55.994633 13099 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:55.995033 13351 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.995225 13393 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:55.995568 13351 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.995746 13396 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.996258 13351 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.996335 13396 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.996968 13396 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.997298 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" is_pre_election: true
I20260709 13:04:56.005880 13396 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.005880 13351 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.007422 13057 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 2: Already voted for candidate f26aaafed2dc4853a7d606d8611f3b6e in this term.
I20260709 13:04:56.008584 13396 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:56.009749 13351 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:56.010833 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:56.011189 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:56.011369 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:56.010226 12982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:56.011718 13131 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f26aaafed2dc4853a7d606d8611f3b6e in current term 2: Already voted for candidate c9234ca90d6f47ec9da746900014f94e in this term.
I20260709 13:04:56.011900 12983 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.012187 13057 raft_consensus.cc:2393] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c9234ca90d6f47ec9da746900014f94e in current term 2: Already voted for candidate f26aaafed2dc4853a7d606d8611f3b6e in this term.
I20260709 13:04:56.014274 13099 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e; no voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:56.015019 13396 raft_consensus.cc:2749] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.018427 12983 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:56.019537 13025 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:56.020298 13351 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.021577 13351 raft_consensus.cc:697] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:56.022476 13351 consensus_queue.cc:237] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.031908 12881 catalog_manager.cc:5697] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 0 to 2, leader changed from <none> to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.530921 12983 raft_consensus.cc:1275] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:56.532300 13351 consensus_queue.cc:1048] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.543970 13130 raft_consensus.cc:1275] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:56.546052 13406 consensus_queue.cc:1048] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.562917 13057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16715487ee694869a9a42acfa6a00093"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:46626
I20260709 13:04:56.563673 13057 raft_consensus.cc:606] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:56.569157 13057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80363cb1708f44099a07554e64889035"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:46626
I20260709 13:04:56.569692 13057 raft_consensus.cc:606] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:56.575600 13130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9701f6d987074eca883851591385fca9"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:41942
I20260709 13:04:56.576200 13130 raft_consensus.cc:606] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:56.584851 13130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:41942
I20260709 13:04:56.585551 13130 raft_consensus.cc:606] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:56.592475 12982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:56.593109 12982 raft_consensus.cc:606] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:56.599620 12983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:56.600276 12983 raft_consensus.cc:606] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS f26aaafed2dc4853a7d606d8611f3b6e
I20260709 13:04:56.601898 13411 raft_consensus.cc:993] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:56.602432 13411 raft_consensus.cc:1081] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:56.603961 12983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9701f6d987074eca883851591385fca9"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40114
I20260709 13:04:56.604573 12983 raft_consensus.cc:493] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.604916 12983 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.606700 12982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
mode: GRACEFUL
new_leader_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:40140
I20260709 13:04:56.607255 12982 raft_consensus.cc:606] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Received request to transfer leadership to TS c9234ca90d6f47ec9da746900014f94e
I20260709 13:04:56.611954 12983 raft_consensus.cc:515] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.614392 12983 leader_election.cc:290] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:56.615216 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:56.615605 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9701f6d987074eca883851591385fca9" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:56.616005 13057 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.616178 13130 raft_consensus.cc:3055] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.616595 13130 raft_consensus.cc:740] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:56.617337 13130 consensus_queue.cc:260] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.618326 13130 raft_consensus.cc:3060] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.621855 13057 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:56.623358 12948 leader_election.cc:304] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:56.623759 13130 raft_consensus.cc:2468] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:56.624258 13365 raft_consensus.cc:2804] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.624805 13365 raft_consensus.cc:697] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:56.625586 13365 consensus_queue.cc:237] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.634692 12881 catalog_manager.cc:5697] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 1 to 2, leader changed from c9234ca90d6f47ec9da746900014f94e (127.0.107.195) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.779178 13406 raft_consensus.cc:993] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:56.779670 13351 raft_consensus.cc:1081] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:56.781064 12983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80363cb1708f44099a07554e64889035"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40124
I20260709 13:04:56.781486 12983 raft_consensus.cc:493] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.781733 12983 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.786375 12983 raft_consensus.cc:515] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.788106 12983 leader_election.cc:290] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:56.788787 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:56.789423 13057 raft_consensus.cc:3055] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.789726 13057 raft_consensus.cc:740] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:56.790378 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80363cb1708f44099a07554e64889035" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:56.791059 13130 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.790562 13057 consensus_queue.cc:260] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.792140 13057 raft_consensus.cc:3060] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.795584 13365 raft_consensus.cc:993] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:56.796168 13416 raft_consensus.cc:1081] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:56.798053 13060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46606
I20260709 13:04:56.798553 13060 raft_consensus.cc:493] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.798856 13060 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.799474 13130 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:56.800159 13057 raft_consensus.cc:2468] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 2.
I20260709 13:04:56.801064 12951 leader_election.cc:304] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:56.801925 13416 raft_consensus.cc:2804] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.802786 13416 raft_consensus.cc:697] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:56.803799 13416 consensus_queue.cc:237] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.806527 13060 raft_consensus.cc:515] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.809574 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:56.809682 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8485ac7973d44fca1eaf8787767944f" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:56.810166 12983 raft_consensus.cc:3055] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.810293 13060 leader_election.cc:290] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:56.811201 12983 raft_consensus.cc:740] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:56.811998 12983 consensus_queue.cc:260] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.813033 12983 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.813149 13130 raft_consensus.cc:3060] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.813486 12881 catalog_manager.cc:5697] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 1 to 2, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.820425 13130 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:56.820425 12983 raft_consensus.cc:2468] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:56.822006 13025 leader_election.cc:304] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:56.823040 13351 raft_consensus.cc:2804] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.823451 13351 raft_consensus.cc:697] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:56.824234 13351 consensus_queue.cc:237] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.831982 12881 catalog_manager.cc:5697] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.838532 13404 raft_consensus.cc:993] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:04:56.839046 13416 raft_consensus.cc:1081] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:04:56.840945 13130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:41926
I20260709 13:04:56.841681 13130 raft_consensus.cc:493] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.842108 13130 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.849583 13130 raft_consensus.cc:515] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.851406 13130 leader_election.cc:290] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:04:56.853358 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:56.853366 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f784b95ca434e21a7dc49e2aa74b992" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:56.854216 13060 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.854259 12983 raft_consensus.cc:3055] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.854781 12983 raft_consensus.cc:740] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:56.855568 12983 consensus_queue.cc:260] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.856861 12983 raft_consensus.cc:3060] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.861585 13060 raft_consensus.cc:2468] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 2.
I20260709 13:04:56.862860 13097 leader_election.cc:304] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:56.863469 12983 raft_consensus.cc:2468] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 2.
I20260709 13:04:56.863862 13411 raft_consensus.cc:2804] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.864408 13411 raft_consensus.cc:697] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:56.865176 13411 consensus_queue.cc:237] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.872794 12881 catalog_manager.cc:5697] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.921280 13404 raft_consensus.cc:993] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:56.921721 13416 raft_consensus.cc:1081] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:56.923480 13060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46606
I20260709 13:04:56.924028 13060 raft_consensus.cc:493] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.924388 13060 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.930043 13060 raft_consensus.cc:515] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.931556 13060 leader_election.cc:290] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:56.932205 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:56.932541 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91983ab064b4cf7bed2a6ec40a12df2" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:56.932914 12983 raft_consensus.cc:3055] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.933120 13130 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.933254 12983 raft_consensus.cc:740] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:56.934058 12983 consensus_queue.cc:260] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.934952 12983 raft_consensus.cc:3060] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.938271 13130 raft_consensus.cc:2468] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:56.939437 12983 raft_consensus.cc:2468] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:56.939447 13026 leader_election.cc:304] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:56.940517 13351 raft_consensus.cc:2804] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.940944 13351 raft_consensus.cc:697] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:56.941651 13351 consensus_queue.cc:237] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:56.948369 12881 catalog_manager.cc:5697] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.023253 13406 raft_consensus.cc:993] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:57.023665 13406 raft_consensus.cc:1081] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:04:57.024963 12983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16715487ee694869a9a42acfa6a00093"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40124
I20260709 13:04:57.025455 12983 raft_consensus.cc:493] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.025767 12983 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.030743 12983 raft_consensus.cc:515] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.032191 12983 leader_election.cc:290] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:57.032966 13060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:04:57.033198 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16715487ee694869a9a42acfa6a00093" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:57.033504 13060 raft_consensus.cc:3055] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:57.033728 13130 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.033799 13060 raft_consensus.cc:740] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:57.034561 13060 consensus_queue.cc:260] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.035430 13060 raft_consensus.cc:3060] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.038856 13130 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 3.
I20260709 13:04:57.040185 12951 leader_election.cc:304] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:04:57.040283 13060 raft_consensus.cc:2468] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 3.
I20260709 13:04:57.040931 13416 raft_consensus.cc:2804] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:57.041448 13416 raft_consensus.cc:697] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:04:57.042220 13416 consensus_queue.cc:237] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.042841 13396 raft_consensus.cc:993] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: : Instructing follower f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:57.043303 13411 raft_consensus.cc:1081] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Signalling peer f26aaafed2dc4853a7d606d8611f3b6e to start an election
I20260709 13:04:57.044597 13057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
 from {username='slave'} at 127.0.0.1:46620
I20260709 13:04:57.045059 13057 raft_consensus.cc:493] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.045332 13057 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.049377 12881 catalog_manager.cc:5697] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 2 to 3, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.051712 13057 raft_consensus.cc:515] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.053371 13057 leader_election.cc:290] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:04:57.054229 12983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:04:57.054489 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533c8beeb5b14b818c59a3e9b94f9894" candidate_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:04:57.054798 12983 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.054989 13130 raft_consensus.cc:3055] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.055315 13130 raft_consensus.cc:740] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:04:57.056002 13130 consensus_queue.cc:260] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.056968 13130 raft_consensus.cc:3060] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.060771 12983 raft_consensus.cc:2468] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:57.061828 13025 leader_election.cc:304] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e863e18bda0c4e6bb1cc6418867a0a90, f26aaafed2dc4853a7d606d8611f3b6e; no voters: 
I20260709 13:04:57.061961 13130 raft_consensus.cc:2468] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26aaafed2dc4853a7d606d8611f3b6e in term 2.
I20260709 13:04:57.062417 13406 raft_consensus.cc:2804] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.062858 13406 raft_consensus.cc:697] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Leader. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:04:57.063697 13406 consensus_queue.cc:237] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:04:57.074900 12881 catalog_manager.cc:5697] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e reported cstate change: term changed from 1 to 2, leader changed from c9234ca90d6f47ec9da746900014f94e (127.0.107.195) to f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.093084 13130 raft_consensus.cc:1275] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.094170 13416 consensus_queue.cc:1048] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.103645 13057 raft_consensus.cc:1275] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.105480 13404 consensus_queue.cc:1048] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.205943 13130 raft_consensus.cc:1275] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.207109 13404 consensus_queue.cc:1048] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.216524 13057 raft_consensus.cc:1275] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.218660 13365 consensus_queue.cc:1048] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.223304 12983 raft_consensus.cc:1275] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.224738 13351 consensus_queue.cc:1048] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.236457 13130 raft_consensus.cc:1275] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.239660 13406 consensus_queue.cc:1048] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.323256 12983 raft_consensus.cc:1275] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.324467 13411 consensus_queue.cc:1048] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.333902 13057 raft_consensus.cc:1275] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.336378 13433 consensus_queue.cc:1048] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.456851 13057 raft_consensus.cc:1275] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:57.458452 13365 consensus_queue.cc:1048] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.466562 13130 raft_consensus.cc:1275] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:57.467962 13365 consensus_queue.cc:1048] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.541486 12983 raft_consensus.cc:1275] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.542989 13406 consensus_queue.cc:1048] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.552985 13130 raft_consensus.cc:1275] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.554358 13406 consensus_queue.cc:1048] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.594956 13131 raft_consensus.cc:1275] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.596455 13406 consensus_queue.cc:1048] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.606192 12983 raft_consensus.cc:1275] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Refusing update from remote peer f26aaafed2dc4853a7d606d8611f3b6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.607508 13430 consensus_queue.cc:1048] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.610754 12881 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50364:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:59.631088 12881 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50364:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:59.659334   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.762933 13479 tablet.cc:1724] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.765890 13475 tablet.cc:1724] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.802891 13465 tablet.cc:1724] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.849344 13481 tablet.cc:1724] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:59.844357 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41979, user_credentials={real_user=slave}} blocked reactor thread for 114654us
W20260709 13:04:59.921536 13026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41979, user_credentials={real_user=slave}} blocked reactor thread for 66435.3us
I20260709 13:04:59.922813 13493 tablet.cc:1724] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.872584 13483 tablet.cc:1724] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.926419 13492 tablet.cc:1724] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.982647 13055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:58028
I20260709 13:04:59.989598 13055 raft_consensus.cc:606] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Received request to transfer leadership to TS e863e18bda0c4e6bb1cc6418867a0a90
I20260709 13:04:59.990146 13479 tablet.cc:1724] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:59.987710 13475 tablet.cc:1724] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.034595 13351 raft_consensus.cc:993] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:05:00.035063 13351 raft_consensus.cc:1081] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Signalling peer e863e18bda0c4e6bb1cc6418867a0a90 to start an election
I20260709 13:05:00.038928 13055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:58028
I20260709 13:05:00.039654 13055 raft_consensus.cc:606] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Received request to transfer leadership to TS c9234ca90d6f47ec9da746900014f94e
I20260709 13:05:00.060669 13055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72"
dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
mode: GRACEFUL
new_leader_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:58028
I20260709 13:05:00.061592 13055 raft_consensus.cc:606] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Received request to transfer leadership to TS c9234ca90d6f47ec9da746900014f94e
I20260709 13:05:00.062160 13483 tablet.cc:1724] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.055903 12984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b"
dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
 from {username='slave'} at 127.0.0.1:40124
I20260709 13:05:00.066073   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:05:00.067413 13489 log.cc:927] Time spent T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:05:00.067682   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:00.067919 13504 tablet.cc:1724] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.076599 12984 raft_consensus.cc:493] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.072477 13465 tablet.cc:1724] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.065271 13502 tablet.cc:1724] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.084264 12984 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.070465 13503 tablet.cc:1724] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:00.088426 13500 log.cc:927] Time spent T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:00.088235 13484 raft_consensus.cc:993] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:05:00.098649 13484 raft_consensus.cc:1081] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Signalling peer c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:05:00.108523 13475 tablet.cc:1724] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.120285 13492 tablet.cc:1724] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.121507 13507 tablet.cc:1724] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.123442 13502 tablet.cc:1724] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.125847 13132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:41940
I20260709 13:05:00.127351 13132 raft_consensus.cc:493] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.140061 13132 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.133126 12984 raft_consensus.cc:515] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.156868 12984 leader_election.cc:290] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 4 election: Requested vote from peers f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565), c9234ca90d6f47ec9da746900014f94e (127.0.107.195:41979)
I20260709 13:05:00.156358 13508 tablet.cc:1724] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.158293 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
I20260709 13:05:00.153429 13465 tablet.cc:1724] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.159116 13129 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.158839 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee261e2164d4d3884057e39a644d70b" candidate_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:05:00.160002 13056 raft_consensus.cc:3055] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.160394 13056 raft_consensus.cc:740] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:05:00.161211 13056 consensus_queue.cc:260] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.162243 13056 raft_consensus.cc:3060] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.146950 13479 tablet.cc:1724] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.167495 13129 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 4.
I20260709 13:05:00.169001 12951 leader_election.cc:304] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:05:00.172708 13482 raft_consensus.cc:2804] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:00.173272 13482 raft_consensus.cc:697] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 LEADER]: Becoming Leader. State: Replica: e863e18bda0c4e6bb1cc6418867a0a90, State: Running, Role: LEADER
I20260709 13:05:00.174158 13482 consensus_queue.cc:237] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.172501 13481 tablet.cc:1724] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.183048 13492 tablet.cc:1724] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.183349 13508 tablet.cc:1724] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.191152 13504 tablet.cc:1724] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.198961 13483 tablet.cc:1724] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.206470 13475 tablet.cc:1724] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:00.191216 13056 raft_consensus.cc:2468] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e863e18bda0c4e6bb1cc6418867a0a90 in term 4.
I20260709 13:05:00.227212 12879 catalog_manager.cc:5697] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 reported cstate change: term changed from 3 to 4, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.229274 13132 raft_consensus.cc:515] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.234900 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:05:00.235762 12980 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.244902 12980 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 3.
I20260709 13:05:00.245687 13132 leader_election.cc:290] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:05:00.246531 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2ab5535d94eb5aa2ad572b3ed3d72" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:05:00.247174 13056 raft_consensus.cc:3055] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.247293 13099 leader_election.cc:304] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:05:00.247526 13056 raft_consensus.cc:740] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:05:00.248262 13433 raft_consensus.cc:2804] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.248449 13056 consensus_queue.cc:260] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.248996 13433 raft_consensus.cc:697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 3 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:05:00.249883 13056 raft_consensus.cc:3060] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.250339 12881 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: soft_deleted_table [id=834712af486e4068b79d9182972b6130] alter complete (version 1)
I20260709 13:05:00.250133 13433 consensus_queue.cc:237] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.262718 13056 raft_consensus.cc:2468] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 3.
I20260709 13:05:00.275781 12881 catalog_manager.cc:5697] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 2 to 3, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.474525 13491 raft_consensus.cc:993] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: : Instructing follower c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:05:00.475030 13439 raft_consensus.cc:1081] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Signalling peer c9234ca90d6f47ec9da746900014f94e to start an election
I20260709 13:05:00.476402 13132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e"
dest_uuid: "c9234ca90d6f47ec9da746900014f94e"
 from {username='slave'} at 127.0.0.1:41940
I20260709 13:05:00.476871 13132 raft_consensus.cc:493] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.477133 13132 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.481995 13132 raft_consensus.cc:515] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.483500 13132 leader_election.cc:290] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 election: Requested vote from peers e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691), f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565)
I20260709 13:05:00.484395 12980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e863e18bda0c4e6bb1cc6418867a0a90"
I20260709 13:05:00.484469 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e39c10c6de461eb4a55cc7e17f4f4e" candidate_uuid: "c9234ca90d6f47ec9da746900014f94e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f26aaafed2dc4853a7d606d8611f3b6e"
I20260709 13:05:00.485061 12980 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.485127 13056 raft_consensus.cc:3055] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.485513 13056 raft_consensus.cc:740] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f26aaafed2dc4853a7d606d8611f3b6e, State: Running, Role: LEADER
I20260709 13:05:00.486260 13056 consensus_queue.cc:260] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.487412 13056 raft_consensus.cc:3060] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.491094 12980 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 3.
I20260709 13:05:00.492339 13099 leader_election.cc:304] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9234ca90d6f47ec9da746900014f94e, e863e18bda0c4e6bb1cc6418867a0a90; no voters: 
I20260709 13:05:00.492971 13433 raft_consensus.cc:2804] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.492897 13056 raft_consensus.cc:2468] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9234ca90d6f47ec9da746900014f94e in term 3.
I20260709 13:05:00.493616 13433 raft_consensus.cc:697] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 3 LEADER]: Becoming Leader. State: Replica: c9234ca90d6f47ec9da746900014f94e, State: Running, Role: LEADER
I20260709 13:05:00.494423 13433 consensus_queue.cc:237] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } }
I20260709 13:05:00.501824 12881 catalog_manager.cc:5697] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e reported cstate change: term changed from 2 to 3, leader changed from f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194) to c9234ca90d6f47ec9da746900014f94e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9234ca90d6f47ec9da746900014f94e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.588964 13129 raft_consensus.cc:1275] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:00.590644 13482 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9234ca90d6f47ec9da746900014f94e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.606871 13056 raft_consensus.cc:1275] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Refusing update from remote peer e863e18bda0c4e6bb1cc6418867a0a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:00.608227 13496 consensus_queue.cc:1048] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.798224 12980 raft_consensus.cc:1275] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.800168 13433 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:00.815002 13056 raft_consensus.cc:1275] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.817113 13487 consensus_queue.cc:1048] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:00.892041 12980 raft_consensus.cc:1275] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.893358 13487 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e863e18bda0c4e6bb1cc6418867a0a90" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.909188 13056 raft_consensus.cc:1275] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Refusing update from remote peer c9234ca90d6f47ec9da746900014f94e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.915109 13526 consensus_queue.cc:1048] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26aaafed2dc4853a7d606d8611f3b6e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:01.140848   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:01.162756 13025 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:05:01.169147 13025 consensus_peers.cc:597] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.182801   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:01.184123   431 tablet_replica.cc:333] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.185547   431 raft_consensus.cc:2243] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.187469   431 raft_consensus.cc:2272] T 9701f6d987074eca883851591385fca9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.193635   431 tablet_replica.cc:333] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.194463   431 raft_consensus.cc:2243] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.195292   431 raft_consensus.cc:2272] T 6f784b95ca434e21a7dc49e2aa74b992 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:01.198840 13099 consensus_peers.cc:597] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.201216   431 tablet_replica.cc:333] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.202142   431 raft_consensus.cc:2243] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.202776   431 raft_consensus.cc:2272] T d91983ab064b4cf7bed2a6ec40a12df2 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.206327   431 tablet_replica.cc:333] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.206966   431 raft_consensus.cc:2243] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.207672   431 raft_consensus.cc:2272] T 9fed803358c848c6a1777e015b7e13dd P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.212510   431 tablet_replica.cc:333] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.213099   431 raft_consensus.cc:2243] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.213644   431 raft_consensus.cc:2272] T b8485ac7973d44fca1eaf8787767944f P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.217880   431 tablet_replica.cc:333] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.218905   431 raft_consensus.cc:2243] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.219751   431 raft_consensus.cc:2272] T 408806ab563f45b9b95c3fade2a5457a P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:01.222872 13025 consensus_peers.cc:597] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.223637   431 tablet_replica.cc:333] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.224619   431 raft_consensus.cc:2243] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.225544   431 raft_consensus.cc:2272] T 533c8beeb5b14b818c59a3e9b94f9894 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.230763   431 tablet_replica.cc:333] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.232077   431 raft_consensus.cc:2243] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.233698   431 raft_consensus.cc:2272] T f811aa4c44b145308d5fa68235631281 P e863e18bda0c4e6bb1cc6418867a0a90 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:01.237792 13099 consensus_peers.cc:597] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.238304   431 tablet_replica.cc:333] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.239125   431 raft_consensus.cc:2243] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.239702   431 raft_consensus.cc:2272] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.243337   431 tablet_replica.cc:333] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.244027   431 raft_consensus.cc:2243] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.245225   431 raft_consensus.cc:2272] T 16715487ee694869a9a42acfa6a00093 P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.248457   431 tablet_replica.cc:333] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.249174   431 raft_consensus.cc:2243] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.250195   431 raft_consensus.cc:2272] T 2ee261e2164d4d3884057e39a644d70b P e863e18bda0c4e6bb1cc6418867a0a90 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.254035   431 tablet_replica.cc:333] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.254908   431 raft_consensus.cc:2243] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.256196   431 raft_consensus.cc:2272] T 84114706e61c423aa854eabdc19b0194 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.259116   431 tablet_replica.cc:333] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.259967   431 raft_consensus.cc:2243] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.260663   431 raft_consensus.cc:2272] T 83e39c10c6de461eb4a55cc7e17f4f4e P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.263693   431 tablet_replica.cc:333] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.264358   431 raft_consensus.cc:2243] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.264890   431 raft_consensus.cc:2272] T 66a132b6257f470795d0fec8310b9cc8 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.268543   431 tablet_replica.cc:333] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.269260   431 raft_consensus.cc:2243] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.270370   431 raft_consensus.cc:2272] T 80363cb1708f44099a07554e64889035 P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.274766   431 tablet_replica.cc:333] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.275434   431 raft_consensus.cc:2243] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.276080   431 raft_consensus.cc:2272] T df2275545f3a4c9e8123f50fdf8174d9 P e863e18bda0c4e6bb1cc6418867a0a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.279106   431 tablet_replica.cc:333] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.279723   431 raft_consensus.cc:2243] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.280354   431 raft_consensus.cc:2272] T 89b173ad655e438291e88fc6a7920bbc P e863e18bda0c4e6bb1cc6418867a0a90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.282963   431 tablet_replica.cc:333] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90: stopping tablet replica
I20260709 13:05:01.283434   431 raft_consensus.cc:2243] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.284411   431 raft_consensus.cc:2272] T 5e3ea38d9225417ab87c10e48c5193ef P e863e18bda0c4e6bb1cc6418867a0a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.337394   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:01.357473 13099 consensus_peers.cc:597] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:01.357935 13025 consensus_peers.cc:597] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:01.367724 13025 consensus_peers.cc:597] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:01.387226 13099 consensus_peers.cc:597] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.399654   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:01.429210   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:01.429979   431 tablet_replica.cc:333] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.430904   431 raft_consensus.cc:2243] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.432569   431 raft_consensus.cc:2272] T d91983ab064b4cf7bed2a6ec40a12df2 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.436419   431 tablet_replica.cc:333] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.437732   431 raft_consensus.cc:2243] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.438345   431 raft_consensus.cc:2272] T 6f784b95ca434e21a7dc49e2aa74b992 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:01.441099 13025 consensus_peers.cc:597] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.441411   431 tablet_replica.cc:333] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.442200   431 raft_consensus.cc:2243] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.442787   431 raft_consensus.cc:2272] T 84114706e61c423aa854eabdc19b0194 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:01.442999 13025 consensus_peers.cc:597] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e -> Peer e863e18bda0c4e6bb1cc6418867a0a90 (127.0.107.193:33691): Couldn't send request to peer e863e18bda0c4e6bb1cc6418867a0a90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.445281   431 tablet_replica.cc:333] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.446126   431 raft_consensus.cc:2243] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.446715   431 raft_consensus.cc:2272] T 9701f6d987074eca883851591385fca9 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.449448   431 tablet_replica.cc:333] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.450143   431 raft_consensus.cc:2243] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.451617   431 raft_consensus.cc:2272] T 9fed803358c848c6a1777e015b7e13dd P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.455581   431 tablet_replica.cc:333] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.456269   431 raft_consensus.cc:2243] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.456785   431 raft_consensus.cc:2272] T 2ee261e2164d4d3884057e39a644d70b P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.459617   431 tablet_replica.cc:333] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.460189   431 raft_consensus.cc:2243] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.460938   431 raft_consensus.cc:2272] T 16715487ee694869a9a42acfa6a00093 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.463728   431 tablet_replica.cc:333] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.464264   431 raft_consensus.cc:2243] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:01.464576 13097 consensus_peers.cc:597] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e -> Peer f26aaafed2dc4853a7d606d8611f3b6e (127.0.107.194:39565): Couldn't send request to peer f26aaafed2dc4853a7d606d8611f3b6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.465255   431 raft_consensus.cc:2272] T b8485ac7973d44fca1eaf8787767944f P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.470537   431 tablet_replica.cc:333] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.471434   431 raft_consensus.cc:2243] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.472052   431 raft_consensus.cc:2272] T 408806ab563f45b9b95c3fade2a5457a P f26aaafed2dc4853a7d606d8611f3b6e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.475579   431 tablet_replica.cc:333] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.476361   431 raft_consensus.cc:2243] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.477309   431 raft_consensus.cc:2272] T 533c8beeb5b14b818c59a3e9b94f9894 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.479592   431 tablet_replica.cc:333] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.480185   431 raft_consensus.cc:2243] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.480747   431 raft_consensus.cc:2272] T f811aa4c44b145308d5fa68235631281 P f26aaafed2dc4853a7d606d8611f3b6e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.482915   431 tablet_replica.cc:333] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.483466   431 raft_consensus.cc:2243] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.483891   431 raft_consensus.cc:2272] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.486732   431 tablet_replica.cc:333] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.487447   431 raft_consensus.cc:2243] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.488179   431 raft_consensus.cc:2272] T 5e3ea38d9225417ab87c10e48c5193ef P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.490913   431 tablet_replica.cc:333] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.491808   431 raft_consensus.cc:2243] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.492880   431 raft_consensus.cc:2272] T df2275545f3a4c9e8123f50fdf8174d9 P f26aaafed2dc4853a7d606d8611f3b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.495473   431 tablet_replica.cc:333] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.496099   431 raft_consensus.cc:2243] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.496685   431 raft_consensus.cc:2272] T 80363cb1708f44099a07554e64889035 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.499118   431 tablet_replica.cc:333] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.499624   431 raft_consensus.cc:2243] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.500584   431 raft_consensus.cc:2272] T 66a132b6257f470795d0fec8310b9cc8 P f26aaafed2dc4853a7d606d8611f3b6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.502919   431 tablet_replica.cc:333] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.503453   431 raft_consensus.cc:2243] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.503897   431 raft_consensus.cc:2272] T 83e39c10c6de461eb4a55cc7e17f4f4e P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.509140   431 tablet_replica.cc:333] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e: stopping tablet replica
I20260709 13:05:01.509917   431 raft_consensus.cc:2243] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.511399   431 raft_consensus.cc:2272] T 89b173ad655e438291e88fc6a7920bbc P f26aaafed2dc4853a7d606d8611f3b6e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.563066   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:05:01.608817   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:01.648010   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:01.649325   431 tablet_replica.cc:333] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.650240   431 raft_consensus.cc:2243] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.650871   431 raft_consensus.cc:2272] T d91983ab064b4cf7bed2a6ec40a12df2 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.653291   431 tablet_replica.cc:333] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.654031   431 raft_consensus.cc:2243] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.654888   431 raft_consensus.cc:2272] T 6f784b95ca434e21a7dc49e2aa74b992 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.657191   431 tablet_replica.cc:333] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.657776   431 raft_consensus.cc:2243] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.658298   431 raft_consensus.cc:2272] T 9701f6d987074eca883851591385fca9 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.660616   431 tablet_replica.cc:333] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.661136   431 raft_consensus.cc:2243] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.661598   431 raft_consensus.cc:2272] T 9fed803358c848c6a1777e015b7e13dd P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.663753   431 tablet_replica.cc:333] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.664384   431 raft_consensus.cc:2243] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.664948   431 raft_consensus.cc:2272] T 84114706e61c423aa854eabdc19b0194 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.669121   431 tablet_replica.cc:333] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.670164   431 raft_consensus.cc:2243] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.670820   431 raft_consensus.cc:2272] T f811aa4c44b145308d5fa68235631281 P c9234ca90d6f47ec9da746900014f94e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.673450   431 tablet_replica.cc:333] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.674093   431 raft_consensus.cc:2243] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.675244   431 raft_consensus.cc:2272] T e4f2ab5535d94eb5aa2ad572b3ed3d72 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.678336   431 tablet_replica.cc:333] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.679019   431 raft_consensus.cc:2243] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.679589   431 raft_consensus.cc:2272] T 533c8beeb5b14b818c59a3e9b94f9894 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.681962   431 tablet_replica.cc:333] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.682523   431 raft_consensus.cc:2243] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.683032   431 raft_consensus.cc:2272] T b8485ac7973d44fca1eaf8787767944f P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.685318   431 tablet_replica.cc:333] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.686261   431 raft_consensus.cc:2243] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.687657   431 raft_consensus.cc:2272] T 408806ab563f45b9b95c3fade2a5457a P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.690963   431 tablet_replica.cc:333] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.691642   431 raft_consensus.cc:2243] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.692180   431 raft_consensus.cc:2272] T 16715487ee694869a9a42acfa6a00093 P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.694777   431 tablet_replica.cc:333] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.696022   431 raft_consensus.cc:2243] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.696686   431 raft_consensus.cc:2272] T 2ee261e2164d4d3884057e39a644d70b P c9234ca90d6f47ec9da746900014f94e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.699041   431 tablet_replica.cc:333] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.699636   431 raft_consensus.cc:2243] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.700667   431 raft_consensus.cc:2272] T 83e39c10c6de461eb4a55cc7e17f4f4e P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.704396   431 tablet_replica.cc:333] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.705010   431 raft_consensus.cc:2243] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.705575   431 raft_consensus.cc:2272] T 66a132b6257f470795d0fec8310b9cc8 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.707906   431 tablet_replica.cc:333] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.708513   431 raft_consensus.cc:2243] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.709235   431 raft_consensus.cc:2272] T 80363cb1708f44099a07554e64889035 P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.711699   431 tablet_replica.cc:333] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.712289   431 raft_consensus.cc:2243] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.713027   431 raft_consensus.cc:2272] T df2275545f3a4c9e8123f50fdf8174d9 P c9234ca90d6f47ec9da746900014f94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.715904   431 tablet_replica.cc:333] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.716483   431 raft_consensus.cc:2243] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.716995   431 raft_consensus.cc:2272] T 89b173ad655e438291e88fc6a7920bbc P c9234ca90d6f47ec9da746900014f94e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.719092   431 tablet_replica.cc:333] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e: stopping tablet replica
I20260709 13:05:01.719550   431 raft_consensus.cc:2243] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.720059   431 raft_consensus.cc:2272] T 5e3ea38d9225417ab87c10e48c5193ef P c9234ca90d6f47ec9da746900014f94e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.782856   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:01.825822   431 master.cc:562] Master@127.0.107.254:35753 shutting down...
I20260709 13:05:01.849630   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:01.850436   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.850819   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5a18d2d0beb14a8c8b89ad87c77715aa: stopping tablet replica
I20260709 13:05:01.875949   431 master.cc:584] Master@127.0.107.254:35753 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (15762 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28558 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (364896 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:05:01.941778   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 402 messages since previous log ~561 seconds ago
I20260709 13:05:01.942028   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 407 messages since previous log ~561 seconds ago
I20260709 13:05:01.942191   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 407 messages since previous log ~561 seconds ago
I20260709 13:05:01.942416   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:05:01.942584   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:05:01.942764   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~125 seconds ago
I20260709 13:05:01.942987   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:05:01.943255   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 122 messages since previous log ~37 seconds ago
